distillation: regenerate v1.0.0 release artifacts
Some checks failed
lakehouse/auditor 13 blocking issues: cloud: claim not backed — "Phase 8 done-criteria (per spec):"
Some checks failed
lakehouse/auditor 13 blocking issues: cloud: claim not backed — "Phase 8 done-criteria (per spec):"
Auto-generated by `./scripts/distill release-freeze` — RELEASE-READY (6/6 gates). Captures the v1.0.0 manifest + the latest acceptance + audit reports re-run during the freeze. reports/distillation/release-freeze.md human-readable manifest reports/distillation/release-manifest.json machine-readable manifest reports/distillation/phase6-acceptance-report.md re-run during freeze (22/22 invariants) reports/distillation/phase8-full-audit-report.md re-run during freeze (16/16 required) Pre-tag state: branch: scrum/auto-apply-19814 head: <prior commit before this one> full pipeline: 145 distillation tests pass · 0 fail acceptance: 22/22 invariants on fixture, bit-identical reproducibility audit-full: 16/16 required across Phases 0-7 Tag command awaiting operator confirmation: git tag -a distillation-v1.0.0 -m "distillation v1.0.0 — 8-phase substrate frozen" git push origin distillation-v1.0.0 Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
parent
73f242e3e4
commit
e7636f202b
@ -1,6 +1,6 @@
|
||||
# Phase 6 — Acceptance Gate Report
|
||||
|
||||
**Run:** 2026-04-27T04:18:55.356Z
|
||||
**Run:** 2026-04-27T04:54:32.225Z
|
||||
**Fixture:** `tests/fixtures/distillation/acceptance/`
|
||||
**Temp root:** `/tmp/distillation_phase6_acceptance`
|
||||
**Pipeline run_ids:** `acceptance-run-1-stable` (first) + `acceptance-run-2-stable` (second / hash reproducibility)
|
||||
|
||||
@ -1,8 +1,8 @@
|
||||
# Phase 8 — Full System Audit Report
|
||||
|
||||
**Run:** 2026-04-27T04:48:13.582Z
|
||||
**Git commit:** 681f39d5fa159849f56856d15474049533337ba9
|
||||
**Baseline:** 2026-04-27T04:47:30.220Z (681f39d5fa15)
|
||||
**Run:** 2026-04-27T04:54:32.283Z
|
||||
**Git commit:** 73f242e3e41c2aa36b35fe9de54742b248915cb5
|
||||
**Baseline:** 2026-04-27T04:53:45.796Z (5bdd159966e6)
|
||||
|
||||
## Result: **PASS** ✓
|
||||
|
||||
@ -26,7 +26,7 @@
|
||||
| 1 | P0 | recon doc exists | Y | docs/recon/local-distillation-recon.md present | present | ✓ |
|
||||
| 2 | P0 | tier-1 source streams present | — | all 4 tier-1 jsonls on disk | all present | ✓ |
|
||||
| 3 | P1 | schema validators pass on fixtures | Y | ≥40 tests, 0 fail | 51 pass, 0 fail | ✓ |
|
||||
| 4 | P2 | materializer dry-run completes | Y | >=1 row from each tier-1 source | 1069 read · 12 written · 2 skipped | ✓ |
|
||||
| 4 | P2 | materializer dry-run completes | Y | >=1 row from each tier-1 source | 1073 read · 16 written · 2 skipped | ✓ |
|
||||
| 5 | P2 | tier-1 sources each materialize ≥1 row | — | 4/4: distilled_facts, scrum_reviews, audit_facts, mode_experiments | 1/4 hit (mode_experiments) | ✓ |
|
||||
| 6 | P3 | on-disk scored-runs distribution non-empty | Y | >=1 accepted | acc=386 part=132 rej=57 hum=480 | ✓ |
|
||||
| 7 | P3 | scored-runs distribution sums positive | — | >0 total | 1055 total | ✓ |
|
||||
@ -38,24 +38,24 @@
|
||||
| 13 | P5 | latest run (3fa51d66-784c-4c7d-843d-6c48328a608c) has all 5 stage receipts | Y | collect,score,export-rag,export-sft,export-preference | all present | ✓ |
|
||||
| 14 | P5 | every stage receipt validates against schema | Y | 0 invalid | 0 invalid | ✓ |
|
||||
| 15 | P5 | RunSummary validates | Y | valid | valid | ✓ |
|
||||
| 16 | P5 | summary.git_commit is 40-char hex | — | match | 68b6697bcb38... (HEAD: 681f39d5fa15...) | ✓ |
|
||||
| 16 | P5 | summary.git_commit is 40-char hex | — | match | 68b6697bcb38... (HEAD: 73f242e3e41c...) | ✓ |
|
||||
| 17 | P5 | run_hash is sha256 | Y | /^[0-9a-f]{64}$/ | 2336b96c3638982d... | ✓ |
|
||||
| 18 | P6 | acceptance gate passes 22/22 invariants on fixture | Y | PASS — 22/22 | 22/22 (exit=0) | ✓ |
|
||||
| 19 | P7 | replay validation passes on 3/3 dry-run sample tasks | Y | 3/3 | 3/3 | ✓ |
|
||||
| 20 | P7 | replay retrieval surfaces ≥1 playbook on each task (when corpus present) | — | ≥1 task with retrieval | 3/3 | ✓ |
|
||||
| 21 | P7 | escalation loop guard: no path > 2 models | Y | 0 loops | 0 | ✓ |
|
||||
| 22 | P7 | replay_runs.jsonl populated by audit run | — | exists with ≥3 rows added | 12 rows total | ✓ |
|
||||
| 22 | P7 | replay_runs.jsonl populated by audit run | — | exists with ≥3 rows added | 21 rows total | ✓ |
|
||||
|
||||
## Drift vs prior baseline
|
||||
|
||||
| Metric | Baseline | Current | Δ% | Flag |
|
||||
|---|---|---|---|---|
|
||||
| p2_evidence_rows | 12 | 12 | 0% | ok |
|
||||
| p2_evidence_rows | 15 | 16 | 7% | ok |
|
||||
| p2_evidence_skips | 2 | 2 | 0% | ok |
|
||||
| p3_accepted | 0 | 386 | — | ok |
|
||||
| p3_partial | 0 | 132 | — | ok |
|
||||
| p3_rejected | 0 | 57 | — | ok |
|
||||
| p3_human | 0 | 480 | — | ok |
|
||||
| p3_accepted | 386 | 386 | 0% | ok |
|
||||
| p3_partial | 132 | 132 | 0% | ok |
|
||||
| p3_rejected | 57 | 57 | 0% | ok |
|
||||
| p3_human | 480 | 480 | 0% | ok |
|
||||
| p4_rag_rows | 448 | 448 | 0% | ok |
|
||||
| p4_sft_rows | 353 | 353 | 0% | ok |
|
||||
| p4_pref_pairs | 83 | 83 | 0% | ok |
|
||||
|
||||
78
reports/distillation/release-freeze.md
Normal file
78
reports/distillation/release-freeze.md
Normal file
@ -0,0 +1,78 @@
|
||||
# Distillation Release Freeze — v1.0.0
|
||||
|
||||
**Tag (proposed):** `distillation-v1.0.0`
|
||||
**Released at:** 2026-04-27T04:54:32.299Z
|
||||
**Git head:** `73f242e3e41c2aa36b35fe9de54742b248915cb5`
|
||||
**Branch:** scrum/auto-apply-19814
|
||||
|
||||
## Result: **RELEASE-READY** ✓
|
||||
|
||||
## Gates
|
||||
|
||||
| # | Gate | Status | Detail |
|
||||
|---|---|---|---|
|
||||
| 1 | clean git state (no source-tree modifications) | ✓ | tree clean (2 auto-regenerated reports tolerated) |
|
||||
| 2 | full test suite (bun test tests/distillation/ auditor/schemas/distillation/) | ✓ | 145 pass, 0 fail (exit=0) |
|
||||
| 3 | every phase commit resolves | ✓ | 9/9 commits verified |
|
||||
| 4 | acceptance gate (22-invariant fixture E2E) | ✓ | 22/22 invariants |
|
||||
| 5 | audit-full (Phases 0-7 verified + drift) | ✓ | 16/16 required checks |
|
||||
| 6 | tag distillation-v1.0.0 available (does not yet exist) | ✓ | tag name is free |
|
||||
|
||||
## Phase commits
|
||||
|
||||
| Phase | Commit | Subject |
|
||||
|---|---|---|
|
||||
| 0+1+2 scaffold | `27b1d27` | distillation: Phase 0 recon + Phase 1 schemas + Phase 2 transforms scaffold |
|
||||
| 2 materializer | `1ea8029` | distillation: Phase 2 — Evidence View materializer + health audit |
|
||||
| 3 scorer | `c989253` | distillation: Phase 3 — deterministic Success Scorer |
|
||||
| 4 exports | `68b6697` | distillation: Phase 4 — dataset export layer |
|
||||
| 5 receipts | `2cf359a` | distillation: Phase 5 — receipts harness (system-level observability) |
|
||||
| 6 acceptance | `1b433a9` | distillation: Phase 6 — acceptance gate suite |
|
||||
| auditor rebuild | `20a039c` | auditor: rebuild on mode runner + drop tree-split (use distillation substrate) |
|
||||
| 7 replay | `681f39d` | distillation: Phase 7 — replay-driven local model bootstrapping |
|
||||
| 8 audit-full | `5bdd159` | distillation: Phase 8 — full system audit |
|
||||
|
||||
## Dataset counts at freeze
|
||||
|
||||
| Artifact | Count |
|
||||
|---|---|
|
||||
| RAG rows | 448 |
|
||||
| SFT rows (strict accepted-only) | 353 |
|
||||
| Preference pairs | 83 |
|
||||
| Evidence files | 12 |
|
||||
| Evidence rows | 1055 |
|
||||
| Scored-run files | 12 |
|
||||
| Scored rows | 1055 |
|
||||
| Quarantined total | 1325 |
|
||||
|
||||
## Latest audit baseline
|
||||
|
||||
```json
|
||||
{
|
||||
"recorded_at": "2026-04-27T04:54:32.282Z",
|
||||
"git_commit": "73f242e3e41c2aa36b35fe9de54742b248915cb5",
|
||||
"metrics": {
|
||||
"p2_evidence_rows": 16,
|
||||
"p2_evidence_skips": 2,
|
||||
"p3_accepted": 386,
|
||||
"p3_partial": 132,
|
||||
"p3_rejected": 57,
|
||||
"p3_human": 480,
|
||||
"p4_rag_rows": 448,
|
||||
"p4_sft_rows": 353,
|
||||
"p4_pref_pairs": 83,
|
||||
"p4_total_quarantined": 1325
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
## Tag command (run after release-ready confirmation)
|
||||
|
||||
```bash
|
||||
git tag -a distillation-v1.0.0 73f242e3e41c -m "distillation v1.0.0 — 8-phase substrate frozen"
|
||||
git push origin distillation-v1.0.0
|
||||
```
|
||||
|
||||
## Failure detail
|
||||
|
||||
(no failures)
|
||||
114
reports/distillation/release-manifest.json
Normal file
114
reports/distillation/release-manifest.json
Normal file
@ -0,0 +1,114 @@
|
||||
{
|
||||
"schema": "distillation_release_manifest.v1",
|
||||
"version": "v1.0.0",
|
||||
"tag": "distillation-v1.0.0",
|
||||
"released_at": "2026-04-27T04:54:32.299Z",
|
||||
"git_head": "73f242e3e41c2aa36b35fe9de54742b248915cb5",
|
||||
"git_branch": "scrum/auto-apply-19814",
|
||||
"phase_commits": [
|
||||
{
|
||||
"phase": "0+1+2 scaffold",
|
||||
"commit": "27b1d27",
|
||||
"subject": "distillation: Phase 0 recon + Phase 1 schemas + Phase 2 transforms scaffold"
|
||||
},
|
||||
{
|
||||
"phase": "2 materializer",
|
||||
"commit": "1ea8029",
|
||||
"subject": "distillation: Phase 2 — Evidence View materializer + health audit"
|
||||
},
|
||||
{
|
||||
"phase": "3 scorer",
|
||||
"commit": "c989253",
|
||||
"subject": "distillation: Phase 3 — deterministic Success Scorer"
|
||||
},
|
||||
{
|
||||
"phase": "4 exports",
|
||||
"commit": "68b6697",
|
||||
"subject": "distillation: Phase 4 — dataset export layer"
|
||||
},
|
||||
{
|
||||
"phase": "5 receipts",
|
||||
"commit": "2cf359a",
|
||||
"subject": "distillation: Phase 5 — receipts harness (system-level observability)"
|
||||
},
|
||||
{
|
||||
"phase": "6 acceptance",
|
||||
"commit": "1b433a9",
|
||||
"subject": "distillation: Phase 6 — acceptance gate suite"
|
||||
},
|
||||
{
|
||||
"phase": "auditor rebuild",
|
||||
"commit": "20a039c",
|
||||
"subject": "auditor: rebuild on mode runner + drop tree-split (use distillation substrate)"
|
||||
},
|
||||
{
|
||||
"phase": "7 replay",
|
||||
"commit": "681f39d",
|
||||
"subject": "distillation: Phase 7 — replay-driven local model bootstrapping"
|
||||
},
|
||||
{
|
||||
"phase": "8 audit-full",
|
||||
"commit": "5bdd159",
|
||||
"subject": "distillation: Phase 8 — full system audit"
|
||||
}
|
||||
],
|
||||
"dataset_counts": {
|
||||
"rag_rows": 448,
|
||||
"sft_rows": 353,
|
||||
"preference_pairs": 83,
|
||||
"evidence_files": 12,
|
||||
"evidence_rows": 1055,
|
||||
"scored_files": 12,
|
||||
"scored_rows": 1055,
|
||||
"quarantined_total": 1325
|
||||
},
|
||||
"latest_baseline": {
|
||||
"recorded_at": "2026-04-27T04:54:32.282Z",
|
||||
"git_commit": "73f242e3e41c2aa36b35fe9de54742b248915cb5",
|
||||
"metrics": {
|
||||
"p2_evidence_rows": 16,
|
||||
"p2_evidence_skips": 2,
|
||||
"p3_accepted": 386,
|
||||
"p3_partial": 132,
|
||||
"p3_rejected": 57,
|
||||
"p3_human": 480,
|
||||
"p4_rag_rows": 448,
|
||||
"p4_sft_rows": 353,
|
||||
"p4_pref_pairs": 83,
|
||||
"p4_total_quarantined": 1325
|
||||
}
|
||||
},
|
||||
"gates": [
|
||||
{
|
||||
"name": "clean git state (no source-tree modifications)",
|
||||
"passed": true,
|
||||
"detail": "tree clean (2 auto-regenerated reports tolerated)"
|
||||
},
|
||||
{
|
||||
"name": "full test suite (bun test tests/distillation/ auditor/schemas/distillation/)",
|
||||
"passed": true,
|
||||
"detail": "145 pass, 0 fail (exit=0)"
|
||||
},
|
||||
{
|
||||
"name": "every phase commit resolves",
|
||||
"passed": true,
|
||||
"detail": "9/9 commits verified"
|
||||
},
|
||||
{
|
||||
"name": "acceptance gate (22-invariant fixture E2E)",
|
||||
"passed": true,
|
||||
"detail": "22/22 invariants"
|
||||
},
|
||||
{
|
||||
"name": "audit-full (Phases 0-7 verified + drift)",
|
||||
"passed": true,
|
||||
"detail": "16/16 required checks"
|
||||
},
|
||||
{
|
||||
"name": "tag distillation-v1.0.0 available (does not yet exist)",
|
||||
"passed": true,
|
||||
"detail": "tag name is free"
|
||||
}
|
||||
],
|
||||
"passed": true
|
||||
}
|
||||
Loading…
x
Reference in New Issue
Block a user