41b0a99ed2
Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.
Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)
Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
5.2 KiB
5.2 KiB
Scenario retrospective — Ironclad Industrial, 2026-04-22
Executor: qwen3.5:latest Reviewer: qwen3:latest Draft: qwen2.5:latest Overview(T3): gpt-oss:120b (cloud)
Prior lessons loaded into executor context: 3 (from 2026-05-10, 2026-05-08, 2026-05-05)
Events
| At | Kind | Role / Count | Pool | Fills | Turns | Dur(s) | Cites | Gaps |
|---|---|---|---|---|---|---|---|---|
| 07:00 | baseline_fill | Electrician × 5 | - | ✗ 0 | 0 | 23.2 | 0 | 1 |
| 09:30 | expansion | Safety Coordinator × 8 | 41 | ✓ 8 | 3 | 22.4 | 0 | 7 |
| 11:45 | emergency | Welder × 3 | - | ✗ 0 | 0 | 21.7 | 0 | 1 |
| 14:00 | expansion | Tool & Die Maker × 4 | 133 | ✓ 4 | 2 | 13.6 | 2 | 4 |
| 15:30 | misplacement | Electrician × 1 | 189 | ✓ 1 | 3 | 19.9 | 0 | 1 |
Final roster
| Worker | Booked | Role | City, ST | Status |
|---|---|---|---|---|
| undefined Ivan G. Castillo | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined Rachel W. Wilson | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined Lisa M. Smith | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined Linda Cooper | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined Jessica Phillips | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined Michael A. Davis | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined Sarah J. Brown | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined David R. Miller | 09:30 | Safety Coordinator | Peoria, IL | confirmed |
| undefined Deborah D. Wilson | 14:00 | Tool & Die Maker | Grand Rapids, MI | confirmed |
| undefined Jerry Thompson | 14:00 | Tool & Die Maker | Grand Rapids, MI | confirmed |
| undefined Carolyn Lopez | 14:00 | Tool & Die Maker | Grand Rapids, MI | confirmed |
| undefined Kyle H. Ramos | 14:00 | Tool & Die Maker | Grand Rapids, MI | confirmed |
| undefined Barbara R. Price | 15:30 | Electrician | South Bend, IN | confirmed |
Gap signals
drift_or_tool
- 07:00 — aborted — 3 consecutive drift flags
- 11:45 — aborted — 3 consecutive drift flags
double_book
- 09:30 — undefined Rachel W. Wilson already booked for 09:30
- 09:30 — undefined Lisa M. Smith already booked for 09:30
- 09:30 — undefined Linda Cooper already booked for 09:30
- 09:30 — undefined Jessica Phillips already booked for 09:30
- 09:30 — undefined Michael A. Davis already booked for 09:30
- 09:30 — undefined Sarah J. Brown already booked for 09:30
- 09:30 — undefined David R. Miller already booked for 09:30
- 14:00 — undefined Deborah D. Wilson already booked for 09:30
- 14:00 — undefined Jerry Thompson already booked for 09:30
- 14:00 — undefined Carolyn Lopez already booked for 09:30
- 14:00 — undefined Kyle H. Ramos already booked for 09:30
- 15:30 — undefined Barbara R. Price already booked for 09:30
fairness
- cross-event — Ivan G. Castillo (undefined) booked 13 times today
write_through_audit
- post-run — playbook_memory has 1570 entries (ran 5 events, expected ≥ 3 new entries from this run)
Workers touched across the week
13 distinct workers made it through to a decision. Every one is accounted for below — no-shows flagged, rebookings noted, everyone visible.
| Worker ID | Name | Events | Outcome |
|---|---|---|---|
| W500K-36666 | Ivan G. Castillo | 09:30 expansion | booked |
| W500K-30806 | Rachel W. Wilson | 09:30 expansion | booked |
| W500K-20630 | Lisa M. Smith | 09:30 expansion | booked |
| W500K-666 | Linda Cooper | 09:30 expansion | booked |
| W500K-10439 | Jessica Phillips | 09:30 expansion | booked |
| W500K-36667 | Michael A. Davis | 09:30 expansion | booked |
| W500K-30807 | Sarah J. Brown | 09:30 expansion | booked |
| W500K-20631 | David R. Miller | 09:30 expansion | booked |
| W500K-49117 | Deborah D. Wilson | 14:00 expansion | booked |
| W500K-4243 | Jerry Thompson | 14:00 expansion | booked |
| W500K-14314 | Carolyn Lopez | 14:00 expansion | booked |
| W500K-15737 | Kyle H. Ramos | 14:00 expansion | booked |
| 30931 | Barbara R. Price | 15:30 misplacement | booked |
Discovered patterns (meta-index)
What the system identified across semantically-similar past fills as each event ran:
- 07:00 baseline_fill (Electrician): —
- 09:30 expansion (Safety Coordinator): Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (46%) · archetype mostly: communicator · reliability median 0.77 (range 0.19–1.00)
- 11:45 emergency (Welder): —
- 14:00 expansion (Tool & Die Maker): Across 25 similar past playbooks (36 workers examined) · recurring certifications: OSHA-10 (47%) · archetype mostly: communicator · reliability median 0.80 (range 0.19–1.00)
- 15:30 misplacement (Electrician): Across 25 similar past playbooks (28 workers examined) · recurring certifications: OSHA-10 (43%) · archetype mostly: communicator · reliability median 0.80 (range 0.34–1.00)
Narrative
- 3/5 events reached consensus.
- Final roster: 13 bookings across 1 distinct workers.
- Workers touched (booked, failed, or otherwise decided): 13.
- Playbook citations across the day: 2 (proof the feedback loop fired across events).
- Dropped events: 07:00 baseline_fill, 11:45 emergency.