41b0a99ed2
Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.
Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)
Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
85 lines
4.5 KiB
Markdown
85 lines
4.5 KiB
Markdown
# Scenario retrospective — Riverfront Steel, 2026-04-21
|
||
|
||
Executor: `mistral:latest` Reviewer: `qwen2.5:latest` Draft: `qwen2.5:latest`
|
||
|
||
## Events
|
||
|
||
| At | Kind | Role / Count | Pool | Fills | Turns | Dur(s) | Cites | Gaps |
|
||
|---|---|---|---|---|---|---|---|---|
|
||
| 08:00 | baseline_fill | Warehouse Associate × 3 | - | ✗ 0 | 0 | 20.2 | 0 | 1 |
|
||
| 10:30 | recurring | Machine Operator × 2 | - | ✗ 0 | 0 | 47.4 | 0 | 1 |
|
||
| 12:15 | expansion | Forklift Operator × 5 | 687 | ✓ 5 | 7 | 28.2 | 0 | 4 |
|
||
| 14:00 | emergency | Loader × 4 | 380 | ✓ 4 | 6 | 22.3 | 0 | 4 |
|
||
| 15:45 | misplacement | Warehouse Associate × 1 | - | ✗ 0 | 0 | 52.5 | 0 | 1 |
|
||
|
||
## Final roster
|
||
|
||
| Worker | Booked | Role | City, ST | Status |
|
||
|---|---|---|---|---|
|
||
| undefined Jennifer K. Robinson | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||
| undefined Kyle F. Brooks | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||
| undefined Jacob T. Diaz | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||
| undefined Jerry M. Jones | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||
| undefined Jeffrey D. Taylor | 12:15 | Forklift Operator | Toledo, OH | confirmed |
|
||
| undefined Mary R. Richardson | 14:00 | Loader | Toledo, OH | confirmed |
|
||
| undefined Raj Torres | 14:00 | Loader | Toledo, OH | confirmed |
|
||
| undefined Brian X. Price | 14:00 | Loader | Toledo, OH | confirmed |
|
||
| undefined Fatima X. Gutierrez | 14:00 | Loader | Toledo, OH | confirmed |
|
||
|
||
## Gap signals
|
||
|
||
### drift_or_tool
|
||
- **08:00** — invalid JSON from executor: JSON Parse error: Invalid escape character ' | raw: {"kind":"plan","steps":["TOOL_CALL hybrid_search({'index_name':'workers_500k_v1','sql_filter':'role = \'Warehouse Associate\' AND city = \'Toledo\' AND state = \'OH\' AND CAST(availability AS DOUBLE) > 0.5','question':'reliable warehouse associate Toledo'})",
|
||
"TOOL_CALL sql({'query':'SELECT worker_i
|
||
- **10:30** — no consensus after 14 turns
|
||
- **15:45** — no consensus after 14 turns
|
||
|
||
### double_book
|
||
- **12:15** — undefined Kyle F. Brooks already booked for 12:15
|
||
- **12:15** — undefined Jacob T. Diaz already booked for 12:15
|
||
- **12:15** — undefined Jerry M. Jones already booked for 12:15
|
||
- **12:15** — undefined Jeffrey D. Taylor already booked for 12:15
|
||
- **14:00** — undefined Mary R. Richardson already booked for 12:15
|
||
- **14:00** — undefined Raj Torres already booked for 12:15
|
||
- **14:00** — undefined Brian X. Price already booked for 12:15
|
||
- **14:00** — undefined Fatima X. Gutierrez already booked for 12:15
|
||
|
||
### fairness
|
||
- _cross-event_ — Jennifer K. Robinson (undefined) booked 9 times today
|
||
|
||
### write_through_audit
|
||
- _post-run_ — playbook_memory has 167 entries (ran 5 events, expected ≥ 2 new entries from this run)
|
||
|
||
## Workers touched across the week
|
||
|
||
9 distinct workers made it through to a decision. Every one is accounted for below — no-shows flagged, rebookings noted, everyone visible.
|
||
|
||
| Worker ID | Name | Events | Outcome |
|
||
|---|---|---|---|
|
||
| W500K-37736 | Jennifer K. Robinson | 12:15 expansion | booked |
|
||
| W500K-33961 | Kyle F. Brooks | 12:15 expansion | booked |
|
||
| W500K-31297 | Jacob T. Diaz | 12:15 expansion | booked |
|
||
| W500K-40884 | Jerry M. Jones | 12:15 expansion | booked |
|
||
| W500K-37729 | Jeffrey D. Taylor | 12:15 expansion | booked |
|
||
| W500K-15305 | Mary R. Richardson | 14:00 emergency | booked |
|
||
| W500K-12325 | Raj Torres | 14:00 emergency | booked |
|
||
| W500K-16975 | Brian X. Price | 14:00 emergency | booked |
|
||
| W500K-22851 | Fatima X. Gutierrez | 14:00 emergency | booked |
|
||
|
||
## Discovered patterns (meta-index)
|
||
|
||
What the system identified across semantically-similar past fills as each event ran:
|
||
|
||
- **08:00 baseline_fill** (Warehouse Associate): —
|
||
- **10:30 recurring** (Machine Operator): —
|
||
- **12:15 expansion** (Forklift Operator): Across 25 similar past playbooks (10 workers examined) · recurring certifications: Forklift (40%), OSHA-10 (40%) · recurring skills: mill (40%) · archetype mostly: leader · reliability median 0.83 (range 0.66–0.96)
|
||
- **14:00 emergency** (Loader): Across 25 similar past playbooks (9 workers examined) · recurring certifications: Forklift (44%) · recurring skills: mill (44%) · archetype mostly: leader · reliability median 0.80 (range 0.66–0.96)
|
||
- **15:45 misplacement** (Warehouse Associate): —
|
||
|
||
## Narrative
|
||
|
||
- 2/5 events reached consensus.
|
||
- Final roster: 9 bookings across 1 distinct workers.
|
||
- Workers touched (booked, failed, or otherwise decided): 9.
|
||
- Playbook citations across the day: 0 (proof the feedback loop fired across events).
|
||
- Dropped events: 08:00 baseline_fill, 10:30 recurring, 15:45 misplacement. |