Surfaced by today's untracked-files audit. None of these are accidents —
multiple are referenced by name in CLAUDE.md and memory files but were
never added.
Categories:
- docs/PHASE_AUDIT_GUIDE.md (106 LOC) — Claude Code phase audit guidance
- ops/systemd/lakehouse-langfuse-bridge.service — Langfuse bridge unit
- package.json — top-level npm manifest
- scripts/e2e_pipeline_check.sh + production_smoke.sh — real test scripts
- reports/kimi/audit-last-week*.md — the "Two reports live" CLAUDE.md cites
- tests/multi-agent/scenarios/ — 44 staffing scenarios (cutover decision A)
- tests/multi-agent/playbooks/ — 102 playbook records
- tests/battery/, tests/agent_test/PRD.md, tests/real-world/* — real tests
- sidecar/sidecar/{lab_ui,pipeline_lab}.py — 888 LOC dev-only UIs that
remain in service post-sidecar-drop (commit ba928b1 explicitly kept them)
Sensitivity check: scenarios use synthetic company names ("Heritage Foods",
"Cornerstone Fabrication"); audit reports describe code findings only;
no PII or secrets surfaced.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
26 lines
792 B
Markdown
26 lines
792 B
Markdown
# KB Measurement Report
|
|
|
|
Generated from 26 runs across 24 distinct signatures.
|
|
|
|
## Recommender confidence
|
|
- high: 23
|
|
- medium: 1
|
|
- low: 3
|
|
|
|
## Overall fill + citation
|
|
- Fill rate: **60/86** (69.8%)
|
|
- Avg citations per run: **1.38**
|
|
- Avg turns per run: 6.6
|
|
|
|
## Citation coverage by (role, city, state)
|
|
- Combos with ≥1 citation: 9
|
|
- Combos with ok fills but 0 citations: 31
|
|
|
|
## Item 3 decision signal
|
|
Non-zero: there are **combos that succeeded but never triggered playbook_memory boost**. Candidates for item 3 investigation:
|
|
- Machine Operator in Indianapolis, IN: 1/1 ok, 0 cites
|
|
- Assembler in Indianapolis, IN: 2/2 ok, 0 cites
|
|
- Warehouse Associate in Indianapolis, IN: 1/1 ok, 0 cites
|
|
- Forklift Operator in Cleveland, OH: 1/1 ok, 0 cites
|
|
- Assembler in Cleveland, OH: 2/2 ok, 0 cites
|