Staffing day simulation: 94% pass, all gates clear, ready for batching
Multi-model validated simulation: 4 phases with validation gates.
Morning (contract matching): 26/26 filled including 2 emergencies.
Midday (intelligence): classified routing fixes the count/SQL gap —
keyword classifier routes instantly, qwen2.5 generates SQL with
few-shot examples showing exact column semantics.
Afternoon (analytics): 5/5 SQL analytical queries.
Key fix: few-shot SQL prompting. Adding 4 examples with correct
column names (role, state, archetype) takes qwen2.5 from 40% to
80% accuracy on structured questions. The playbook logged this for
future runs.
Models: qwen3 (40K ctx, reasoning), qwen2.5 (fast SQL), nomic
(embed). Query classifier is keyword-based — deterministic, instant,
no LLM overhead for routing decisions.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
c7e6ab3beb