3263254f1c
Stress-tests the role gate with 40 queries (10 fill_events rows × 4
styles): need, client_first, looking, shorthand. Each row's role +
client + city stays the same; only the surface phrasing changes.
real_003 (original extractor) confirmed the shorthand-vs-shorthand
failure mode: CNC Operator shorthand recording leaked w-2404 onto
Forklift Operator shorthand query within the same Beacon Freight
Detroit cluster. Both record + query had empty role (extractor
returns "" for shorthand because there's no separator between role
and city), gate disabled, distance check passed, bleed fired.
Fix: extended extractRoleFromNeed to handle client_first
("{client} needs N {role} in...") and looking ("Looking for N
{role} at...") patterns. Shorthand left intentionally unmatched —
"Forklift Operator Detroit" is shape-indistinguishable from
"Forklift" + "Operator Detroit" without an LLM extractor or known-
cities lookup.
real_003b (extended extractor) verifies bleed closed across all 4
styles for this dataset. Forklift Operator queries keep w-2136 (the
cold-pass-correct match) regardless of which style the query came
in. Same-role boosts now fire correctly across styles — a CNC
Operator recording made in `looking` style boosts the CNC need-form
query.
scripts/cutover/gen_real_queries.go: added -styles flag with values
need|client_first|looking|shorthand|all (default need preserves
real_001/002 behavior). Tests/reality/real_coord_queries_v2.txt is
the 40-query stress file.
scripts/playbook_lift/main_test.go: 10 sub-tests lock the four
documented patterns + shorthand limitation + lift-suite-style
queries (no clean role, returns empty as expected).
Aggregate metrics:
- real_003 (original): disc=7, lift=7, boost=14, meanΔ=-0.108
- real_003b (extended): disc=11, lift=10, boost=31, meanΔ=-0.202
The growth reflects more LEGITIMATE same-role same-cluster transfer
firing across styles, not bleed (verified by per-cluster bleed
table — Forklift Operator queries unchanged across all 4 styles).
Known limitation documented in real_003_findings.md: same-cluster,
same-role queries in shorthand still embed close enough that a
shorthand recording could bleed onto a different-role shorthand
query if both record + query strip role. Closing this requires
LLM extraction or known-cities lookup at record + query time.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
55 lines
3.5 KiB
Plaintext
55 lines
3.5 KiB
Plaintext
# Real-shape coordinator queries — generated from fill_events.parquet
|
|
# (real-shape demand data; queries built mechanically from event rows).
|
|
# Source: /home/profit/lakehouse/data/datasets/fill_events.parquet (123 rows total, 10 emitted, styles=[need client_first looking shorthand])
|
|
#
|
|
# Styles:
|
|
# need: 'Need N {role}{s} in {city} {state} starting at {at} for {client}'
|
|
# — matches scripts/playbook_lift's extractRoleFromNeed regex
|
|
# client_first: '{client} needs N {role}{s} in {city} {state} at {at}'
|
|
# looking: 'Looking for N {role}{s} at {client} in {city} {state} for {at} shift'
|
|
# shorthand: 'N {role}{s} {city} {state} {at} {client}'
|
|
#
|
|
# Only 'need' currently extracts a role. The other three test the
|
|
# substrate's bleed behavior when the role gate is silently disabled.
|
|
|
|
Need 5 Warehouse Associates in Kansas City MO starting at 09:00 for Parallel Machining
|
|
Parallel Machining needs 5 Warehouse Associates in Kansas City MO at 09:00
|
|
Looking for 5 Warehouse Associates at Parallel Machining in Kansas City MO for 09:00 shift
|
|
5 Warehouse Associates Kansas City MO 09:00 Parallel Machining
|
|
Need 1 Forklift Operator in Detroit MI starting at 15:00 for Beacon Freight, deadline 2026-05-28
|
|
Beacon Freight needs 1 Forklift Operator in Detroit MI at 15:00
|
|
Looking for 1 Forklift Operator at Beacon Freight in Detroit MI for 15:00 shift
|
|
1 Forklift Operator Detroit MI 15:00 Beacon Freight
|
|
Need 4 Loaders in Indianapolis IN starting at 12:00 for Midway Distribution
|
|
Midway Distribution needs 4 Loaders in Indianapolis IN at 12:00
|
|
Looking for 4 Loaders at Midway Distribution in Indianapolis IN for 12:00 shift
|
|
4 Loaders Indianapolis IN 12:00 Midway Distribution
|
|
Need 3 Warehouse Associates in Fort Wayne IN starting at 17:30 for Cornerstone Fabrication, deadline 2026-05-17
|
|
Cornerstone Fabrication needs 3 Warehouse Associates in Fort Wayne IN at 17:30
|
|
Looking for 3 Warehouse Associates at Cornerstone Fabrication in Fort Wayne IN for 17:30 shift
|
|
3 Warehouse Associates Fort Wayne IN 17:30 Cornerstone Fabrication
|
|
Need 4 Pickers in Detroit MI starting at 13:30 for Beacon Freight, deadline 2026-05-28
|
|
Beacon Freight needs 4 Pickers in Detroit MI at 13:30
|
|
Looking for 4 Pickers at Beacon Freight in Detroit MI for 13:30 shift
|
|
4 Pickers Detroit MI 13:30 Beacon Freight
|
|
Need 2 Packers in Joliet IL starting at 09:30 for Parallel Machining
|
|
Parallel Machining needs 2 Packers in Joliet IL at 09:30
|
|
Looking for 2 Packers at Parallel Machining in Joliet IL for 09:30 shift
|
|
2 Packers Joliet IL 09:30 Parallel Machining
|
|
Need 3 Assemblers in Flint MI starting at 08:30 for Heritage Foods
|
|
Heritage Foods needs 3 Assemblers in Flint MI at 08:30
|
|
Looking for 3 Assemblers at Heritage Foods in Flint MI for 08:30 shift
|
|
3 Assemblers Flint MI 08:30 Heritage Foods
|
|
Need 3 Packers in Flint MI starting at 12:30 for Parallel Machining
|
|
Parallel Machining needs 3 Packers in Flint MI at 12:30
|
|
Looking for 3 Packers at Parallel Machining in Flint MI for 12:30 shift
|
|
3 Packers Flint MI 12:30 Parallel Machining
|
|
Need 1 Shipping Clerk in Flint MI starting at 17:00 for Pioneer Assembly
|
|
Pioneer Assembly needs 1 Shipping Clerk in Flint MI at 17:00
|
|
Looking for 1 Shipping Clerk at Pioneer Assembly in Flint MI for 17:00 shift
|
|
1 Shipping Clerk Flint MI 17:00 Pioneer Assembly
|
|
Need 1 CNC Operator in Detroit MI starting at 17:30 for Beacon Freight, deadline 2026-05-28
|
|
Beacon Freight needs 1 CNC Operator in Detroit MI at 17:30
|
|
Looking for 1 CNC Operator at Beacon Freight in Detroit MI for 17:30 shift
|
|
1 CNC Operator Detroit MI 17:30 Beacon Freight
|