95f155b017
Methodology fix: gen_real_queries.go gains -offset N flag. Every prior real_NNN test sourced queries from rows 0-9 of fill_events.parquet (default -limit 10), so the substrate's published "8/10 cold-pass top-1 = judge-best" was measured on a memorized slice, not held-out data. real_006 samples 50 fresh rows (offset 10, never seen by the workers or ethereal_workers corpora). Same harness, same local qwen2.5:latest judge, same K=10. ~14 min wall total. Local-only, no cloud calls. Headline findings: - Cold-pass top-1 = judge-best (rank match): 41/50 (82%) vs real_001's 8/10 (80%) — substrate generalizes at rank level. - Strict (rating ≥ 2): 34/50 (68%) — 12-point drop from real_001's 80%. ~7 of 41 "no-discovery" queries had cold top-1 the judge rated 1; the corpus has gaps for some role-city combos in the v3 slice. - Verbatim lift: 9/9 discoveries → warm top-1 (clean, matches real_001 2/2) - Paraphrase recovery: 6/9 → top-1, 9/9 any-rank - Quality regressed: 3/50 — Q43 is the structural one Q43 (Packer at Midway Distribution / Chicago IL) regressed from rating 5 to rating 2 on warm pass with `warm_boosted_count=0` and `playbook_recorded=false`. Q18 (Shipping Clerks at the same client+city) recorded a playbook entry. The regression suggests Q18's recording leaked into Q43 via the warm-pass playbook corpus retrieval surface even though the role gate from real_002 should have blocked it. Three possible paths: extractor failed on one query, gate fires on boost path but not Shape B inject, or cosine drift puts the recorded worker close enough to Q43's embedding that warm-pass retrieval picks it up directly. Diagnosis is the next move. Three same-(client, city) clusters tested: - Heritage Foods Gary IN × 3 distinct roles: clean, distinct workers - Riverfront Steel Columbus OH × 4: cosine-level confusion (Q9/Q25 surface same worker w-281 for Assemblers vs Quality Techs at cold- pass), but no playbook bleed - Midway Distribution Chicago IL × 3: Q43 regression as above What this confirms: substrate works on the fresh distribution at the rank level, verbatim lift is real, paraphrase recovery is real. What this falsifies: real_002's role-gate fix is not structurally airtight. The bleed pattern can still fire under conditions the prior tests didn't reach. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
65 lines
4.9 KiB
Plaintext
65 lines
4.9 KiB
Plaintext
# Real-shape coordinator queries — generated from fill_events.parquet
|
|
# (real-shape demand data; queries built mechanically from event rows).
|
|
# Source: /home/profit/lakehouse/data/datasets/fill_events.parquet (123 rows total, rows [10,60) emitted, styles=[need])
|
|
#
|
|
# Styles:
|
|
# need: 'Need N {role}{s} in {city} {state} starting at {at} for {client}'
|
|
# — matches scripts/playbook_lift's extractRoleFromNeed regex
|
|
# client_first: '{client} needs N {role}{s} in {city} {state} at {at}'
|
|
# looking: 'Looking for N {role}{s} at {client} in {city} {state} for {at} shift'
|
|
# shorthand: 'N {role}{s} {city} {state} {at} {client}'
|
|
#
|
|
# Only 'need' currently extracts a role. The other three test the
|
|
# substrate's bleed behavior when the role gate is silently disabled.
|
|
|
|
Need 1 Loader in Kansas City MO starting at 17:30 for Cornerstone Fabrication
|
|
Need 2 Assemblers in Cincinnati OH starting at 14:30 for Great Lakes Mfg
|
|
Need 1 Forklift Operator in Lexington KY starting at 08:30 for Vanguard Components, deadline 2026-05-20
|
|
Need 2 Assemblers in Flint MI starting at 08:30 for Centennial Packaging
|
|
Need 2 Welders in Indianapolis IN starting at 10:00 for Northland Logistics
|
|
Need 2 Material Handlers in Cincinnati OH starting at 13:00 for Great Lakes Mfg
|
|
Need 3 Pickers in Flint MI starting at 17:00 for Centennial Packaging
|
|
Need 3 Packers in Indianapolis IN starting at 09:00 for Heritage Foods, deadline 2026-05-04
|
|
Need 3 Assemblers in Columbus OH starting at 17:30 for Riverfront Steel
|
|
Need 5 Machine Operators in Cleveland OH starting at 14:30 for Apex Warehouse
|
|
Need 2 Assemblers in Grand Rapids MI starting at 13:00 for Cornerstone Fabrication, deadline 2026-05-21
|
|
Need 2 Pickers in Akron OH starting at 10:30 for Summit Industrial
|
|
Need 3 Quality Techs in Lexington KY starting at 12:30 for Keystone Plastics, deadline 2026-06-14
|
|
Need 4 Assemblers in Gary IN starting at 12:00 for Heritage Foods
|
|
Need 3 Packers in Toledo OH starting at 16:00 for Cornerstone Fabrication, deadline 2026-06-02
|
|
Need 4 Warehouse Associates in Fort Wayne IN starting at 13:00 for Cornerstone Fabrication, deadline 2026-05-17
|
|
Need 4 Assemblers in Columbus OH starting at 13:00 for Midway Distribution
|
|
Need 2 Shipping Clerks in Chicago IL starting at 17:00 for Midway Distribution
|
|
Need 2 Machine Operators in Chicago IL starting at 11:00 for Midway Distribution
|
|
Need 3 CNC Operators in Grand Rapids MI starting at 10:00 for Parallel Machining, deadline 2026-06-14
|
|
Need 1 Warehouse Associate in Lexington KY starting at 09:30 for Keystone Plastics, deadline 2026-06-14
|
|
Need 2 Material Handlers in Gary IN starting at 11:00 for Heritage Foods
|
|
Need 5 Assemblers in Fort Wayne IN starting at 16:30 for Midway Distribution, deadline 2026-06-09
|
|
Need 1 Loader in Cincinnati OH starting at 08:00 for Summit Industrial
|
|
Need 3 Quality Techs in Columbus OH starting at 12:00 for Riverfront Steel
|
|
Need 1 Machine Operator in Columbus OH starting at 09:30 for Riverfront Steel
|
|
Need 3 Machine Operators in Madison WI starting at 12:00 for Great Lakes Mfg, deadline 2026-05-24
|
|
Need 2 Material Handlers in Kansas City MO starting at 11:30 for Parallel Machining
|
|
Need 3 Loaders in Flint MI starting at 16:00 for Parallel Machining
|
|
Need 2 Welders in Louisville KY starting at 13:00 for Horizon Supply, deadline 2026-06-04
|
|
Need 1 CNC Operator in Flint MI starting at 10:30 for Horizon Supply
|
|
Need 1 Material Handler in Columbus OH starting at 15:30 for Riverfront Steel
|
|
Need 2 Forklift Operators in Louisville KY starting at 14:30 for Cornerstone Fabrication, deadline 2026-06-08
|
|
Need 2 Warehouse Associates in Chicago IL starting at 10:00 for Northland Logistics
|
|
Need 2 Material Handlers in Gary IN starting at 15:00 for Parallel Machining
|
|
Need 1 Forklift Operator in Grand Rapids MI starting at 10:00 for Cornerstone Fabrication, deadline 2026-05-21
|
|
Need 2 Pickers in Louisville KY starting at 12:30 for Cornerstone Fabrication, deadline 2026-06-08
|
|
Need 2 Loaders in Indianapolis IN starting at 17:30 for Midway Distribution
|
|
Need 1 Shipping Clerk in Indianapolis IN starting at 12:30 for Northland Logistics
|
|
Need 2 Assemblers in Cincinnati OH starting at 08:00 for Keystone Plastics, deadline 2026-05-26
|
|
Need 5 Quality Techs in Kansas City MO starting at 11:30 for Summit Industrial, deadline 2026-05-23
|
|
Need 2 Machine Operators in Gary IN starting at 10:00 for Heritage Foods
|
|
Need 1 Packer in Chicago IL starting at 09:30 for Midway Distribution
|
|
Need 2 Pickers in Lexington KY starting at 17:30 for Vanguard Components, deadline 2026-05-20
|
|
Need 2 Maintenance Techs in Grand Rapids MI starting at 17:00 for Pioneer Assembly, deadline 2026-05-20
|
|
Need 1 Material Handler in Detroit MI starting at 10:30 for Summit Industrial
|
|
Need 1 Welder in Akron OH starting at 15:00 for Summit Industrial
|
|
Need 1 Shipping Clerk in Cincinnati OH starting at 13:30 for Summit Industrial
|
|
Need 5 Packers in Indianapolis IN starting at 10:30 for Midway Distribution
|
|
Need 1 Forklift Operator in Louisville KY starting at 10:30 for Cornerstone Fabrication, deadline 2026-06-08
|