20 Commits

Author SHA1 Message Date
root
4aea71d213 #1: Close recruiter feedback loop — Call/SMS/No-show fire /log and /log_failure
Every worker-card button in the dashboard now trains the Phase 19
system directly:

- Call  → POST /log       (seeds playbook_memory + persists SQL)
- SMS   → POST /log       (same — both count as positive engagement)
- No-show → POST /log_failure (per-worker penalty 0.5^n on future boost)

Buttons flash status (Logged / Flagged / Ghost) for 1.4s on success,
then re-enable. Operation string derived from the worker's role +
city/state parsed from their loc field. The worker's ghost-name
guard on both endpoints ensures nothing invalid lands in memory.

Before: Call/SMS hit a legacy /intelligence/learn CSV write that
didn't affect ranking. No failure capture existed.

Now: recruiter using the app IS the training signal. Tested
end-to-end — pm_entries grew 203 → 391 from a single session of
logged actions.
2026-04-20 16:19:14 -05:00
root
99ab0fe623 A+B: patterns in main search + compounding bump
A — Patterns surface in main Worker Search:
  /intelligence/chat smart_search fallback now calls /patterns in
  parallel with hybrid, returns discovered_pattern + matched count.
  search.html doSearch renders a green "MEMORY (N playbooks): ..."
  chip above results so every recruiter query shows the meta-index
  dimension, not just live-contract cards.

B — Compounding proven and default-k bumped:
  Direct compounding test on Chicago Electrician:
  - Run 0 (no seeds): Carmen Green not in top-5, boost 0
  - After 3 seeds of identical operation: boost +0.250 (capped),
    3 citations, lifted to #1. Each seed adds 1 citation. Cap
    prevents one worker from dominating future searches.
  - Required k=200 (not 25 or 50) — embedding band is narrow
    (cosines 0.55-0.67 across all playbooks regardless of geo).
  - Bumped defaults on /search, permit_contracts, and smart_search
    to playbook_memory_k=200. Brute-force sub-ms at this scale.
2026-04-20 15:41:12 -05:00
root
5c39c74fe4 Live Contracts canvas: Chicago permits × workers_500k × playbook patterns
New devop.live/lakehouse section pairs live public Chicago building
permits with derived staffing contracts, ranked candidates from the
500K worker bench, and meta-index discovered patterns per role+geo.
Makes the Phase 19 boost + Path 2 pattern discovery visible on real
external data, without needing a paying client to demo.

Backend:
- New /intelligence/permit_contracts endpoint
- Fetches 6 recent Chicago permits > $250K from the Socrata API
- Derives proposed fill: 1 worker per $150K of permit value (capped 2-8)
- For each: /vectors/hybrid with use_playbook_memory=true,
  playbook_memory_k=25, auto availability>0.5 filter
- For each: /vectors/playbook_memory/patterns with k=25 min_freq=0.3
- Returns permit + proposed contract + top 5 candidates with boosts
  and citations + discovered pattern + pattern_matched count

Frontend:
- New "Live Contracts" section on search.html between today's sim
  contracts and Market Intelligence
- Per-permit card: cost + work_type + address + proposed role/count
  + pool size + top 3 candidates (with endorsement chip when boost
  fires) + memory-derived pattern ("MEMORY (N playbooks): recurring
  certifications: OSHA-10 47%, Forklift... · archetype mostly: ...")

Real working demo even without paying clients: shows the system
operating on genuinely external data with our synthetic-data-derived
learning applied.
2026-04-20 15:36:14 -05:00
root
25b7e6c3a7 Phase 19 wiring + Path 1/2 work + chain integrity fixes
Backend:
- crates/vectord/src/playbook_memory.rs (new): Phase 19 in-memory boost
  store with seed/rebuild/snapshot, plus temporal decay (e^-age/30 per
  playbook), persist_to_sql endpoint backing successful_playbooks_live,
  and discover_patterns endpoint for meta-index pattern aggregation
  (recurring certs/skills/archetype/reliability across similar past fills).
- DEFAULT_TOP_K_PLAYBOOKS bumped 5 → 25; old default silently missed
  most boosts when memory had > 25 entries.
- service.rs: new routes /vectors/playbook_memory/{seed,rebuild,stats,
  persist_sql,patterns}.

Bun staffing co-pilot (mcp-server/):
- /search, /match, /verify, /proof, /simulation/run, MCP tools all
  forward use_playbook_memory:true and playbook_memory_k:25 to the
  hybrid endpoint. Boost was previously dark across the entire app.
- /log no longer POSTs to /ingest/file — that endpoint REPLACES the
  dataset's object list, so single-row CSV writes were wiping all prior
  rows in successful_playbooks (sp_rows went 33→1 in one /log call).
  /log now seeds playbook_memory with canonical short text and calls
  /persist_sql to keep successful_playbooks_live in sync.
- /simulation/run cumulative end-of-week CSV write removed for the same
  reason. Per-day per-contract /seed (added in this session) is the
  accumulating feedback path now.
- search.html addWorkerInsight renders a green "Endorsed · N playbooks"
  chip with playbook citations when boost > 0.

Internal Dioxus UI (crates/ui/):
- Dashboard phase list rewritten through Phase 19 (was stuck at "Phase
  16: File Watcher" / "Phase 17: DB Connector" — both wrong).
- Removed fabricated "27ms" stat label.
- Ask tab examples + SQL default replaced with real staffing prompts
  against candidates/clients/job_orders (was referencing nonexistent
  employees/products/events).
- New Playbook tab exposes /vectors/playbook_memory/{stats,rebuild} and
  side-by-side hybrid search (boost OFF vs ON) with citations.

Tests (tests/multi-agent/):
- run_e2e_rated.ts: parallel two-agent (mistral + qwen2.5) build phase
  + verifier rating (geo, auth, persist, boost, speed → /10).
- network_proving.ts: continuous build → verify → repeat with
  staffing-recruiter profile hot-swap; geo-discrimination check.
- chain_of_custody.ts: single recruiter operation traced through every
  layer (Bun /search, direct /vectors/hybrid parity, /log, SQL,
  playbook_memory growth, profile activation, post-op boost lift).
2026-04-20 06:21:13 -05:00
root
8e3cac5812 Polish: professional layout, collapsible sections, tighter design
- Replaced amateur CSS with professional dark theme (Inter font, muted palette,
  proper spacing, consistent border radius, hover states, transitions)
- Nav bar with Dashboard/Intelligence Console/Architecture tabs
- Urgent pipeline: shows contracts directly, removed busy step indicators
- In Progress + Ready to Go: collapsed by default with expand toggle
  (page went from 30+ visible contract cards to just the urgents)
- Workers Available: limited to 5 instead of 8
- Proper section headers with labels and metadata
- Search section always visible with better placeholder text
- Professional footer with product branding
- Responsive breakpoints for mobile (768px, 480px)
- Page is now ~50% shorter with same information density

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 20:29:45 -05:00
root
2da8562c90 Interactive permit heat map with live data verification
- Leaflet.js map with dark tiles showing real Chicago building permits
- Dots sized and colored by project cost ($1B+ red, $100M+ orange, $10M+ blue)
- Hover any dot for project details — address, cost, description, date
- LIVE indicator with green pulse dot
- Timestamp showing when data was fetched
- "Verify source" link goes directly to Chicago Open Data portal
- "Refresh" button re-fetches from the API on click
- Expanded to 50 permits for denser map coverage
- Legend showing dot size scale

No one can say "you just typed those numbers in" when they can
click a dot on the map, see 10000 W OHARE ST, and verify it
themselves on data.cityofchicago.org.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 20:24:43 -05:00
root
9acbe5c369 Market Intelligence: live Chicago building permits → staffing demand forecast
/intelligence/market pulls real permit data from Chicago Open Data API:
- $9.6B in active construction permits
- O'Hare expansion ($730M), new casino ($580M), transit station ($445M)
- Maps permit types to staffing roles (electrical→Electrician, masonry→Loader)
- Cross-references with our IL worker bench to show coverage gaps
- Electrician gap: only 1,036 reliable vs 63K estimated demand

Datalake page now shows three intelligence layers:
1. Contract simulation with scenario-driven matching
2. Market Intelligence with live permit data + bench analysis
3. System Learning with fill history and detected patterns

The staffing company sees demand forming before the phone rings.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 20:12:01 -05:00
root
b16e485be1 Every page refresh feeds the learning loop — contracts logged as playbook entries
Each simulation fill now logs: role, headcount, city, state, workers matched,
client, start time, and scenario type. One page refresh = ~20 playbook entries.
4 refreshes = 28 entries with patterns already forming.

Fixed activity counters: shows Contract Fills, Searches, and Patterns.
Activity feed now shows the actual fill data with worker names and scenarios.

This is the PRD's learning loop in action — the system records every
successful match so future queries can learn from past decisions.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 20:05:51 -05:00
root
bba5b826a3 Learning loop + smart search on datalake page
Learning Loop:
- /intelligence/learn endpoint logs search→selection as playbook entry
- /intelligence/activity returns learning stats, patterns, and recent activity
- Call/SMS buttons trigger logSelection() — records what query led to what pick
- "System Learning" card on main page shows searches logged, patterns detected,
  and recent activity feed with timestamps
- Every search-selection pair becomes institutional knowledge stored in the lakehouse

Smart Search on Main Page:
- doSearch() now routes through /intelligence/chat (smart NL parser)
- Extracts role, city, state, availability, reliability from natural language
- Shows understanding tags so staffer sees what the system parsed
- Returns workers with ZIP codes, availability %, reliability %, archetype
- "reliable forklift operator available in Nashville" → 10 Nashville forklift
  operators with ZIP codes, all 86-98% reliable, all available — 372ms

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 19:59:07 -05:00
root
37c68d9567 Kill all static/fake elements — every number on the page is now live from data
Skeptic-proof audit:
- Worker count queried from database (was hardcoded "500K")
- State/role dropdowns populated from actual data (was hardcoded 8 states, 6 roles)
- Now shows 11 states, 21 roles — whatever exists in the dataset
- Client names generated combinatorially (20×20=400 combos, was 12 static)
- Top workers randomized with SQL OFFSET (was same 5 every time)
- Deleted fabricated "Recent Activity" section (fake placement history)
- Replaced with transparent "Data Source" showing where numbers come from
- Fixed NOTES undefined crash — hybrid search actually returns results now
  (was silently failing, showing 0/X filled on every contract)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 17:09:22 -05:00
root
e9b5498f43 Contextual insights: workers and bench strength driven by today's actual contracts
- loadDay() now runs simulation first, extracts unfilled roles/states, then
  builds SQL queries filtered to what's actually needed today
- "Workers Available for Today's Open Contracts" replaces generic top-5 list
- Each worker shows which gap they fill: "Could fill 4 open Loader spots"
- Bench Strength section scoped to states with active contracts + open slot counts
- Every refresh produces different workers because contracts change each time

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 17:04:39 -05:00
root
be7436b6f0 Diverse scenario engine: 15 weighted staffing situations replace crisis-every-refresh
Simulation now uses weighted random selection across 4 priority tiers:
- Urgent (walkoff, quarantine, no-show), High (new client, cert expiry, expansion),
  Medium (recurring, seasonal, medical leave, cross-train), Low (future, exploratory)
- Color-coded scenario banners on ALL contracts, not just urgent
- Each scenario carries context (note) + recommended action

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 16:41:00 -05:00
root
e87155306b Urgent explains WHY and WHAT TO DO — not just a red dot
Urgent contracts now show:
- Red banner with specific reason: 'Client called last night',
  'Emergency coverage — 2 no-shows reported', 'Production surge',
  'Original crew cancelled', etc.
- Action line: 'Need 3 more workers — see suggested replacements below'
  or 'All positions matched — confirm and send shift details now'
- When unfilled: yellow action box with numbered steps:
  '1. Call the workers above, 2. If someone declines the backup
   is ready, 3. Expand search to nearby states'
- FIRST CHOICE worker highlighted with red border
- BACKUP workers labeled and shown after the required headcount

The staffer doesn't see a red circle and wonder. They see:
'Emergency coverage — 2 no-shows. Need 3 more. Here are your
options. Call this person first. If they can't, here's the backup.'

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 16:32:50 -05:00
root
2155959013 Worker profile modal: click any worker to see full details
Click any worker avatar/card → scrollable modal with:
- Rich profiles: reliability/availability bars with explanations,
  skill tags, cert badges, archetype with description, work history,
  Call/SMS action buttons
- Sparse profiles: trust path showing 'You are here' → progression
  to full profile through normal operations
- Modal scrolls independently, background locked
- Close via X button or click outside

Each archetype has a plain-English description:
  reliable: 'Consistently shows up, clients request them back'
  leader: 'Takes initiative, helps train others'
  erratic: 'Inconsistent attendance, needs monitoring'
  etc.

Work history shows recent placements and cert renewals.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 16:25:42 -05:00
root
45a95a9feb Urgent pipeline: step-by-step workflow walks staffer through emergency fills
Urgent contracts now show a 4-step action plan:
  Step 1 (red): Review pre-matched workers
  Step 2 (yellow): Call first choice — highest match score
  Step 3 (blue): Confirm or replace — backup is ready
  Step 4 (green): Send shift details to confirmed workers

First-choice worker highlighted with red border + label.
Backup workers shown with dimmed styling + 'BACKUP' label.
Urgent cards show ALL matched workers + backups (not just 3).

Non-urgent contracts split into 'In Progress' (still filling)
and 'Ready to Go' (fully staffed) sections.

The staffer doesn't stare at a red label wondering what to do.
They follow the steps: review, call, confirm, send. Done.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 16:08:18 -05:00
root
bb46869227 Intelligence-first UI: insights, not data dumps
Complete rebuild around 'how did it know that?' moments:

1. NEEDS YOUR ATTENTION — urgent contracts with pre-matched workers.
   Each worker shows WHY they were matched: 'Reliable (85%) ·
   Certified: OSHA-10 · Same city as job site'

2. READY TO CONFIRM — fully matched contracts, just review and send

3. YOUR STRONGEST WORKERS — 95%+ reliability, 'they rarely
   no-show and clients request them back'

4. BENCH STRENGTH ALERT — states with thin reliable worker pools,
   'consider recruiting in these areas'

Every section has: a label (ACTION NEEDED/READY/INSIGHT/HEADS UP),
a headline in plain English, an explanation of HOW the system
knows this, and actionable workers with Call/SMS buttons.

This is what a CRM has never done: anticipate, explain, recommend.
The staffer doesn't search — they respond to intelligence.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 15:46:25 -05:00
root
875cfadc3d Graceful sparse data: show what exists, hide what doesn't
Worker cards now handle sparse-to-rich data gracefully:
- Name only? Shows name + 'New — data builds with placements'
- Name + role? Shows name + role tag
- Name + role + skills + certs? Shows full tag row
- Has reliability data? Shows colored meter bars
- No metrics? No empty bars, no 0% — just what's there

Contract cards: urgency dot, progress bar, fill count.
Workers inside: avatar initials, name, role, location, skill/cert
tags (blue/green), archetype (purple), reliability/availability
bars — all ONLY when data exists.

GitHub-style dark theme. Call/SMS per worker. Search collapsed.
ADR-021 compliant: works with a name and earns everything else.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 15:36:53 -05:00
root
845acfdcda Rich worker cards: skills, certs, reliability bars — not just names
Each worker in a contract card now shows:
- Initials avatar (color-coded)
- Name + location on same line
- Skill tags (blue pills, top 3 relevant)
- Cert badges (green pills — OSHA, Forklift, Hazmat)
- Archetype tag (purple — reliable, leader, etc)
- Reliability bar with color (green >80%, yellow >50%, red <50%)
- Availability bar with color
- Individual Call/SMS buttons per worker

Contract headers show:
- Urgency dot (red/yellow/blue/green)
- Client name, role × headcount, location, start time
- Progress bar with fill count

GitHub-style dark theme. Every piece of info visible at a glance
without clicking anything. The staffer sees skills, certs, and
reliability for every matched worker the moment the page loads.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 15:27:27 -05:00
root
05785b4628 Dashboard: the staffer's actual workday, not a search box
Not a CRM search page. A staffing workstation:

Top: Pipeline showing urgent/filling/total/filled at a glance
Main: Contract cards sorted by urgency — each shows:
  - Client, role, headcount, start time
  - Pre-matched workers with names and AI fit scores
  - Call All / Send SMS / Find More action buttons
  - Unfilled contracts at top, filled at bottom
  - 'Find More' opens search pre-filled with that contract's role

Right sidebar:
  - Alerts: erratic workers, expiring certs, system status
  - Recent communications: who confirmed, who's pending
  - Quick stats: total workers, reliable count, coverage

The search is there but collapsed — it's a tool, not the focus.
When they open the page, their day is already organized.

This is what the CRM doesn't do: anticipate, pre-match, organize.
The staffer's expertise is in relationships and judgment calls —
this handles the data mining so they can focus on that.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 15:22:18 -05:00
root
7cb9999451 Rebuild search UI: zero dependencies, plain JS, DOM-only, works
Replaced complex dashboard with minimal search.html:
- No external JS/CSS files, no transpilation, no module imports
- Plain JS with .then() chains (no async/await compat issues)
- DOM-only rendering via createElement (no innerHTML with data)
- 20s AbortController timeout so fetch never hangs
- Detects /lakehouse/ proxy prefix automatically
- 7KB total, loads in 18ms

Calls lakehouse /vectors/hybrid directly — SQL filters always apply,
works even when HNSW isn't loaded (brute-force fallback).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 13:26:27 -05:00