1 Commits

Author SHA1 Message Date
root
2e455919b7 Overnight proof — 5-step unattended test with real embeddings
Runs autonomously via cron (every 3 min, state machine):
  1. Embed 500K workers through Ollama nomic-embed-text (~40 min)
     Real embeddings, not random vectors. This is what matters.
  2. Build HNSW + Lance IVF_PQ on real clustered data
  3. Measure recall — HNSW vs Lance on real embeddings
  4. 100 autonomous operations — local model only, no human steering
     Mix: 50 matches + 25 counts + 15 aggregates + 10 lookups
  5. 30 min sustained load — 10 concurrent ops/sec continuously

Currently running: Step 1 active, GPU at 43%, Ollama embedding.
Monitor: tail -f /home/profit/lakehouse/logs/overnight_proof.log
Check: cat /tmp/overnight_proof_state

This is the test that proves it's not just architecture — it's
real embeddings, real models, real sustained load, no hand-holding.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 01:22:07 -05:00