diff --git a/logs/overnight_proof.log b/logs/overnight_proof.log new file mode 100644 index 0000000..bb09d4d --- /dev/null +++ b/logs/overnight_proof.log @@ -0,0 +1,48 @@ + +=== OVERNIGHT PROOF === +Start: 01:28:59 + +STEP 1: Embedding 5K real workers + Fetched 5000 rows + 5000 docs ready + Job job-1776407339506: 5000 chunks embedding... + unknown: 0/50000 chunks... unknown: 0/50000 chunks... ... ?: 0/5000 (0s) + unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks...01:30:01 ═══ OVERNIGHT PROOF: step= ═══ +01:30:01 ═══ OVERNIGHT PROOF: step= ═══ + unknown: 0/50000 chunks... ... ?: 0/5000 (60s) + unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... ... ?: 0/5000 (120s) + unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... +============================================================ +OVERNIGHT PROOF — steps 2-6 on REAL embeddings +============================================================ + +STEP 2: HNSW on workers_5k_proof + unknown: 0/50000 chunks... unknown: 0/50000 chunks... HNSW: 5000 vectors in 5.3s + +STEP 3: Lance + Migrate: 5000 rows in 0.0s + unknown: 0/50000 chunks... IVF_PQ: built in 2.4s + Btree: 0.00s + +STEP 4: Recall on REAL embeddings + Eval harness: 30 queries + unknown: 0/50000 chunks... unknown: 0/50000 chunks... HNSW recall@10: 1.0000 p50: 762us + Lance recall@10: 0.9500 p50: 6791us + +STEP 5: 50 autonomous SQL operations + unknown: 0/50000 chunks... unknown: 0/50000 chunks... 50/50 passed (100%) in 2.9s + +STEP 6: Hybrid search — REAL embeddings + SQL filter + method=hybrid_sql_vector sql=6289 results=0 + +============================================================ + OVERNIGHT PROOF — RESULTS +============================================================ + Real embeddings: 5,000 via nomic-embed-text (not random) + HNSW recall@10: 1.0000 p50: 762us + Lance recall@10: 0.9500 p50: 6791us + SQL autonomous: 50/50 (100%) + Hybrid search: FAILED +============================================================ + unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... ... ?: 0/5000 (180s) + unknown: 0/50000 chunks... unknown: 0/50000 chunks... unknown: 0/50000 chunks... \ No newline at end of file diff --git a/logs/scale_test.log b/logs/scale_test.log index 4a9cce3..51b9011 100644 --- a/logs/scale_test.log +++ b/logs/scale_test.log @@ -125,3 +125,26 @@ Index built in 173s THIS IS THE PROOF: Lance handles what HNSW can't. ═══════════════════════════════════════════════════════════ +Fri Apr 17 01:18:01 AM CDT 2026 Already running (pid 957071) +2026-04-17 01:19:10 IVF_PQ built in 309.85242s + IVF_PQ built in 309.85242s +2026-04-17 01:19:10 Heartbeat done. Next step: search_test +Heartbeat done. Next step: search_test +2026-04-17 01:20:01 ═══ Scale test heartbeat: step=search_test ═══ +═══ Scale test heartbeat: step=search_test ═══ +2026-04-17 01:20:01 Step 4: Search benchmark on 10M vectors... +Step 4: Search benchmark on 10M vectors... +Running 10 searches on 10M Lance dataset... + Search 0 failed: HTTP Error 422: Unprocessable Entity + Search 1 failed: HTTP Error 422: Unprocessable Entity + Search 2 failed: HTTP Error 422: Unprocessable Entity + Search 3 failed: HTTP Error 422: Unprocessable Entity + Search 4 failed: HTTP Error 422: Unprocessable Entity + Search 5 failed: HTTP Error 422: Unprocessable Entity + Search 6 failed: HTTP Error 422: Unprocessable Entity + Search 7 failed: HTTP Error 422: Unprocessable Entity + Search 8 failed: HTTP Error 422: Unprocessable Entity + Search 9 failed: HTTP Error 422: Unprocessable Entity + No successful searches +2026-04-17 01:20:01 Heartbeat done. Next step: hot_swap_test +Heartbeat done. Next step: hot_swap_test