root 8b512d30e5 10M VECTOR SCALE TEST — PASSED
THE PROOF:
  10,000,000 × 768d vectors
  30 GB Lance dataset on disk
  IVF_PQ index: 173 seconds to build (3162 partitions, 192 sub_vectors)
  Search p50: 5ms — at TEN MILLION vectors
  Search p95: 19ms

  HNSW at 10M would need 29 GB RAM = past the ceiling
  Lance at 10M = 30 GB disk, 5ms search, no RAM constraint

Agent test on 500K workers: 22/22 positions filled (100%)
  Forklift Operator x5, Machine Operator x4, Welder x3,
  Loader x8, Quality Tech x2 — all via hybrid SQL+vector

The architecture holds past the HNSW ceiling. Lance takes over
exactly as ADR-019 designed. This is not theoretical anymore.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-17 01:16:59 -05:00
2026-04-17 01:16:59 -05:00
2026-03-27 05:54:09 -05:00
Description
Rust-first object storage system
6.3 GiB
Languages
TypeScript 38.4%
Rust 35.8%
HTML 13.9%
Python 7.8%
Shell 2.1%
Other 2%