root a710896db2 Ingest Ethereal 10K worker profiles — domain data in the substrate ...

10,000 staffing worker profiles from profit/ethereal repo. Flattened
JSON → CSV → Parquet. Indexed on HNSW (9.5s) + Lance IVF_PQ (7.2s).

SQL hybrid verified: forklift operators in IL with reliability > 0.8
returned exact matches. Vector search alone missed the state filter —
confirms the hybrid SQL+vector routing need from quality eval.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-16 22:26:19 -05:00

crates

RAG reranker + manifest bucket fix — quality improvements from eval

2026-04-16 22:19:11 -05:00

data

Ingest Ethereal 10K worker profiles — domain data in the substrate

2026-04-16 22:26:19 -05:00

docs

Update PRD + PHASES.md — reflect 8-commit 2026-04-17 push

2026-04-16 20:54:05 -05:00

inbox/processed

Scheduled ingest: file watcher auto-ingests from ./inbox

2026-03-27 20:04:40 -05:00

proto

Phase 5: hardening — gRPC, observability, auth, config

2026-03-27 06:37:07 -05:00

scripts

Ingest Ethereal 10K worker profiles — domain data in the substrate

2026-04-16 22:26:19 -05:00

sidecar

Phases 16.2 + L2 + 17 VRAM gate + MySQL + 18 Lance hybrid milestone

2026-04-16 20:24:46 -05:00

tests

Phase 2: DataFusion query engine over Parquet

2026-03-27 05:48:20 -05:00

.gitignore

Add __pycache__ to gitignore

2026-03-27 05:54:09 -05:00

Cargo.lock

Phases 16.2 + L2 + 17 VRAM gate + MySQL + 18 Lance hybrid milestone

2026-04-16 20:24:46 -05:00

Cargo.toml

Phases 16.2 + L2 + 17 VRAM gate + MySQL + 18 Lance hybrid milestone

2026-04-16 20:24:46 -05:00

justfile

Phase 4: Dioxus frontend with dataset browser and SQL query editor

2026-03-27 06:24:15 -05:00

lakehouse.toml

S3 backend for Lance — hybrid operates on real MinIO object storage

2026-04-16 21:09:42 -05:00

Description

Rust-first object storage system

6.3 GiB

Languages

TypeScript 38.4%

Rust 35.8%

HTML 13.9%

Python 7.8%

Shell 2.1%

Other 2%