root b2cd54e941 100K embedding: supervisor achieves 67.6/sec (57% faster than single pipeline) ...

- 4 parallel pipelines on i9 + A4000 via Ollama
- Previous single-pipeline: 43/sec, 39min for 100K
- Supervisor: 67.6/sec, 22min for 100K
- Previous 100K attempt failed at 97K (no retry) — supervisor handles this
- Checkpointing every 1000 chunks for crash recovery
- Round-robin retry on batch failure (3 attempts)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-27 09:45:59 -05:00

crates

Phase 12: Tool registry — governed business actions for AI agents

2026-03-27 09:31:42 -05:00

data

100K embedding: supervisor achieves 67.6/sec (57% faster than single pipeline)

2026-03-27 09:45:59 -05:00

docs

Add read-mem skill + comprehensive project memory

2026-03-27 09:23:01 -05:00

proto

Phase 5: hardening — gRPC, observability, auth, config

2026-03-27 06:37:07 -05:00

scripts

Scale test: 2.47M rows + 10K vector index benchmarked

2026-03-27 08:31:37 -05:00

sidecar

Add __pycache__ to gitignore

2026-03-27 05:54:09 -05:00

tests

Phase 2: DataFusion query engine over Parquet

2026-03-27 05:48:20 -05:00

.gitignore

Add __pycache__ to gitignore

2026-03-27 05:54:09 -05:00

Cargo.lock

Phase 12: Tool registry — governed business actions for AI agents

2026-03-27 09:31:42 -05:00

Cargo.toml

Phase 9: Event journal — append-only mutation history

2026-03-27 09:09:33 -05:00

justfile

Phase 4: Dioxus frontend with dataset browser and SQL query editor

2026-03-27 06:24:15 -05:00

lakehouse.toml

Phase 5: hardening — gRPC, observability, auth, config

2026-03-27 06:37:07 -05:00

Description

Rust-first object storage system

6.3 GiB

Languages

TypeScript 38.4%

Rust 35.8%

HTML 13.9%

Python 7.8%

Shell 2.1%

Other 2%