lakehouse

Go to file

root 238cb84d26 Server-side pagination for large result sets

- ResultStore: execute query, store batches server-side, serve pages on demand
- POST /query/paged → returns query_id + total_rows + page count (no rows)
- GET /query/page/{id}/{page}?size=100 → returns one page of rows
- RecordBatch slicing for efficient page extraction from Arrow batches
- LRU eviction: keeps 50 most recent query results in memory
- Tested: 100K rows → 1,000 pages of 100, any page fetchable by number
- Supervisor pattern: chunk results, serve on demand, retry-safe (idempotent GET)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-27 20:54:44 -05:00

crates

Server-side pagination for large result sets

2026-03-27 20:54:44 -05:00

data

Robust SQL extraction: handles explanations, markdown, prefixes

2026-03-27 20:42:11 -05:00

docs

Sync memory + phases: all 15 phases marked complete

2026-03-27 19:34:15 -05:00

inbox/processed

Scheduled ingest: file watcher auto-ingests from ./inbox