6df904a03c
- MemCache: LRU in-memory cache for hot datasets (configurable max, default 16GB) Pin/evict/stats endpoints: POST /query/cache/pin, /cache/evict, GET /cache/stats - Delta store: append-only delta Parquet files for row-level updates Write deltas without rewriting base files, merge at query time - Compaction: POST /query/compact merges deltas into base Parquet - Query engine: checks cache first, falls back to Parquet, merges deltas - Benchmarked on 2.47M rows: 1M row JOIN: 854ms cold → 96ms hot (8.9x speedup) 100K filter: 62ms cold → 21ms hot (3x speedup) 1.1M rows cached in 408MB RAM Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
15 lines
389 B
JSON
15 lines
389 B
JSON
{
|
|
"id": "c00465bd-c562-419a-b40e-c557ba9054bf",
|
|
"name": "candidates",
|
|
"schema_fingerprint": "auto",
|
|
"objects": [
|
|
{
|
|
"bucket": "data",
|
|
"key": "datasets/candidates.parquet",
|
|
"size_bytes": 10592165,
|
|
"created_at": "2026-03-27T13:36:42.018896280Z"
|
|
}
|
|
],
|
|
"created_at": "2026-03-27T13:36:42.018904245Z",
|
|
"updated_at": "2026-03-27T13:36:42.018904245Z"
|
|
} |