6df904a03c
- MemCache: LRU in-memory cache for hot datasets (configurable max, default 16GB) Pin/evict/stats endpoints: POST /query/cache/pin, /cache/evict, GET /cache/stats - Delta store: append-only delta Parquet files for row-level updates Write deltas without rewriting base files, merge at query time - Compaction: POST /query/compact merges deltas into base Parquet - Query engine: checks cache first, falls back to Parquet, merges deltas - Benchmarked on 2.47M rows: 1M row JOIN: 854ms cold → 96ms hot (8.9x speedup) 100K filter: 62ms cold → 21ms hot (3x speedup) 1.1M rows cached in 408MB RAM Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
15 lines
380 B
JSON
15 lines
380 B
JSON
{
|
|
"id": "8fa7cb8b-ab6b-4e64-9384-d2480e79dd7c",
|
|
"name": "clients",
|
|
"schema_fingerprint": "auto",
|
|
"objects": [
|
|
{
|
|
"bucket": "data",
|
|
"key": "datasets/clients.parquet",
|
|
"size_bytes": 21971,
|
|
"created_at": "2026-03-27T13:36:42.025701092Z"
|
|
}
|
|
],
|
|
"created_at": "2026-03-27T13:36:42.025707574Z",
|
|
"updated_at": "2026-03-27T13:36:42.025707574Z"
|
|
} |