- JobTracker: create/update/complete/fail jobs with progress tracking
- POST /vectors/index now returns immediately with job_id (HTTP 202)
- Embedding runs in tokio::spawn background task
- GET /vectors/jobs/{id} returns live progress (chunks embedded, rate, ETA)
- GET /vectors/jobs lists all jobs
- Progress logged every 100 batches with chunks/sec and ETA
- 100K embedding job running successfully at 44 chunks/sec
- System stays responsive during embedding (queries in 23ms)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
15 lines
389 B
JSON
15 lines
389 B
JSON
{
|
|
"id": "e26d3633-a341-4229-9819-f287d98b788a",
|
|
"name": "candidates",
|
|
"schema_fingerprint": "auto",
|
|
"objects": [
|
|
{
|
|
"bucket": "data",
|
|
"key": "datasets/candidates.parquet",
|
|
"size_bytes": 10592165,
|
|
"created_at": "2026-03-27T14:00:35.662150713Z"
|
|
}
|
|
],
|
|
"created_at": "2026-03-27T14:00:35.662162510Z",
|
|
"updated_at": "2026-03-27T14:00:35.662162510Z"
|
|
} |