First G1+ piece. Standalone vectord service with in-memory HNSW
indexes keyed by string IDs and optional opaque JSON metadata.
Wraps github.com/coder/hnsw v0.6.1 (pure Go, no cgo). New port
:3215 with /v1/vectors/* routed through gateway.
API:
POST /v1/vectors/index create
GET /v1/vectors/index list
GET /v1/vectors/index/{name} get info
DELETE /v1/vectors/index/{name}
POST /v1/vectors/index/{name}/add (batch)
POST /v1/vectors/index/{name}/search
Acceptance smoke 7/7 PASS — including recall=1 on inserted vector
w-042 (cosine distance 5.96e-8, float32 precision noise), 200-
vector batch round-trip, dim mismatch → 400, missing index → 404,
duplicate create → 409.
Two upstream library quirks worked around in the wrapper:
1. coder/hnsw.Add panics with "node not added" on re-adding an
existing key (length-invariant fires because internal
delete+re-add doesn't change Len). Pre-Delete fixes for n>1.
2. Delete of the LAST node leaves layers[0] non-empty but
entryless; next Add SIGSEGVs in Dims(). Workaround: when
re-adding to a 1-node graph, recreate the underlying graph
fresh via resetGraphLocked().
Cross-lineage scrum on shipped code:
- Opus 4.7 (opencode): 0 BLOCK + 4 WARN + 3 INFO
- Kimi K2-0905 (openrouter): 2 BLOCK + 2 WARN + 1 INFO
- Qwen3-coder (openrouter): "No BLOCKs" (4 tokens)
Fixed (4 real + 2 cleanup):
O-W1: Lookup returned the raw []float32 from coder/hnsw — caller
mutation would corrupt index. Now copies before return.
O-W3: NaN/Inf vectors poison HNSW (distance comparisons return
false for both < and >, breaking heap invariants). Zero-norm
under cosine produces NaN. Now validated at Add time.
K-B1: Re-adding with nil metadata silently cleared the existing
entry — JSON-omitted "metadata" field deserializes as nil,
making upsert non-idempotent. Now nil = "leave alone"; explicit
{} or Delete to clear.
O-W4: Batch Add with mid-batch failure left items 0..N-1
committed and item N rejected. Now pre-validates all IDs+dims
before any Add.
O-I1: jsonItoa hand-roll replaced with strconv.Itoa — no
measured allocation win.
O-I2: distanceFn re-resolved per Search → use stored i.g.Distance.
Dismissed (2 false positives):
K-B2 "MaxBytesReader applied after full read" — false, applied
BEFORE Decode in decodeJSON
K-W1 "Search distances under read lock might see invalidated
slices from concurrent Add" — false, RWMutex serializes
write-lock during Add against read-lock during Search
Deferred (3): HTTP server timeouts (consistent G0 punt),
Content-Type validation (internal service behind gateway), Lookup
dim assertion (in-memory state can't drift).
The K-B1 finding is worth pausing on: nil metadata on re-add is
the kind of API ergonomics bug only a code-reading reviewer
catches — smoke would never detect it because the smoke always
sends explicit metadata. Three lines changed in Add; the resulting
API matches what callers actually expect.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
169 lines
5.7 KiB
Bash
Executable File
169 lines
5.7 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
# G1 smoke — vectord (HNSW vector search). All assertions go
|
|
# through gateway :3110, none direct to vectord :3215.
|
|
#
|
|
# Validates:
|
|
# - POST /v1/vectors/index → 201, params echoed back
|
|
# - POST /v1/vectors/index/{name}/add (batch of 200) → 200, length=200
|
|
# - POST /v1/vectors/index/{name}/search → top-K with the inserted
|
|
# vector at distance≈0 (recall=1 for the inserted vector itself)
|
|
# - Dim mismatch on Add → 400
|
|
# - Search on missing index → 404
|
|
# - Duplicate Create → 409
|
|
# - DELETE then Search → 404
|
|
#
|
|
# Requires vectord + gateway. Other backing services aren't needed.
|
|
#
|
|
# Usage: ./scripts/g1_smoke.sh
|
|
|
|
set -euo pipefail
|
|
cd "$(dirname "$0")/.."
|
|
|
|
export PATH="$PATH:/usr/local/go/bin"
|
|
|
|
echo "[g1-smoke] building vectord + gateway..."
|
|
go build -o bin/ ./cmd/vectord ./cmd/gateway
|
|
|
|
pkill -f "bin/vectord|bin/gateway" 2>/dev/null || true
|
|
sleep 0.3
|
|
|
|
PIDS=()
|
|
TMP="$(mktemp -d)"
|
|
cleanup() {
|
|
echo "[g1-smoke] cleanup"
|
|
for p in "${PIDS[@]}"; do [ -n "$p" ] && kill "$p" 2>/dev/null || true; done
|
|
rm -rf "$TMP"
|
|
}
|
|
trap cleanup EXIT INT TERM
|
|
|
|
poll_health() {
|
|
local port="$1" deadline=$(($(date +%s) + 5))
|
|
while [ "$(date +%s)" -lt "$deadline" ]; do
|
|
if curl -sS --max-time 1 "http://127.0.0.1:$port/health" >/dev/null 2>&1; then return 0; fi
|
|
sleep 0.05
|
|
done
|
|
return 1
|
|
}
|
|
|
|
echo "[g1-smoke] launching vectord → gateway..."
|
|
./bin/vectord > /tmp/vectord.log 2>&1 &
|
|
PIDS+=($!)
|
|
poll_health 3215 || { echo "vectord failed"; tail /tmp/vectord.log; exit 1; }
|
|
./bin/gateway > /tmp/gateway.log 2>&1 &
|
|
PIDS+=($!)
|
|
poll_health 3110 || { echo "gateway failed"; tail /tmp/gateway.log; exit 1; }
|
|
|
|
FAILED=0
|
|
NAME="g1_workers"
|
|
DIM=8
|
|
|
|
echo "[g1-smoke] /v1/vectors/index — create dim=$DIM:"
|
|
HTTP="$(curl -sS -o "$TMP/create.out" -w '%{http_code}' -X POST http://127.0.0.1:3110/v1/vectors/index \
|
|
-H 'Content-Type: application/json' \
|
|
-d "{\"name\":\"$NAME\",\"dimension\":$DIM,\"distance\":\"cosine\"}")"
|
|
if [ "$HTTP" = "201" ]; then
|
|
echo " ✓ create → 201"
|
|
else
|
|
echo " ✗ create → $HTTP body=$(cat "$TMP/create.out")"; FAILED=1
|
|
fi
|
|
|
|
echo "[g1-smoke] duplicate create → 409:"
|
|
HTTP="$(curl -sS -o /dev/null -w '%{http_code}' -X POST http://127.0.0.1:3110/v1/vectors/index \
|
|
-H 'Content-Type: application/json' \
|
|
-d "{\"name\":\"$NAME\",\"dimension\":$DIM}")"
|
|
if [ "$HTTP" = "409" ]; then
|
|
echo " ✓ duplicate → 409"
|
|
else
|
|
echo " ✗ duplicate → $HTTP"; FAILED=1
|
|
fi
|
|
|
|
echo "[g1-smoke] add batch of 200 vectors:"
|
|
# Build a batch payload with 200 items. ID encodes index; vector
|
|
# is a deterministic spread so we can assert recall on a known id.
|
|
python3 - <<EOF > "$TMP/batch.json"
|
|
import json, math
|
|
items = []
|
|
for i in range(200):
|
|
# Each vector is unit-norm with one dominant axis cycling through 8 dims.
|
|
v = [0.0] * $DIM
|
|
v[i % $DIM] = 1.0
|
|
# Add a tiny perturbation per id so vectors are distinct.
|
|
v[(i+1) % $DIM] = (i % 17) * 0.01
|
|
items.append({"id": f"w-{i:03d}", "vector": v, "metadata": {"row": i}})
|
|
print(json.dumps({"items": items}))
|
|
EOF
|
|
ADD_RESP="$(curl -sS -X POST "http://127.0.0.1:3110/v1/vectors/index/$NAME/add" \
|
|
-H 'Content-Type: application/json' \
|
|
-d @"$TMP/batch.json")"
|
|
LEN="$(echo "$ADD_RESP" | jq -r '.length')"
|
|
ADDED="$(echo "$ADD_RESP" | jq -r '.added')"
|
|
if [ "$LEN" = "200" ] && [ "$ADDED" = "200" ]; then
|
|
echo " ✓ added=200, length=200"
|
|
else
|
|
echo " ✗ add → $ADD_RESP"; FAILED=1
|
|
fi
|
|
|
|
echo "[g1-smoke] search for inserted vector w-042 → recall:"
|
|
# Build the same vector w-042 was inserted with.
|
|
python3 - <<EOF > "$TMP/q.json"
|
|
import json
|
|
i = 42
|
|
v = [0.0] * $DIM
|
|
v[i % $DIM] = 1.0
|
|
v[(i+1) % $DIM] = (i % 17) * 0.01
|
|
print(json.dumps({"vector": v, "k": 3}))
|
|
EOF
|
|
SEARCH_RESP="$(curl -sS -X POST "http://127.0.0.1:3110/v1/vectors/index/$NAME/search" \
|
|
-H 'Content-Type: application/json' \
|
|
-d @"$TMP/q.json")"
|
|
TOP_ID="$(echo "$SEARCH_RESP" | jq -r '.results[0].id')"
|
|
TOP_DIST="$(echo "$SEARCH_RESP" | jq -r '.results[0].distance')"
|
|
TOP_META="$(echo "$SEARCH_RESP" | jq -c '.results[0].metadata')"
|
|
RC="$(echo "$SEARCH_RESP" | jq -r '.results | length')"
|
|
# Distance should be ~0 (cosine of identical unit vectors). Allow 1e-4.
|
|
DIST_OK="$(python3 -c "import sys; sys.exit(0 if abs($TOP_DIST) < 1e-4 else 1)" && echo y || echo n)"
|
|
if [ "$TOP_ID" = "w-042" ] && [ "$DIST_OK" = "y" ] && [ "$RC" = "3" ] && [ "$TOP_META" = '{"row":42}' ]; then
|
|
echo " ✓ top hit = w-042 (dist=$TOP_DIST), 3 results, metadata round-tripped"
|
|
else
|
|
echo " ✗ search → top_id=$TOP_ID dist=$TOP_DIST rc=$RC meta=$TOP_META"
|
|
echo " full: $SEARCH_RESP"
|
|
FAILED=1
|
|
fi
|
|
|
|
echo "[g1-smoke] dim mismatch on add → 400:"
|
|
HTTP="$(curl -sS -o /dev/null -w '%{http_code}' -X POST "http://127.0.0.1:3110/v1/vectors/index/$NAME/add" \
|
|
-H 'Content-Type: application/json' \
|
|
-d '{"items":[{"id":"bad","vector":[1,2,3]}]}')"
|
|
if [ "$HTTP" = "400" ]; then
|
|
echo " ✓ dim mismatch → 400"
|
|
else
|
|
echo " ✗ dim mismatch → $HTTP"; FAILED=1
|
|
fi
|
|
|
|
echo "[g1-smoke] search on missing index → 404:"
|
|
HTTP="$(curl -sS -o /dev/null -w '%{http_code}' -X POST "http://127.0.0.1:3110/v1/vectors/index/no_such/search" \
|
|
-H 'Content-Type: application/json' \
|
|
-d "{\"vector\":[1,0,0,0,0,0,0,0],\"k\":1}")"
|
|
if [ "$HTTP" = "404" ]; then
|
|
echo " ✓ unknown index → 404"
|
|
else
|
|
echo " ✗ unknown index → $HTTP"; FAILED=1
|
|
fi
|
|
|
|
echo "[g1-smoke] DELETE then GET → 404:"
|
|
curl -sS -o /dev/null -X DELETE "http://127.0.0.1:3110/v1/vectors/index/$NAME"
|
|
HTTP="$(curl -sS -o /dev/null -w '%{http_code}' "http://127.0.0.1:3110/v1/vectors/index/$NAME")"
|
|
if [ "$HTTP" = "404" ]; then
|
|
echo " ✓ post-delete GET → 404"
|
|
else
|
|
echo " ✗ post-delete → $HTTP"; FAILED=1
|
|
fi
|
|
|
|
if [ "$FAILED" -eq 0 ]; then
|
|
echo "[g1-smoke] G1 acceptance gate: PASSED"
|
|
exit 0
|
|
else
|
|
echo "[g1-smoke] G1 acceptance gate: FAILED"
|
|
exit 1
|
|
fi
|