Architectural snapshot of the lakehouse codebase at the point where the
full matrix-driven agent loop with Mem0 versioning + deletion was
validated end-to-end.
WHAT THIS REPO IS
A clean single-commit snapshot of the lakehouse code. Heavy test data
(.parquet datasets, vector indexes) excluded — see REPLICATION.md for
regen path. Full lakehouse history at git.agentview.dev/profit/lakehouse.
WHAT WAS PROVEN
- Vector retrieval across multi-corpora matrix (chicago_permits + entity
briefs + sec_tickers + distilled procedural + llm_team runs)
- Observer hand-review (cloud + heuristic fallback) gating each candidate
- Local-model agent loop (qwen3.5:latest) with tool use + scratchpad
- Playbook seal on success → next-iter retrieval surfaces it as preamble
- Mem0 versioning + deletion in pathway_memory:
* UPSERT: ADD on new workflow, UPDATE bumps replay_count on identical
* REVISE: chains versions, parent.superseded_at + superseded_by stamped
* RETIRE: marks specific trace retired with reason, excluded from retrieval
* HISTORY: walks chain root→tip, cycle-safe
KEY DIRECTORIES
- crates/vectord/src/pathway_memory.rs — Mem0 ops live here
- crates/vectord/src/playbook_memory.rs — original Mem0 reference
- tests/agent_test/ — local-model agent harness + PRD + session archives
- scripts/dump_raw_corpus.sh — MinIO bucket dump (raw test corpus)
- scripts/vectorize_raw_corpus.ts — corpus → vector indexes
- scripts/analyze_chicago_contracts.ts — real inference pipeline
- scripts/seal_agent_playbook.ts — Mem0 upsert from agent traces
Replication: see REPLICATION.md for Debian 13 clean install + cloud-only
adaptation (no local Ollama).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
35 lines
1.2 KiB
TypeScript
35 lines
1.2 KiB
TypeScript
// POST bot cycle outcomes to the observer on :3800 so they accumulate
|
|
// in the KB alongside scenario + autotune events. Non-fatal on failure:
|
|
// the cycle result is also written to disk so observability isn't a
|
|
// single point of failure.
|
|
|
|
const OBSERVER_URL = process.env.LH_OBSERVER_URL ?? "http://localhost:3800";
|
|
|
|
export interface BotObserverEvent {
|
|
source: "bot";
|
|
cycle_id: string;
|
|
sig_hash: string; // stable hash of the gap + proposal for dedup
|
|
event_kind: string; // cycle outcome (ok, tests_failed, ...)
|
|
ok: boolean;
|
|
staffer_id?: string; // the model used, e.g. "gpt-oss:120b"
|
|
turns?: number; // number of cloud calls this cycle
|
|
duration_ms?: number;
|
|
extra?: Record<string, any>;
|
|
}
|
|
|
|
export async function postEvent(ev: BotObserverEvent): Promise<void> {
|
|
try {
|
|
const r = await fetch(`${OBSERVER_URL}/event`, {
|
|
method: "POST",
|
|
headers: { "content-type": "application/json" },
|
|
body: JSON.stringify(ev),
|
|
signal: AbortSignal.timeout(3000),
|
|
});
|
|
if (!r.ok) {
|
|
console.error(`[bot/observer] ${r.status}: ${await r.text()}`);
|
|
}
|
|
} catch (e) {
|
|
console.error(`[bot/observer] POST failed: ${(e as Error).message}`);
|
|
}
|
|
}
|