ac01fffd9a
Architectural snapshot of the lakehouse codebase at the point where the
full matrix-driven agent loop with Mem0 versioning + deletion was
validated end-to-end.
WHAT THIS REPO IS
A clean single-commit snapshot of the lakehouse code. Heavy test data
(.parquet datasets, vector indexes) excluded — see REPLICATION.md for
regen path. Full lakehouse history at git.agentview.dev/profit/lakehouse.
WHAT WAS PROVEN
- Vector retrieval across multi-corpora matrix (chicago_permits + entity
briefs + sec_tickers + distilled procedural + llm_team runs)
- Observer hand-review (cloud + heuristic fallback) gating each candidate
- Local-model agent loop (qwen3.5:latest) with tool use + scratchpad
- Playbook seal on success → next-iter retrieval surfaces it as preamble
- Mem0 versioning + deletion in pathway_memory:
* UPSERT: ADD on new workflow, UPDATE bumps replay_count on identical
* REVISE: chains versions, parent.superseded_at + superseded_by stamped
* RETIRE: marks specific trace retired with reason, excluded from retrieval
* HISTORY: walks chain root→tip, cycle-safe
KEY DIRECTORIES
- crates/vectord/src/pathway_memory.rs — Mem0 ops live here
- crates/vectord/src/playbook_memory.rs — original Mem0 reference
- tests/agent_test/ — local-model agent harness + PRD + session archives
- scripts/dump_raw_corpus.sh — MinIO bucket dump (raw test corpus)
- scripts/vectorize_raw_corpus.ts — corpus → vector indexes
- scripts/analyze_chicago_contracts.ts — real inference pipeline
- scripts/seal_agent_playbook.ts — Mem0 upsert from agent traces
Replication: see REPLICATION.md for Debian 13 clean install + cloud-only
adaptation (no local Ollama).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
58 lines
2.0 KiB
Markdown
58 lines
2.0 KiB
Markdown
# Lakehouse systemd units
|
|
|
|
Service definitions for long-running Lakehouse sidecars that aren't the
|
|
Rust gateway itself. The gateway has its own pre-existing unit
|
|
(`lakehouse.service`) that was configured at initial deploy time and
|
|
isn't tracked here.
|
|
|
|
## Units
|
|
|
|
| File | Service | Port | Purpose |
|
|
|---|---|---|---|
|
|
| `lakehouse-auditor.service` | `lakehouse-auditor` | n/a | Polls Gitea for open PRs, runs four checks (static / dynamic / inference / KB query), posts commit-status + review comment. Hard-blocks merges when claims aren't backed. |
|
|
| `lakehouse-context7-bridge.service` | `lakehouse-context7-bridge` | `:3900` | HTTP wrapper around context7's public API for Phase 45 doc-drift detection. |
|
|
|
|
## Install
|
|
|
|
```bash
|
|
sudo bash ops/systemd/install.sh
|
|
```
|
|
|
|
Idempotent. Copies units to `/etc/systemd/system/`, reloads, enables + (re)starts both services.
|
|
|
|
## Operate
|
|
|
|
```bash
|
|
# Status
|
|
systemctl status lakehouse-auditor
|
|
systemctl status lakehouse-context7-bridge
|
|
|
|
# Live logs
|
|
journalctl -u lakehouse-auditor -f
|
|
|
|
# Restart
|
|
systemctl restart lakehouse-auditor
|
|
|
|
# Stop (won't restart until enable + start again)
|
|
systemctl stop lakehouse-auditor
|
|
```
|
|
|
|
## Pause the auditor without stopping
|
|
|
|
```bash
|
|
touch /home/profit/lakehouse/auditor.paused # skip cycles until removed
|
|
rm /home/profit/lakehouse/auditor.paused # resume
|
|
```
|
|
|
|
## Env toggles on the auditor (edit the unit file, `systemctl daemon-reload`, restart)
|
|
|
|
```
|
|
LH_AUDITOR_RUN_DYNAMIC=1 # include the hybrid fixture on every audit
|
|
# default off — fixture mutates live playbook state
|
|
LH_AUDITOR_SKIP_INFERENCE=1 # skip cloud inference for fast/cheap runs
|
|
```
|
|
|
|
## Why both services run as root
|
|
|
|
To match the existing `lakehouse.service` + `mcp-server` + `observer` conventions on this host. Hardening to a dedicated unprivileged user is a follow-up: would need PATH adjustment for `bun`, credential file accessibility (the auditor reads `/home/profit/.git-credentials` which is `0600 profit:profit` — root reads fine, a non-profit non-root user wouldn't).
|