History

profit b933334ae2 Auditor: static diff check — catches own Phase 45 placeholder

auditor/checks/static.ts — grep-style scan of PR diffs, no AST,
no LLM. High-signal patterns only.

Severity grading:
- BLOCK — unimplemented!(), todo!(), panic!("not implemented"),
  throw new Error("not implemented")
- WARN  — TODO/FIXME/XXX/HACK in added lines;
          new pub struct fields with <2 mentions in the diff
          (added but nobody reads it — placeholder state)
- INFO  — hardcoded "placeholder"/"dummy"/"foobar"/"changeme"/"xxx"
          strings in added lines

Live-proven — the existential test J asked for:

  vs PR #1 (scaffold):        0 findings (all scaffold fields cross-
                              reference within the diff)
  vs commit 2a4b81b (Phase    5 WARN: every DocRef field (tool,
  45 first slice — I          version_seen, snippet_hash, source_url,
  half-admitted placeholder): seen_at) added with 0 read-sites in
                              the diff

That's the auditor flagging my own "Phase 45 first slice" commit as
state-without-consumer, which is exactly what I half-admitted it
was. If PR #1 had required auditor-pass (branch protection), the
DocRef commit would have been blocked pre-merge. The auditor works
because it agreed with the honest read.

Next: dynamic hybrid test fixture (task #4) — the never-run multi-
layer pipeline test.

2026-04-22 03:29:31 -05:00

checks

Auditor: static diff check — catches own Phase 45 placeholder

2026-04-22 03:29:31 -05:00

claim_parser.ts

Auditor: claim parser

2026-04-22 03:28:06 -05:00

gitea.ts

Auditor scaffold: types + Gitea client + policy stub + README

2026-04-22 03:26:56 -05:00

policy.ts

Auditor scaffold: types + Gitea client + policy stub + README

2026-04-22 03:26:56 -05:00

README.md

Auditor scaffold: types + Gitea client + policy stub + README

2026-04-22 03:26:56 -05:00

types.ts

Auditor scaffold: types + Gitea client + policy stub + README

2026-04-22 03:26:56 -05:00

README.md

Lakehouse Claim Auditor

A Bun sub-agent that watches open PRs on Gitea, reads the ship-claims in commit messages and PR bodies, and hard-blocks merges when the code doesn't back the claim.

Rationale: when "compiles + one curl works" gets called "phase shipped," placeholder code accumulates. This auditor runs every 90s, fetches each open PR, and subjects it to four checks:

Static diff — grep/parse looking for placeholder patterns
Dynamic — runs the never-before-executed hybrid test fixture
Cloud inference — asks gpt-oss:120b via /v1/chat to identify gaps in the diff
KB query — looks up data/_kb/ + observer for prior failure patterns on similar claims

Verdict is assembled, posted to Gitea as:

A failing commit status (hard block — branch protection prevents merge)
A review comment explaining every finding

Run manually

cd /home/profit/lakehouse
bun run auditor/index.ts

Defaults: polls every 90s, stops on auditor.paused file present.

State

data/_auditor/state.json — last-audited head SHA per PR
data/_auditor/verdicts/{pr}-{sha}.json — per-run verdict record

Where YOU edit

auditor/policy.ts — the verdict assembler. Controls which findings block vs warn vs inform. All other code is mechanical: fetching, running checks, posting to Gitea.

Hard-block mechanism

Commit status is posted as failure with context lakehouse/auditor
If main branch protection requires lakehouse/auditor status to pass, Gitea prevents merge
When code is fixed and re-audit passes, status flips to success, merge unblocks

Enable branch protection (one-time, via Gitea UI or API):

POST /repos/profit/lakehouse/branch_protections
{"branch_name": "main", "required_status_checks": {"contexts": ["lakehouse/auditor"]}}