profit/lakehouse
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

observer: route escalation to paid OpenRouter (deepseek-v3.1-terminus)
Some checks failed
lakehouse/auditor 1 blocking issue: todo!() macro call in tests/real-world/scrum_master_pipeline.ts

Browse Source 
ollama_cloud/qwen3-coder:480b was hitting weekly 429 quota; observer
escalations were silently failing 502 with no audit row. Switched
escalation cloud-call to deepseek-v3.1-terminus on paid OpenRouter:
671B reasoning specialist, $0.21 in / $0.79 out per M tokens (under
the $0.85/M ceiling J set), 164K ctx.

End-to-end verified: kb_preamble_chars=416, prompt 245 tokens,
completion 155 tokens, ~$0.00018 per escalation. Diagnosis output is
specific (cites adapter + route file), not generic. Two-stage chain
holds: qwen3.5:latest compresses raw KB hits into a tight briefing,
deepseek-v3.1-terminus reasons over the briefing for diagnosis.

Audit `mode` field updated to direct_chat_deepseek_v3_1_terminus so
downstream consumers can attribute analyses to the correct rung.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
root 2026-04-26 18:42:27 -05:00
parent d9bd4c9bdf
commit 340fca2427
1 changed files with 9 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
mcp-server/observer.ts
View File

@ -275,12 +275,18 @@ async function escalateFailureClusterToLLMTeam(sigHash: string, cluster: Observe
const prompt = `${kbPreamble}sig_hash=${sigHash} · ${cluster.length} failures on the same signature:\n\n${context}\n\nReview this failure cluster. Identify:\n1. Likely root cause (single sentence).\n2. Files most likely responsible (path hints).\n3. Concrete fix direction (under 3 sentences).\n4. Confidence: NN%\n\nBe specific, not generic.`; const prompt = `${kbPreamble}sig_hash=${sigHash} · ${cluster.length} failures on the same signature:\n\n${context}\n\nReview this failure cluster. Identify:\n1. Likely root cause (single sentence).\n2. Files most likely responsible (path hints).\n3. Concrete fix direction (under 3 sentences).\n4. Confidence: NN%\n\nBe specific, not generic.`;
try { try {
// 2026-04-26: switched from ollama_cloud/qwen3-coder:480b (weekly
// 429 quota was blocking escalations) to paid OpenRouter
// deepseek-v3.1-terminus — 671B reasoning specialist, $0.21 in /
// $0.79 out per M tokens (under the $0.85/M ceiling J set), 164K
// ctx. Per-escalation cost: ~$0.0006 (typical 500-token prompt +
// 300-token completion).
const resp = await fetch(`${LAKEHOUSE}/v1/chat`, { const resp = await fetch(`${LAKEHOUSE}/v1/chat`, {
method: "POST", method: "POST",
headers: { "Content-Type": "application/json" }, headers: { "Content-Type": "application/json" },
body: JSON.stringify({ body: JSON.stringify({
provider: "ollama_cloud", provider: "openrouter",
model: "qwen3-coder:480b", model: "deepseek/deepseek-v3.1-terminus",
messages: [{ role: "user", content: prompt }], messages: [{ role: "user", content: prompt }],
max_tokens: 800, max_tokens: 800,
temperature: 0.2, temperature: 0.2,
@ -302,7 +308,7 @@ async function escalateFailureClusterToLLMTeam(sigHash: string, cluster: Observe
const row = { const row = {
ts: new Date().toISOString(), ts: new Date().toISOString(),
source: "observer_escalation", source: "observer_escalation",
mode: "direct_chat_qwen3_coder_480b", mode: "direct_chat_deepseek_v3_1_terminus",
sig_hash: sigHash, sig_hash: sigHash,
cluster_size: cluster.length, cluster_size: cluster.length,
cluster_staffer: cluster[0]?.staffer_id, cluster_staffer: cluster[0]?.staffer_id,