firstpass-proxy 0.1.2

Drop-in, Anthropic-compatible LLM proxy that routes each request to the cheapest model that provably passes a quality gate, escalates on failure, and records a tamper-evident audit trace.
Documentation

firstpass-proxy

An HTTP proxy that sits as a drop-in base_url in front of Anthropic/OpenAI-compatible providers. In observe mode it forwards each request unchanged and records a tamper-evident audit trace asynchronously (zero added latency). In enforce mode it runs the escalation engine — cheapest model first, gate the output, escalate one rung on failure, serve the first output that passes — with cross-provider failover (SPEC §7.1, §7.1a, §9.1).

  • [config] — [ProxyConfig], loaded from the environment.
  • [store] — the background SQLite trace writer.
  • [calibrate] — recalibrate the conformal serving threshold from deferred feedback.
  • [upstream] — BYOK passthrough to the upstream provider (observe mode).
  • [provider] — normalized multi-provider model access (Anthropic, OpenAI).
  • [gate] — runtime verification gates (Batch 3 inline set).
  • [router] — the enforce-mode escalation engine.
  • [proxy] — axum routing, observe passthrough, and enforce dispatch.
  • [error] — structured, no-leak error responses.
  • [metrics] — Prometheus recorder install + GET /metrics.
  • [cli] — firstpass doctor / trace logic (validate a setup, read the store).
  • [mcp] — minimal MCP stdio server so an agent can read its traces and submit feedback.
  • [run] — shared server bootstrap for the firstpass and firstpass-proxy binaries.