In production
LLM layer for a small-business operations system
One model-provider interface with per-request routing across Claude, Gemini and OpenRouter. One OpenTelemetry span per model call with GenAI semantic conventions. Every call, failures included, kept in a ledger with billed cost and tokens. Hybrid retrieval, async generation through Pub/Sub, and an MCP server with OAuth 2.0 and per-user consent.
Go · OpenTelemetry · Pub/Sub · MCP
