Changelog

Groq discontinued groq/llama-3.1-8b-instant and groq/llama-3.3-70b-versatile on their inference platform. Requests to these model ids will now 404 from the gateway. Migrate to groq/openai/gpt-oss-20b or groq/openai/gpt-oss-120b, both LPU-served and priced comparably.

Full agent-discovery stack shipped in one release: the @leanroute/mcp-server npm package (also listed in the official MCP Registry as dev.leanroute/mcp-server), a new /platform/v1/* REST API for programmatic account control (list keys, check usage, get credit), a dashboard admin-keys page (owner-only) for minting gw_admin_* tokens, and /llms.txt + /llms-full.txt so agents doing web research find us structured-first.

MCP server docs →

Every API key now has a class: gw_live_* (runtime; dispatches LLM traffic) and gw_admin_* (admin; manages the account). Runtime keys cannot hit /platform/v1/*; admin keys cannot dispatch LLM traffic. Neither class can top up credit or upload BYOK provider keys — those stay behind the dashboard. This is the invariant that makes it safe to hand an admin key to an agent.

LPU-served OpenAI-format inference for openai/gpt-oss-20b and openai/gpt-oss-120b. Sub-100ms first-token latency on both.

Muse Spark 1.1 and 1.2 available at standard-tier pricing. Contributor tier not supported — it trains on customer prompts, incompatible with our privacy commitments.

Privacy statement →

Both checkpoints priced $1.25 / $4.25 per M-tokens (input / output), with 88% cached-input discount.

Concurrent first-visit requests (parallel tab open, RSC layout + page hit at the same time) could both see an empty membership and both INSERT a new org row. Now serialized via pg_advisory_xact_lock keyed on user id — one request wins, the other picks up the created row.

A hardcoded reachability check was only scanning 5 providers, silently filtering out models from qwen, glm, doubao, kimi, sarvam, krutrim, meta, and groq even when their keys were configured. Now iterates the full provider set.

gpt-5.6-cyber for security-analysis workloads ($12.50 / $75). gpt-5.3-codex for code-generation ($1.75 / $14).

Fable 5 ($10 / $50) is Anthropic's new flagship long-context model. Opus 4.5 ($5 / $25) and Sonnet 4.5 ($3 / $15) are quality bumps to the existing tiers.

gpt-5.6-luna dropped from $1.00 / $6.00 to $0.20 / $1.20 — a 5x reduction on input, 5x on output. gpt-5.6-terra now $2.00 / $12.00 (down from $2.50 / $15.00). No change to gateway markup; the savings flow through to your bill directly.

DeepSeek raised published prices for v4-flash ($0.14 → $0.22 input, $0.28 → $0.66 output) and v4-pro ($0.435 → $0.66 input, $0.87 → $1.98 output). Our arbitrage router now routes around DeepSeek during their UTC peak-hour window (01–04 + 06–10 UTC, 2× surcharge) when a cheaper same-tier alternative exists.

How arbitrage works →

When the primary provider returns 5xx, the gateway transparently retries on a same-tier alternative. Logs stamp failover=true + failover_from_provider so the dashboard can show which requests survived an outage. Cost math stays accurate — billing uses whichever provider actually answered.