LiteLLMLiteLLM's October 21 Compromise Puts Provider Keys at Risk
LiteLLM 1.107.0 and its latest Docker tags carried a credential stealer for about two hours on October 21, and the attack survives uninstalling. Rebuild on 1.106.2 and rotate every key the proxy held as a security incident.
October 24, 2026 · 10 min readAI FinOpsBest FinOps Tools for AI Spend: No Dashboard Fixes an Untagged Key
No FinOps platform can split a shared API key. Tag AI spend at the gateway and the provider first, reconcile against the cost API, then add Vantage for one view and OpenCost for GPUs. Only the gateway can cap a budget.
September 28, 2026 · 13 min readprompt injectionAn Eval Sandbox Gave Up Its Keys. Your Gateway Holds Yours.
Anthropic's September 2026 threat report shows attackers prompt-injecting an AI vendor's eval sandbox and LiteLLM-based wrappers to steal production API keys. Any harness or gateway that reads untrusted text while holding a key is a credential store — split, scope and cap those keys.
September 12, 2026 · 11 min readmodel routingModel Router Buyer's Guide: Buy Failover, Not Judgment
A model router sells two things: mechanical failover, which works, and a learned classifier that picks your model, which the neutral benchmarks say does not. Buy the first, build the second, and plan on 35% savings rather than 60%.
September 11, 2026 · 20 min readAI coding agentsZalando Auto-Approves a Third of PRs. Agents Made Them Bigger.
Zalando published 2.5 years of agentic engineering data across 250+ teams. The 20-40% pull request lead-time win came from a bot that auto-approves 33% of PRs without a human — while PR sizes climbed into the 1k-2k line buckets and per-commit cyclomatic complexity showed inflection points exactly where coding agents entered.
August 17, 2026 · 13 min readLLM gatewayBest LLM Gateways for Cost Control: Self-Host First
Self-host LiteLLM: per-team budgets and virtual keys are in the free open-source tier, while everyone else gates enforcement behind a sales call. Priced through one 50M-request workload, the platform layer ranges from $7 to $10,300 a month.
August 7, 2026 · 19 min read