prompt cachingYour AI Router Is Trading a 10x Discount for a 2.5x One
Manifest killed its four-tier LLM router after four months and 7,000 users, and the arithmetic explains why: cache reads bill at 10% of base input, so routing an agent step to a model 2.5x cheaper makes it 3.5x more expensive. Route at the session boundary, not the request.
August 1, 2026 · 15 min readGPT-5.6GPT-5.6: 3 Models, 30x Price Spread, 1 Enterprise Decision
OpenAI just split GPT-5.6 into three models — Sol ($5/$30), Terra ($2.50/$15), and Luna ($1/$6) per million tokens. Sol beats Anthropic's restricted Mythos on TerminalBench. Terra matches GPT-5.5 at half the cost. The release is limited to ~20 organizations under a new U.S. government review process, but the pricing and benchmarks are public. Here's how to classify your workloads across all three tiers and prepare for migration before general availability.
June 26, 2026 · 17 min read