AI FinOps

A 40-call black-box audit from USTC flagged 7 of 15 OpenAI-compatible GPT services for behaviour consistent with output-token inflation. The flags are not proof, but padded answers pass quality evals and invoice checks alike, so measure output tokens per task against the first-party API.

At 10,000 users, Postgres with pgvector costs $163-$332 a month against Zep's $375-$750 and Letta's $1,020 — and no independent party has confirmed that a commercial memory store retrieves better. Buy one when you can name the column you could not write yourself.

A model router sells two things: mechanical failover, which works, and a learned classifier that picks your model, which the neutral benchmarks say does not. Buy the first, build the second, and plan on 35% savings rather than 60%.

Priced on one normalised agent workload, a month of inference costs $370 on GPT-5.6 Luna and $10,725 on Claude Opus 5. Output, reasoning and cache-read rates explain the gap, not the input price.

Training a custom model costs about $30. Serving the same weights costs $326 to $28,908 a month depending on the platform. The fine-tuning-versus-RAG decision is a serving-contract decision, and the break-even is 683,000 queries.

A Copilot seat lists at $19 to $30 a month, but agent consumption, a credit pool that expires and per-gibibyte indexing decide the bill. One GitHub Copilot developer running a daily agent session costs $174 a month against a $19 seat.

Sixty-four B200s cost between $1.93M and $9.03M for a year depending only on how you buy them. But at the 5% GPU utilisation Cast AI measured across 23,000 production clusters, a committed $3.44/hr rate bills out at $68.80 per useful GPU-hour — and the break-even duty cycle is 48%.

GitHub's HydraFusion router bills every model it invokes at standard rates, and two of its three patterns fire two or three models per turn. The measured saving swings from 36% to 67% across just three benchmarks — and the one that looks most like enterprise work saved least.

Databricks took managed Iceberg tables to GA, so the file format is no longer the lock — but external writes are still Private Preview, and the real markup is GPU serving at $5.50 an A100-hour against $2.79 at Lambda. Move the serving, keep the lakehouse.

A published trace of one 800-line pull request shows a coding agent billed roughly 156 million tokens to produce 289,000 — 98% of the volume was cache re-reads of context re-sent on every one of 512 turns. Coding-agent cost is set by turns per task and the width of each read, not by the model's rate card.

Google began billing Memory Bank and Sessions on September 1, charging $0.30/GiB-month on total data stored including every revision. Memories carry no default TTL, so four months of agent state accumulated before the first metered invoice.

Anthropic cut Claude Fable 5.1 cache reads 75% to $0.25/MTok, half of Opus 5's rate on a model with twice the base input price. But Opus 5 stays cheaper until cache reads pass a third of your bill, and Anthropic's own savings ceiling of 45% falls short of the 50% crossover.

OpenAI bought tens of thousands of Mac minis to train computer-use agents, and Anthropic rents Mac capacity through AWS. The reason matters to your pilot: a desktop agent's unit of cost is a machine, not a token, and Apple's licence caps you at two virtual desktops per Mac while every cloud Mac host bills a 24-hour minimum.

Anthropic's August 13 Claude Tag update replaced the per-message classifier with full-channel context. The agent's read scope is now the channel's whole conversation, the member list is the control that governs it, and Anthropic's own docs now say there is no per-action log of who asked.

Nvidia carries $279B in supply commitments, an increase it attributes primarily to memory, and still guided gross margin from 75% down to a 71-72% trough on RAM costs. Your server quote has no such contract behind it, and every self-hosted inference TCO model built on 2025 hardware prices is now understated.

At two million pages a month, Amazon Textract's Forms + Tables + Queries bundle bills $125,000 and a Gemini Flash-Lite schema prompt bills $3,155. The gap is a pricing structure, not a technology gap — buy OCR and field extraction separately.

Priced against one normalised workload — 5M LLM calls a month across 4 models — Azure API Management runs about $700/month, Kong about $1,400 and Apigee about $3,931. None of the three enforces a hard budget cap.

A controlled 90-trial experiment found Claude Haiku 4.5 spent 735K tokens where Sonnet 4.6 spent 640K, for a result 1.9 points worse. Downgrading a coding agent to a cheap tier saves less than the rate card implies, varies fivefold by vendor, and only holds up if you replace prose design docs with machine-checkable contracts.

OpenAI cut GPT-5.6 Sol to $4/$20 per million tokens but guarantees the rate only "at least through November 21, 2026," with no successor published. The cut was asymmetric, so no two workloads saved the same amount — and the reversion is +50% on output, not +33%.

Priced on one 10,000-conversation workload, the same agentic work costs $5,940 or $20,000 a month depending only on the billing unit. Per-resolution is the only meter where the vendor absorbs the 30x token variance instead of the buyer.

Eleven AI observability options priced against one workload — 500,000 agent runs a month, 5 million spans, 10 GB of traces. The same telemetry costs $49 at SigNoz Cloud and about $930 at W&B Weave, and retention is a bigger multiplier than traffic.

Modelled at three workload sizes on 18 August 2026: managed pgvector runs about $1,910/month at 10M vectors against Pinecone's $19,716 on-demand. But the real problem is that Pinecone's cheaper Dedicated Read Node rate and Qdrant Cloud's per-unit rates are not published anywhere.

DoiT bought Attribute, the eBPF-based AI cost-attribution startup, for an estimated $65M. DoiT also resells the cloud it now meters — and the kernel sensor you approved has a new owner nobody re-reviewed.

A production RAG pipeline at 10M tokens a day costs about $1,308 a month, 61% of it generation and one dollar of it embeddings. The line that wrecks the budget is document parsing, which swings from $2,100 to $90,000 over the same 2 million pages.

AgentCore's new Instances compute type runs agents on EC2 in your own account for up to 14 days. AWS's documentation states that agents sharing an instance get no security boundary, that the platform does not verify a session ID belongs to the caller, and that the billable instances are hidden from your EC2 console by default.

Seven agent monitoring tools priced against the same workload: 50,000 runs a month at 12 steps each. Self-hosted Langfuse wins on cost and audit depth — but only one of these tools sits in the request path where it can actually stop a runaway agent, and that is the part you have to build yourself.

Self-host LiteLLM: per-team budgets and virtual keys are in the free open-source tier, while everyone else gates enforcement behind a sales call. Priced through one 50M-request workload, the platform layer ranges from $7 to $10,300 a month.

DeepSeek warned of a significant API price rise with no number and no date. Because the weights are MIT-licensed, the ceiling is already public: independent hosts serving the identical model charge 3-4x on posted rates and 40x on cache hits.

Manifest killed its four-tier LLM router after four months and 7,000 users, and the arithmetic explains why: cache reads bill at 10% of base input, so routing an agent step to a model 2.5x cheaper makes it 3.5x more expensive. Route at the session boundary, not the request.

Avalara surveyed 1,505 CFOs: 92% feel pressure to prove AI ROI, 50% see only limited returns. McKinsey's AI FinOps framework is the answer most teams are missing.

OpenAI CFO Sarah Friar published a four-question AI ROI framework — 'Useful Intelligence per Dollar' — as enterprise AI spending hits $2.59 trillion with 72% of investments destroying value through waste. The scorecard demands enterprises stop measuring tokens consumed and start measuring work accomplished. Enterprise AI ROI calculator, cost-per-successful-task measurement framework, and AI investment maturity assessment inside.

On July 2, 2026, Crunchbase published data that should have triggered an emergency vendor review at every Fortune 500 company. Global startup investment hit a record $510 billion in the first half of 2026 — surpassing the $440 billion invested in all of 2025. But the real story isn't the record. It's the concentration: OpenAI and Anthropic alone absorbed $217 billion, or 43% of every venture dollar deployed on Earth. Your AI stack almost certainly runs on one or both of these companies. And whether they succeed spectacularly or collapse under their own economics, you have a problem either way.

Tesla caps AI at $200/week. Uber blew its 2026 budget in 4 months. Here's the enterprise playbook for AI cost governance.

Agents hit production unevenly. MCP became the integration standard. AI FinOps went from edge concern to universal practice. Here's what actually changed in H1 2026 — and what's coming next.

State of FinOps 2026: AI cost governance went from niche to universal in 24 months. 41% of enterprises waste 15%+ of AI budgets. Readiness scorecard inside.

Harness launches AI DLC Insights as 94% of engineering leaders admit they can't measure AI coding ROI. ROI calculator + 25-point readiness assessment inside.