Self-Hosted gpt-oss-120b on H100 Costs 2x the API at 9-to-5 Load
An H100 running gpt-oss-120b at Lambda's $4.29 an hour must sustain 5,958 tokens per second every hour of the month to match a $0.20 blended API rate. Business-hours traffic leaves it at about twice the API's cost.
October 23, 2026 · 16 min read