Token prices fell 80% and your bill still went up.
July 12, 2026
OpenAI dropped GPT-4 Turbo prices ~60% in November 2024. Anthropic dropped Claude 3.5 Sonnet prices ~50% in July 2025 and again in Q2 2026. Industry surveys report per-token prices falling 30–50% per year, averaging ~80% decline since 2023. Yet most teams report their AI bills grew 40–100% year-over-year in 2025. Something doesn't add up. That something is Jevons paradox: when the unit price of a resource falls, consumption rises faster than the price fell, and total spend increases. In LLM economics, it's not a hypothetical anymore.
The numbers that don't add up
| Metric | 2024 → 2026 change | Implication |
|---|---|---|
| Per-token pricing (GPT-4, Claude) | -70% to -80% | Cheaper to run every model at every scale. |
| Total LLM tokens consumed (industry) | +200% to +300% | More requests, longer contexts, agents, reasoning. |
| Reported enterprise AI spend | +40% to +100% | Bills went up even though unit cost crashed. |
| Reasoning tokens as % of bill | 0% (2024) → 10–25% (2026) | o1 / o3 changed the cost structure overnight. 10x more expensive per token but high-value problems justify it. |
The math: if token prices fell 80% and your bill went up 60%, consumption grew 8x. Survey data confirms this. Reported adoption of AI agents, autonomous systems, and reasoning models is accelerating, not plateauing.
Why consumption exploded
- Agents stopped being experiments. In 2024, agent loops were risky—they would spiral into expensive token consumption. In 2025, teams deployed agent workflows to production: ticket triage, code review, report generation. Every agent invocation runs dozens of model calls. An agent that handles 100 tickets / day is 1000+ model calls / day. Across the org, this is millions of new tokens / week.
- Context windows got longer, so did the requests. Claude 200K window means people now paste full documents instead of summarizing first. Llama 128K enables retrieving bigger chunks of your knowledge base. The cost per call rose even as the per-token price fell.
- Reasoning tokens became the default for hard problems. OpenAI o1 and Anthropic extended thinking (o3, later models) cost 10–20x more per token but solve previously-unsolvable problems (competitive math, deep reasoning). Teams started routing hard questions to reasoning models, accepting the cost spike.
- Quality evals became routine infrastructure. Nobody runs 1000 token generations for testing anymore. Teams generate 10k variants, score them with LLM-as-judge, and iterate. The eval loop itself is now 100x the cost of the original feature.
- Cheaper pricing meant more use cases suddenly became viable. Classifying every incoming customer email, auto-tagging support tickets, generating fallback responses for every API endpoint—these didn't happen in 2024 because the math was brutal at 2024 prices. At 2026 prices, they're cheap enough to run 24/7.
The trap for finance teams
Finance sees "per-token costs down 80%" and projects AI spend going down. Engineering ships agents, reasoning, and longer contexts. The bill arrives at +60% year-over-year. Finance blames engineering for waste. Engineering says "It was cheaper per token, we thought it was fine." Nobody was wrong, but nobody measured total consumption.
This is the definition of Jevons paradox: the more efficient the input, the more we consume it. Coal became cheaper when steam engines improved ; consumption skyrocketed. Antibiotics became cheaper after Fleming's discovery ; doctors prescribed them for everything, including viral infections. LLM tokens are following the same curve.
How to actually control the bill
- Track total tokens consumed, not just per-token price. Weekly. By model, by feature, by team. If total tokens are up 50% month-over-month, the bill will follow. Price drops won't save you.
- Budget consumption, not cost. "We will not exceed 100B tokens / month" is a real constraint. "We will not exceed $50k / month" is false—prices will drop and you'll burn it all.
- Reason-type accounting. Separate reasoning token spend (expected to grow, high ROI) from base inference (target flat or declining). Reasoning is an investment; base inference is a cost center.
- Agent lifecycle cost. When you ship an agent, calculate its annual token cost. If it handles 1000 tasks / day, it's 365M invocations / year. At $1 / 1K invocations in token cost, that's $365k / year. Budget it like any other infrastructure cost.
- Forecast consumption growth independently from price drops. Separate your price forecast (get it from provider pricing pages) from your consumption forecast (measure trends, growth targets, new features). The two move differently.
What to actually track
Your dashboard should show:
- Total tokens consumed this month, YoY change. This is your leading indicator. If tokens are up, bill will be up.
- Tokens by model. If GPT-4 tokens are flat but o3 tokens are up 300%, you're shifting to higher-quality reasoning. Expected and good. If Llama tokens dropped because you migrated to a frontier model, that's cost creep—investigate why.
- Tokens by feature / team / use-case. Which agent is burning the most? Which team? This drives optimization priority.
- Price per token (list vs actual). Track provider list prices so you can see the effect of price drops on your bill net of consumption growth.
- Reasoning token %, growing or flat? If reasoning climbs from 5% to 20% of tokens, that's a major spend shift. Make sure it's intentional.
The hard truth
Falling prices are not a win for your CFO; they're a trap. They make bad decisions cheap. They expand consumption. They hide waste. Your CFO's job is to make sure that expansion is intentional and ROI-positive, not accidental. You can't do that without separating price from consumption and tracking both ruthlessly.
Related
- LLM cost monitoring: what to track and how to control it
- AI FinOps in 2026
- Reasoning tokens are the hidden line item on your AI bill
FAQ
Why did AI bills go up even though token prices fell?
Token prices fell 70–80% but consumption grew 8x because of agents in production, longer context windows, reasoning tokens becoming the default for hard problems, quality evals becoming routine infrastructure, and cheaper pricing enabling new use cases. This is Jevons paradox: when unit price falls, consumption rises faster and total spend increases.
What caused LLM token consumption to explode?
Agents stopped being experiments and moved to production (ticket triage, code review). Context windows got longer so requests carry bigger payloads. Reasoning tokens became the default for hard problems, accepted at 10–20x cost. Quality evals became routine infrastructure at 100x the feature cost. Cheaper pricing made previously-unviable use cases viable.
What is Jevons paradox in the context of LLM costs?
When the unit price of a resource falls, consumption rises faster than the price fell, and total spend increases. Coal became cheaper when steam engines improved; consumption skyrocketed. LLM tokens are following the same curve: 70–80% per-token price drops met 8x consumption growth, resulting in net +60% spend year-over-year.
How should you budget LLM consumption?
Budget consumption, not cost. 'We will not exceed 100B tokens per month' is a real constraint. 'We will not exceed $50k per month' is false—prices will drop and you will burn it all. Separate reasoning token spend (expected to grow, high ROI) from base inference (target flat or declining).
What should your LLM cost dashboard actually show?
Total tokens consumed this month and YoY change (leading indicator). Tokens by model (detect shifts like o3 up 300%). Tokens by feature/team/use-case (optimization priority). Price per token list vs. actual (see effect of price drops net of consumption). Reasoning token % growing or flat (major spend shift indicator).