2 Sources
[1]
How A.I. Tokens Work
As more sophisticated models emerge, along with novel ways to use them, there has been a tremendous need for infrastructure to power A.I. activity, from advanced microchips to the data centers that house them. Right now, the full cost of all this activity isn't always passed on to end users. Many
[2]
Fortune
Almost everything in the AI economy is a bet about the future. When Nvidia reports its quarterly earnings, its backlog -- orders planned but not yet filled -- matters nearly as much as revenue. Anthropic and OpenAI's IPO chatter and "valuations" are bets on what they'll earn as much as decades
Share
Copy Link
The price of AI compute tokens has dropped 41% since March 2024, falling from $1.15 to 68 cents per million tokens. As OpenAI slashed GPT-5.6 Luna costs by 80% and businesses imposed cost discipline, the shift away from frontier AI models threatens the financial foundations of the AI economy and its $300 billion in data center financing.
The price of AI compute tokens has plummeted 41% from its March 2024 peak, dropping from $1.15 to 68 cents per million tokens according to data from Ramp, the corporate spending platform
2
. This sharp decline signals what economists are calling a "crack in the AI thesis" that threatens the financial dynamics of the AI economy. The unit of computational cost that powers everything from ChatGPT conversations to enterprise software is becoming commoditized, challenging assumptions that demand for advanced AI models would remain nearly infinite.Businesses are abandoning frontier AI models at an accelerating pace. The share of usage going to the most advanced models dropped from 53% in early August to 45% by September
2
. The top 1% of AI spenders, who drive roughly 80% of OpenAI and Anthropic revenue, cut their per-employee spending by nearly 10% in August. This represents a dramatic reversal from the spring "tokenmaxxing" era when Nvidia CEO Jensen Huang suggested a $500,000 engineer should consume $250,000 annually in AI tokens.Token pricing has become a battleground between the two leading AI companies preparing for public offerings. OpenAI slashed the cost of its GPT-5.6 Luna model by 80%, while Anthropic announced its own price cuts last month
2
. Since August 1, OpenAI's effective price has fallen 38% to 48 cents per million tokens, while Anthropic's has declined 22% to 90 cents. Anthropic has maintained nearly double OpenAI's pricing throughout the year, suggesting some pricing power, but that advantage is eroding as OpenAI captures market share through aggressive discounting.The dollar cost of a token varies dramatically depending on the model. Advanced models like Anthropic's Mythos can cost over 10 times as much per token as cheaper models from the same company due to requirements for newer, more expensive chips and considerably higher energy consumption
1
. Yet businesses are discovering that powerful models waste resources when deployed for mundane tasks that don't require such advanced capabilities.Most consumers remain unaware of the true economics behind their AI interactions. The overwhelming majority of reasoning work generated by AI models is never shown to users, yet these hidden reasoning tokens still count toward operational costs
1
. When The New York Times tested three different ChatGPT versions released since 2023 with identical road trip prompts, the most advanced OpenAI model consumed more than 14 times as many tokens as an earlier version.
Source: NYT
Right now, consumers exist in an "all-you-can-eat phase" of AI, according to Carmen Li, head of Silicon Data, a company tracking token pricing and compute power costs
1
. Many users access free versions of ChatGPT or pay flat AI subscriptions of $20 to $100 monthly without understanding their token consumption or its actual cost. AI companies deliberately price products below token costs while focusing on user acquisition, but this subsidy model faces scrutiny as OpenAI and Anthropic approach their blockbuster public offerings.The market mood has shifted dramatically from spring enthusiasm to summer pragmatism. Amazon and Meta killed internal token-usage leaderboards in May, while Microsoft cancelled Claude Code subscriptions
2
. Companies now impose defaults steering employees away from frontier AI models entirely toward mid-tier options like Anthropic's Sonnet and OpenAI's o1-mini, which deliver high performance at lower costs.Justin Summerville, an executive at OpenRouter, a service helping businesses match appropriate models to specific tasks, observed that many organizations "spent the past year yelling at their employees to use A.I., use A.I., use A.I." But finance departments are now confronting the accumulated expenses
1
. Ramp's data shows the most AI-intensive firms now spend approximately $7,200 per employee monthly on AI subscriptions—roughly one-third of Huang's suggested target and tapering downward2
.Related Stories
The commoditization of AI tokens threatens the financial foundations supporting massive infrastructure investments. Morgan Stanley has identified vulnerability in up to $300 billion in bonds financing neocloud buildouts—companies like CoreWeave that borrowed heavily to construct data centers before securing tenants
2
. These investments assumed sustained demand for expensive compute would justify premium pricing, but current trends suggest otherwise.
Source: Fortune
The entire AI economy operates as a bet on future demand. Nvidia's order backlog matters as much as current revenue, while Anthropic and OpenAI valuations price in earnings decades ahead. The industry pushes roughly 2% of GDP annually through infrastructure development on the premise that businesses will either pay more for smarter models or consume them in such volume that pricing becomes irrelevant. Huang calls this the "two exponentials" driving AI compute demand—models growing more complex while more people and agents use them.
While open-source competition receives significant attention, only 3.6% of businesses on Ramp's platform currently use open source or Chinese models
2
. However, Chinese companies including Deepseek, Tencent, and Alibaba are waging a brutal pricing war that depresses global token pricing. This international phenomenon compounds domestic competitive pressures between OpenAI and Anthropic.Citadel Securities noted in June that Silicon Data's LLM Expenditure Index began falling due to "bifurcation" between frontier AI concentrated among tech-heavy firms that can afford it and the "everyday" AI powering the broader economy
2
. Ara Khazarian, Ramp's chief economist, emphasized that multiple metrics now move in negative directions, threatening anyone "expecting a full dream scenario where the AI companies grow with nothing curbing their enthusiasm."The question of AI cost grows especially pressing as companies prepare for public offerings. Token pricing contributes directly to profit margins, yet uncertainty remains about what costs consumers will bear once subsidies end and whether appetite will persist for the most advanced and expensive models
1
. Whether users pay directly or not, someone bears these costs in money or environmental impact—a reality reshaping how businesses approach AI deployment and investment decisions.Summarized by
Navi
[1]
[2]
17 Jun 2026•Business and Economy

28 Jul 2026•Business and Economy

26 May 2026•Business and Economy

1
Science and Research

2
Technology
3
Technology