During the Industrial Revolution, the cheaper the coal, the more everyone burned. Now, in the AI era, tokens are the same way.


When tokens become cheap, AI products can burn even more.
In the past, you asked a question, the model answered, and that was the end.
Now, you click once, and an agent in the background disassembles tasks, searches for information, adjusts tools, writes code, fixes bugs, summarizes, running a whole set of processes.
So, individual tokens are cheaper, but the tokens consumed per task are much higher.
That’s why bills keep rising.
After steam engines became more fuel-efficient, the UK didn’t burn less coal. Because coal became more cost-effective, more machines, factories, and railways started burning coal.
Tokens follow the same logic.
Once they’re cheap, agents, deep research, AI programming, long contexts, and enterprise automation really take off.
So, the cost center of AI is shifting from training to inference.
Training is a temporary burn, inference is continuous.
When users are online, it’s burning.
When agents are running, it’s burning.
The longer the context, the larger the cache, and the more memory, bandwidth, electricity, and heat are consumed.
That’s also why the AI supply chain can’t just focus on GPUs.
HBM, DRAM, SSDs, advanced packaging, optical modules, switching chips, CPUs, inference chips—all will be re-priced due to this wave of inference demand.
AI application companies will also be forced to layer their services.
Companies that only provide a UI layer and rely entirely on closed-source APIs—
the more users they have, the bigger the bills, and the thinner the profit margins.
The real barriers will go downward: routing, quantization, caching, batch processing, context trimming, small models replacing large models.
Yes, tokens are like coal.
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pin