Token prices, for the time being, are helping us moderate enterprise diffusion of AI. If prices catered we would see compute demand pressure magnitudes higher than it is today.
Zephyr (@zephyr_z9)
They don't have enough inference capacity to fulfil demand, so they are trying to raise prices and destroy demand
One of the reasons why I'm not worried about closed-source lab revenue is that they or their investors (hyperscalers like Google, Amazon, Microsoft) control the majority of global inference capacity
DeepSeek, Kimi, Zhipu (have less than 400MW of combined compute capacity) can't challenge Ant/OAI (have over 6GW of compute)
The real threat for Ant/OAI is a company like Meta/xAI (have 3-4 GW of compute) starting a price war in the near term
The long-term threat is on-prem adoption of open models with enterprises setting up mini clusters (Jensen wants this to happen as it reduces customer concentration risk)
— https://nitter.net/zephyr_z9/status/2085274310982398408#m