Thought provoking post by Dwarkesh. In general - as AI gets more powerful - we should expect on the margin that inference goes toward the most economically useful task, and everything else gets priced out.
This in theory in a very scarce environment would cause the cost of inference to skyrocket because those tasks would be far more valuable than today.
But I don’t think it plays out in the way that’s laid out just simply due to market forces competing for inference demand as a way of continuing to drive down prices until capacity can catch up.
There are too many model providers and infra players that want these workloads to cause the effect that’s proposed here. But will see!
Dwarkesh Patel (@dwarkesh_sp)
New blog post on what would be true about the world if trendline continues and leading lab hits $1T in revenue by the end of next year.
In other words, why compute might get 10x+ more expensive in coming years
dwarkesh.com/p/why-compute-m…
— https://nitter.net/dwarkesh_sp/status/2082482530209411419#m