i refuse to believe the ai infra thesis is anywhere near having played out yet.
remember gpus are completely interchangeable
1 company might want to use 100,000 gpus to run AI-powered ads
another company might use the same gpus to build a cure for cancer.
the latter company is going to pay more to use the gpus and nvidia is going to price the gpus closer to the value of unlocking a cancer cure (i.e. charge way more)
so prices (and demand) for gpus is just going to sky-rocket
demand for these semiconductor chips, power and energy is nowhere near being satisfied.
Suhail (@Suhail)
I looked at 13 different providers for even 1 node of B200/B200s while I wait for my order to get delivered.
Zero availability.
I’ve never seen GPU capacity scarcity like this. Prices are also headed towards $6.50-7/gpu/hr. Expect inference to get more expensive.
— https://nitter.net/Suhail/status/2083959529038094709#m