Odd Lots

How CoreWeave Sees the Market for Compute Right Now

Brief

CoreWeave’s view of the compute market anchored the episode: co‑founder and CDO Brandon McBee told hosts Joe Wisenthal and Tracy Alloway that demand for inference has arrived and is intensifying across hyperscalers, AI labs and a fast‑growing enterprise base — including direct financial‑services customers such as Jane Street. McBee quantified that CoreWeave supports nine of the top ten AI labs, counts roughly ten $1B+ customers, carries a financial‑services backlog in the tens of billions, operates over a gigawatt of active power, has lowered its cost of capital after raising more than $21B YTD, and sees inference consume well over half of platform utilization. He also described a clear customer shift toward longer, larger take‑or‑pay commitments (3→4→5 years) for access to specific NVIDIA generations.

The conversation traced the market arc from a few experiments to a corporate reckoning: Joe and Tracy flagged headlines about companies burning through AI budgets (Uber reportedly using its 2026 AI spend in four months; an Axios‑cited consultant saying one client spent roughly $500M in a month). McBee agreed demand is “unrelenting” but qualified key constraints: the bottleneck is not simply GPUs but energized data‑center shells (power, transformers, backup batteries, certified electricians) and the operational skill to keep GPUs online and delivering high MFU/goodput. On hardware he emphasized customer requests for NVIDIA (Hopper, Blackwell, H100/A100) and said CoreWeave is already testing Vera Rubin racks; he does not yet see material enterprise traction for non‑NVIDIA silicon. On market structure, McBee argued GPU compute lacks fungibility today — differing configurations, cooling and proprietary ops/software mean a standard, tradable compute commodity is unlikely in the short term (but could emerge over a longer timeline). Hosts and guest agreed the intensity of inference demand is reshaping financing, contracting and data‑center operations, while open questions remain about custom silicon, model routing, and whether compute will ever become a true financial commodity.

Why it matters

Brandon McBee (CoreWeave co‑founder & CDO) said CoreWeave now supports 9 of the top 10 global AI labs, has roughly ten customers spending $1B+ each, and a financial‑services client backlog in the “tens of billions” of dollars.

Key details

  • McBee reported operational scale: CoreWeave has over a gigawatt of active power, has raised over $21 billion of financing year‑to‑date, and says inference workloads account for well in excess of 50% of infrastructure utilization on its platform.
  • Contract durations are lengthening: McBee said customers moved from ~3‑year take‑or‑pay deals to 4‑year, and now are seeking 5‑year, non‑cancellable commitments for specific NVIDIA generations at scale.
  • Hosts Joe Wisenthal and Tracy Alloway highlighted a corporate spend shock: Joe cited Uber reportedly burning through its 2026 AI budget in four months and an Axios‑cited consultant claim of a client spending ~$500M in a single month, underscoring rapid inference cost growth.
  • McBee emphasized NVIDIA dominance: customers overwhelmingly request NVIDIA GPUs (Hopper/Blackwell/H100/A100), CoreWeave has started testing NVIDIA’s next architecture (Vera Rubin) racks, and he said there is not yet material client demand for alternative silicon in production.
  • On commoditization, McBee argued GPU compute is not fungible today — differences in deployment, cooling (liquid vs air), software, MFU (model FLOPS utilization) and goodput mean a liquid traded ‘compute’ commodity is unlikely short term; it could be a timeline question longer term.
Reader · no content

No body text on file.

Open the original to read the full piece.