Twitter/X

In 2001 Jeff Dean and Sanjay Ghemawat calculated that Google’s entire search…

2026-07-30 · 22:27 UTC ·@sdianahu ·1 min read

Brief

sdianahu thanked Jeff Dean after their Startup School 2026 conversation, in which Dean recounted that in 2001 he and Sanjay Ghemawat fit Google’s entire search index into RAM (deployed in days) and that a 2013 napkin math—three minutes of daily speech recognition per user would double the server fleet—spurred the TPU; he argued inference hardware is the next specialization, predicted long‑running agents, and emphasized context engineering and where small teams can still win.

Why it matters

In 2001 Jeff Dean and Sanjay Ghemawat calculated that Google’s entire search index would fit in RAM, shipped the change in a few days, and that optimization made search fast.

Key details

  • In 2013 a napkin calculation showed three minutes of daily speech recognition per user would require doubling Google’s server fleet; that insight led to building the TPU.
  • At Startup School 2026 (conversation between Jeff Dean and @sdianahu) Dean argued that inference hardware is the next specialization, predicted long‑running AI agents and the importance of context engineering, and said two- or three-person teams can still win (timestamps 00:07–50:02 cover topics).
Source evidence

thx @JeffDean enjoyed the conversation!

Y Combinator (@ycombinator)

In 2001, @JeffDean and Sanjay Ghemawat did the math and realized Google’s entire search index would fit in RAM — then shipped it in a few days, and search got fast.

In 2013, another napkin calculation showed that three minutes of daily speech recognition per user would require doubling Google’s server fleet. That one became the TPU.

At Startup School 2026, Google’s Chief Scientist talks with YC’s @sdianahu through the thought experiments behind both, why inference hardware is the next specialization, and where two or three people in a room can still win.

00:07 — Are AI Models Already Junior Engineers?
01:44 — AI Systems That Improve Themselves
02:40 — The Google Search Breakthrough That Changed Everything
04:38 — AI Agents Will Run for Weeks
05:58 — The Napkin Math That Led to TPUs
09:20 — How to Find Breakthrough Ideas
10:25 — The AI Engineer's New Mental Model
12:33 — Why AI Is Really an Energy Problem
16:11 — Context Engineering Is the Next Frontier
19:46 — The Skill That Made AI Better at Optimization
22:13 — Why Long-Running Agents Fail
25:21 — Where Startups Can Still Beat Google
31:19 — How to Become an AI-Native Founder
36:36 — Question Your Biggest Assumptions
42:08 — AI That Builds Better AI
50:02 — Build Something That Truly Matters

Video

— https://nitter.net/ycombinator/status/2082938685071491219#m