Twitter/X

antirez says he has been making this argument since 2023 (and earlier) about LLM…

2026-08-02 · 16:13 UTC ·@antirez ·0 min read

Brief

antirez states he’s argued since 2023 (and before) that critics claim large language models do not form deeply inferred representations. Instead, skeptics argue LLMs only perform shallow interpolation within the training-set’s local data space—essentially parroting almost-already-seen content rather than truly inferring deeper structure.

Why it matters

antirez says he has been making this argument since 2023 (and earlier) about LLM behavior.

Key details

  • He characterizes the skeptics' claim: even inside the training-set's local data manifold, LLMs only interpolate at a shallow, near-identical level (a “parrot model”) rather than producing deeply inferred representations.
Source evidence

I try to push this argument since 2023 btw. And even much earlier.

antirez (@antirez)

That's undisputed, but the argument of the skepticals was a bit different: that even in the local space represented by the training set, LLMs could not interpolate on the realm of a deeply inferred representation, just on a shallow almost-already-seen one (parrot model).

— https://nitter.net/antirez/status/1735925283125952514#m