Twitter/X

There is growing demand for high-quality empirical data comparing usage of open…

Brief

OpenRouter's team released a claimed rigorous study analyzing 100 trillion tokens to address rising requests for empirical comparisons of open versus closed frontier model usage. The paper, led by MaikaThoughts, alexatallah, and cclark, is posted on arXiv and presented as evidence toward answering those community demands.

Why it matters

There is growing demand for high-quality empirical data comparing usage of open vs closed frontier models.

Key details

  • The authors highlight a "fairly rigorous" OpenRouter study analyzing 100 trillion tokens, led by @MaikaThoughts, @alexatallah, and @cclark.
  • The OpenRouter 100T-token study is available on arXiv.
Source evidence

ppl are increasingly asking for high quality empirical data on open vs closed frontier model usage

a fairly rigorous paper on this topic is our recent @OpenRouter 100 trillion token study, led by @MaikaThoughts @alexatallah @cclark and team

it is up on arxiv