More Thoughts on the New AI Licensing Regime
The economic interest is in the frontier. People are paying for Anthropic and OpenAI's frontier models. They want the best. Companies like Mistral, XAI, etc. are falling behind because they are not on the frontier, and we are seeing winner-take-most dynamics. Some markets -- potentially the most valuable ones -- are winner-take-all where the smartest model wins.
Therefore, OpenAI and Anthropic could suffer the same fate as Mistral if they are no longer offering frontier models, while someone else is.
Therefore, this shoots the true starting gun for China to develop frontier models: if they offer the best models, they will get the customers. Switching model providers, in most instances, is still easy; we've seen lots of evidence of this recently. Right now, the R&D gap is less than a year: perhaps they can close it.
Some people think that the US and China might team up and (effectively) create a global AI licensing regime. But I view it as unlikely that China will cooperate with the US with a similar licensing regime, for two reasons:
(a) My understanding of the Chinese government's approach is far less eschatological than the US': not framing AI as technology on par with nuclear weaponry, but rather as another normal technology that offers a chance at prosperity. It's important to note that the trend in China for the past fifty years has been one of steep, exponential progress in technological advancement offering enormous prosperity. It would take much more than what's going on currently to shake confidence in that trend.
(b) If they do take the technological lead on supplying the world with frontier models, obviously that's a huge geopolitical and economic advantage!Some people are suggesting that this will result in the US banning Chinese models. While plausible, this would be an ineffective policy move: digital borders are porous and a myriad resellers and wrappers would enable access, if not providing US customers with plausible deniability.
Perhaps the US could go further in trying to ban Chinese models, impose sanctions, etc. but this would end up being structurally equivalent to the EU's attempts to regulate US technology. We know how those end: ineffective while dooming themselves to irrelevance with the technology of yesteryear.
What I've described is a Red Queen's race. If you wish to regulate, you must compete, and you must win.
As a final thought, what does it mean to be "frontier"? This is a real question. As @polynoamial recently wrote about, benchmark performance is increasingly becoming a function of test-time compute, so it becomes very hard to tell which models are better than others: benchmarks might need to run for weeks or months to tell.
So maybe you say "frontier" is anything above a certain number of FLOPs. Or above some number of parameters.
But training techniques are becoming more efficient all the time. @karpathy said he expects to see AGI in a <1B parameter model.
=> There's no clear line. The result is that while today's "frontier" models may need to be licensed, eventually all models will be licensed. Maybe even all model-capable hardware.