It’s very easy to say “we need an FDA for AI” or some equivalent government agency. Well this is what that would look like.
The capabilities of AI models have near infinite permutations. It’s going to be very hard have a purely objective set of metrics that can be universally applied before every model release, without extended back and forth, research, and debate between model labs, academics, and the government.
Now, imagine this same process with every country that you’re doing business with, globally, for every single model release. Add in a backlog of dozens of AI model releases, and you can quickly see how in the limit this will dramatically slow down all AI progress.
This is why we need to primarily focus on regulating the applied uses of AI, where the risk actually shows up.
Simon Willison (@simonw)
Doesn't sound like we'll be getting Fable back very soon, then
— https://nitter.net/simonw/status/2066495053221286271#m