The labs will need a new business model. It will mean being first party owners of intellectual property themselves.
This probably means some version of Anthropic owning the robot that cuts your hair and Isomorphic Labs curing cancer with a patented therapy.
Continual Learning DOES solve a problem: you can release a model that isn't above 162 ECI. The model doesn't need to be capable of hacking nation-states to be capable of performing economically relevant work.
This will matter insofar you think that there’s some magical ECI where you can't economically release models. I do think it exists and I thought it was 162 ECI. But apparently I was wrong.
Continual Learning WILL solve everything for the AI trade. It'll be so much more compute intensive that will be able to support many many orders of magnitude of intelligence price declines.
But the labs will be equally challenged until they can sell the final outcomes themselves.
MetaCritic Capital (@MetacriticCap)
This is true, and Alphabet’s management has shown the most foresight so far with applied AI efforts like Waymo and Isomorphic Labs. You see sparks of that at Anthropic with their CRO-ish acquisition.
However, this anti-Coasian singularity will demand an insurmountable amount of execution from the labs. If they draw a line in the sand and declare “No models above 170 ECI ever,” this will be existential for the labs, as they'll need to replace one hundred billion dollars in token revenue with first-party IP.
It’s also possible that the politics surrounding patent and intellectual property law could change radically in ways that are not beneficial to the labs.
— https://nitter.net/MetacriticCap/status/2071074814538780796#m