i think if anthropic really believes that they must build both the application and the model in one, this causes two problems for them:
- it creates the largest possible incentive to replace them
- it sets up other labs to counter position by waiting for apps to overshoot customer expectations
say it's the 1920s and you've got amazing engine technology. but no matter how good your engine is, you're still going to get a faster car by building the rest of the car: the chasis, the wheels, the engine, the whole thing.
but now fast forward in time and wow cars are getting really fast, even faster than the speed limit allows. but now these customers are suddenly no longer interested in the speed of the car, because every car can go 100 miles an hour. they care about leather seats. they care about radios.
it's this era of the lifecycle that the modular technology shines. the maker of the car radio could instead make cars by buying the engine, a modular component, from another vendor. meanwhile, our original vertically integrated competitor may struggle to split up their products, because they make so much margin selling to the top of the market, the race car drivers who still care about speed, and because they've invested so much money vertically integrating.
so a reasonably smart model vendor, looking at anthropic vertical integration play, could position themselves to take the tremendous capital that is at risk if anthropic comes for them, and "arm the rebels" a bit. in cars, this may not have worked, because the timescale from going from "20mph" to everything being "80mph" was ~100 years. but the acceleration of AI is so fast that it the vertically integrated products may quickly overshoot customer expectations, possibly within ~years, rather than decades.
if i had to put myself in the mind of anthropic, i suspect their answer to this will be like "we have the newest models, and so we will always be able to use them ourselves to live in the future and outcompete everyone on products" because of the speed advantages they get. i think this framing is reasonably true, but it also means that they're exactly incentivized to push up market and attack the "race cars" of the world, which will likely earn them higher margins. but the problem of doing this is that they expose the lower end of the market to a modular competitor who either partners with someone else offering a value proposition that anthropic was not specialized in offering (the "radios in the car"), or a modular competitor who simply pushes prices down such that anthropic reallocates their hard assets towards the top of the market, where all their margins are. that modular competitor then gets to keep pushing up market at the same rate anthropic does, as a fast follower that brings down prices while anthropic (or whoever the leader is) goes off and makes the cancer cures or whatnot.
Fireside Alpha (@firesidealpha)
Anthropic Technical Staff Jess Yan says the harness and the model cannot be pulled apart without giving up performance, though she flags her own bias.
"I think I am quite biased but I also think that it is impossible to get the maximum possible performance without tying together the harness and the model."
"Now the components of the harness and maybe the thickness of the harness will change over time as models get more and more capable."
"However, when we test our models and when we are assessing their performance we always have to test it in conjunction with a harness."
"And are we going to test it with all the different harnesses of the world? We're going to select the harnesses that we have built."
"And so there is an aspect of the necessity of building models is that you have to be testing them with harnesses, and that sort of keeps them paired together."
Video
— https://nitter.net/firesidealpha/status/2083664004506145276#m