.@ssankar says Palantir was able to make Nvidia's Nemotron Ultra model "better than frontier":
"I literally almost felt gaslit when, within 24 hours of getting Nemotron up with no post-training, this is vanilla Nemotron Ultra, it did better than frontier."
"If you just looked at the numbers, you would say, 'It's nowhere near the Frontier. That shouldn't even be possible.'"
"But of course, the benchmarks are wrong. I mean, the benchmarks are right for what the benchmark's measuring, but that's not my business. Those are not the tasks my customers had that they were trying to solve."
Video