we replicated anthropic jspace analysis on @thinkymachines Inkling new 1T model!
it seems to be an outlier: where other models split into near-orthogonal sensory/workspace/motor blocks, inkling keeps roughly one geometry across the whole stack (early-late CKA ~0.8 vs ~0.5 elsewhere)
we also look computed the J-space of @poolsideai's laguna XS 2.1 in bf16 vs nvfp4 to test the impact of quantization. result: almost none. the quantized model has the same jlens space as the non-quantized one
both jspace checkpoint are up on hugging face!
Thinking Machines (@thinkymachines)
Today, we are introducing Inkling.
Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available.
thinkingmachines.ai/news/int…
Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵
Link
Inkling: Our Open-Weights Model
Our first open-weights model: multimodal, Mixture-of-Experts, with controllable reasoning effort. Available to fine-tune on Tinker.
thinkingmachines.ai
— https://nitter.net/thinkymachines/status/2077454609551921208#m