Twitter/X

Kimi K3 is announced as a 2.8 trillion-parameter, native multimodal model with a…

2026-07-16 · 23:04 UTC ·@rsalakhu ·1 min read

Brief

Rajat Salakhutdinov congratulated Zhilin Yang, founder and CEO of Kimi, noting Yang’s four-year Ph.D. from Salakhutdinov’s CMU lab (co-advised by William Cohen) and foundational ML work, while Kimi announced Kimi K3: a 2.8T-parameter, native multimodal model with a 1M-token context, Delta Attention (up to 6.3x faster decoding) and Attention Residuals (~25% training efficiency gain); weights due July 27, 2026.

Why it matters

Kimi K3 is announced as a 2.8 trillion-parameter, native multimodal model with a 1 million-token context window; it is live on Kimi.com, Kimi Work, Kimi Code and the Kimi API, with open weights scheduled for July 27, 2026.

Key details

  • Kimi claims two core innovations: Kimi Delta Attention, enabling up to 6.3x faster decoding in million-token contexts, and Attention Residuals, which reportedly deliver ~25% higher training efficiency at <2% additional cost; the model is positioned for long-horizon agentic coding and self-evolving workflows.
  • Rajat Salakhutdinov congratulated Zhilin Yang (founder & CEO of Kimi), noting Yang completed his Ph.D. in four years from Salakhutdinov's CMU lab (co-advised by William Cohen) and made fundamental ML contributions before founding Kimi.
Source evidence

Congratulations to Zhilin Yang, founder and CEO of @Kimi_Moonshot, on the latest Kimi release. What a huge win for the open-source community!

It feels like just yesterday Zhilin was graduating from my lab at CMU, jointly co-advised with William Cohen. Not only did he complete his Ph.D. in just four years, but he also made truly fundamental contributions to ML during his time at CMU.

What a spectacular career! Congrats again Zhilin, and thank you and the entire Kimi team for everything you're doing for the open-source community.

Kimi.ai (@Kimi_Moonshot)

Introducing Kimi K3: Open Frontier Intelligence

🔹 2.8 Trillion Parameters, 1 Million Context, Native Multimodal
🔹 Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts
🔹 Attention Residuals deliver ~25% higher training efficiency at <2% additional cost
🔹 Built for long-horizon agentic coding and self-evolving workflows

Kimi K3 is now live on on Kimi.com, Kimi Work, Kimi Code, and the Kimi API.
Open Weights by July 27, 2026.

🔗 API: platform.kimi.ai
🔗 Tech blog: kimi.com/blog/kimi-k3

— https://nitter.net/Kimi_Moonshot/status/2077830229968683203#m