Twitter/X

Kimi K3 claims 2.8 trillion parameters and a 1,000,000-token context window with…

2026-07-16 · 20:54 UTC ·@alexocheema ·0 min read

Brief

Kimi.ai announced Kimi K3, a 2.8T-parameter, native-multimodal model with a 1M-token context designed for long-horizon agentic coding and self-evolving workflows. The release highlights Kimi Delta Attention (up to 6.3× faster decoding at million-token scales) and Attention Residuals (~25% training-efficiency gain at <2% extra cost). Kimi K3 is available now across Kimi’s products, with open weights promised by July 27, 2026.

Why it matters

Kimi K3 claims 2.8 trillion parameters and a 1,000,000-token context window with native multimodal support.

Key details

  • Kimi Delta Attention purportedly enables up to 6.3× faster decoding in million-token contexts; Attention Residuals claim ~25% higher training efficiency at under 2% additional cost.
  • Kimi K3 is live on Kimi.com, Kimi Work, Kimi Code, and the Kimi API; weights will be open on July 27, 2026.
Source evidence

A win for everyone, except a few companies.

Kimi.ai (@Kimi_Moonshot)

Introducing Kimi K3: Open Frontier Intelligence

🔹 2.8 Trillion Parameters, 1 Million Context, Native Multimodal
🔹 Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts
🔹 Attention Residuals deliver ~25% higher training efficiency at <2% additional cost
🔹 Built for long-horizon agentic coding and self-evolving workflows

Kimi K3 is now live on on Kimi.com, Kimi Work, Kimi Code, and the Kimi API.
Open Weights by July 27, 2026.

🔗 API: platform.kimi.ai
🔗 Tech blog: kimi.com/blog/kimi-k3

— https://nitter.net/Kimi_Moonshot/status/2077830229968683203#m