Twitter/X

@cramforce (2026-07-27) states that inference for Chinese open-weight models does…

2026-07-27 · 15:34 UTC ·@cramforce ·1 min read

Brief

Author @cramforce warns people who assume inference for Chinese open-weight models must run in China, emphasizing that open weights let any provider host inference anywhere. As an example, Vercel posted on 2026-07-27 that Moonshot AI's Kimi K3 and Kimi K3 Fast are now served via AI Gateway by US providers (Baseten, FireworksAI) with Zero Data Retention and automatic failover.

Why it matters

@cramforce (2026-07-27) states that inference for Chinese open-weight models does not have to run in China — open weights allow any provider worldwide to host inference.

Key details

  • Vercel Developers announced (vercel.com/changelog) that Moonshot AI's Kimi K3 and Kimi K3 Fast (moonshotai/kimi-k3 and moonshotai/kimi-k3-fast) are available on AI Gateway from US-based providers including Baseten and FireworksAI, with Zero Data Retention and automatic failover.
Source evidence

I sometimes talk to people who assume that inference for Chinese open weight models is also in China.

This is, of course, not true. In fact, the beauty of open weights is that anyone can provide an inference service for them.

Vercel Developers (@vercel_dev)

Kimi K3 is now available from US-based providers on AI Gateway, including @baseten, @FireworksAI_HQ, and others.

Zero Data Retention is also supported.

• 𝚖𝚘𝚘𝚗𝚜𝚑𝚘𝚝𝚊𝚒/𝚔𝚒𝚖𝚒-𝚔𝟹
• 𝚖𝚘𝚘𝚗𝚜𝚑𝚘𝚝𝚊𝚒/𝚔𝚒𝚖𝚒-𝚔𝟹-𝚏𝚊𝚜𝚝

vercel.com/changelog/kimi-k3…

Link

Kimi K3 and Kimi K3 Fast with ZDR and US-based providers now on AI Gateway - Vercel

Kimi K3 and Kimi K3 Fast from Moonshot AI are now available on AI Gateway with Zero Data Retention, served by US-based providers including Baseten and Fireworks, with automatic failover for higher...
vercel.com

— https://nitter.net/vercel_dev/status/2081762176541622478#m