Twitter/X

DeepSeek open-sourced DSpark/DeepSpec on 2026-06-28 (post by @heyshrutimishra)…

Brief

DeepSeek released DSpark (and the DeepSpec training/eval stack) on 2026-06-28, open-sourcing the code and checkpoints under an MIT license and claiming production deployment across millions of users. DSpark addresses the token-by-token latency of large LLMs by combining a parallel drafter backbone with a lightweight Markov head so drafts are both fast and token-coherent, yielding 26–31% better accepted-token lengths versus Eagle3 (Qwen3 families) and 16–18% versus DFlash. It also adds a confidence-prediction head that estimates rejection probability and dynamically trims verification length based on server load to avoid wasted GPU verification. DeepSeek reports per-user generation speed gains of 60–85% on V4 Flash and 57–78% on V4 Pro (vs MTP-1), with aggregate throughput improvements of 51–400% under high concurrency. The paper lists founder Liang Wenfeng and Peking University collaborators; checkpoints are on Hugging Face and training code on GitHub, and the framework already supports Qwen3 and Gemma models.

Why it matters

DeepSeek open-sourced DSpark/DeepSpec on 2026-06-28 (post by @heyshrutimishra), releasing the V4 Pro DSpark checkpoint on Hugging Face and training code on GitHub under an MIT license; the system is already running in production on millions of users and available as a free download.

Key details

  • DSpark combines a parallel backbone with a lightweight Markov head to preserve token-to-token coherence while generating in parallel, improving accepted token length by 26–31% versus Eagle3 across Qwen3 model families and by 16–18% versus DFlash.
  • To cut verification waste under load, DSpark adds a confidence-prediction head that estimates rejection probability and dynamically trims verification length per request based on server load, switching verification aggressiveness as GPUs idle or saturate.
  • Measured production impact: per-user generation speed increased 60–85% on DeepSeek-V4 Flash and 57–78% on V4 Pro versus the MTP-1 baseline; aggregate throughput under high-concurrency/strict latency improved 51–400% depending on server load. Paper co-authored by founder Liang Wenfeng and Peking University researchers; framework already works with Qwen3 and Gemma model families.
Source evidence

DeepSeek open-sourced something yesterday that should not be free.

An 85% speed upgrade. Same model. Zero new training. Already running in production on millions of users. And now available to every developer on earth as a free download.

The US-China AI race is usually covered as a model benchmarks competition. Country A releases a model that scores higher on MMLU. Country B releases a reasoning model that beats it on math. The scorecard changes every few weeks and everyone moves on.

DSpark is not that story. DSpark is about who controls the cost of inference at scale, which is the actual competition that matters in 2026.

Here's the problem DSpark solves.

Every large language model generates text one token at a time. Each token requires a full forward pass through the entire model. You feel this as latency. The bigger the model, the slower every single response.

The standard fix is speculative decoding. A small draft model guesses several tokens ahead, then the full model verifies the batch in one pass instead of running one by one. If the guesses are good, you accept them all. If not, you correct and move on. The output is mathematically identical to running the full model normally. The speed is not.

The problem with existing speculative decoding is that it forces a tradeoff. Parallel drafters generate fast but lose token-to-token coherence, so acceptance rates decay badly on long sequences. Sequential drafters preserve quality but are slower to generate. Every system before DSpark picked one side of this tradeoff.

DeepSeek picked neither. They combined a parallel backbone with a lightweight Markov head that injects token dependencies at near-zero cost. The result is a drafter that generates fast and stays coherent. Against Eagle3, the prior state-of-the-art, accepted token length improves by 26 to 31 percent across Qwen3 model families. Against DFlash, it improves by 16 to 18 percent.

Then they solved the second problem: verification waste.

Under heavy server load, verifying long candidate sequences is expensive. If most of those candidates are going to be rejected anyway, the GPU time spent verifying them is pure waste. DSpark adds a confidence prediction head that estimates rejection probability before verification runs, then dynamically trims the verification length per request based on current server load. When traffic is light and GPUs are idle, verify more. When traffic is heavy, verify less and stay fast.

In production on DeepSeek-V4 Flash, per-user generation speed increased by 60 to 85 percent compared to the MTP-1 baseline. On V4 Pro, 57 to 78 percent. Under high-concurrency conditions with strict latency targets, aggregate throughput improved by 51 to 400 percent depending on server load.

This is already running on every user hitting DeepSeek's API today.

The paper was co-authored by DeepSeek founder Liang Wenfeng alongside researchers from Peking University. They then open-sourced the entire training and evaluation stack, called DeepSpec, under an MIT license. The V4 Pro DSpark checkpoint is on Hugging Face. The training code is on GitHub. The framework already works on Qwen3 and Gemma model families, not just DeepSeek's own models.

The pattern here is not accidental. Release the model. Then release the infrastructure that makes it faster. Then release the code so the entire community can replicate it. This is how you build a lead that compounds.

Every major Western lab is focused on the next model release. DeepSeek shipped an 85 percent speed improvement to a model that already existed.