Charles (@charles_irl) announces a co-release with Z Lab of six state-of-the-art DFlash speculators for Alibaba Qwen 3.x, touting a measured throughput exceeding 1,000 output transactions per second for Qwen 3.5 122B-A10B on a B200. The post frames speculation-driven decoding as their strategic focus and links to a blog for technical rationale.
Co-release (with Z Lab) of six new DFlash speculators targeting Alibaba Qwen 3.x, announced by @charles_irl.
Speculation Is All You Need.
In this blog post, we announce the co-release (w/ Z Lab) of six more state-of-the-art DFlash speculators for @Alibaba_Qwen 3.x.
Over 1k output tps for 3.5 122B-A10B on a B200.
Read the blog for why we're all-in on spec dec.
modal.com/blog/spec-is-all-u…
Video