Sglang is my #1 inference engine.
- most active community
- most models supported
- best performance for 6000s
- good GitHub issues
I love you sglang ❤️
mr-r0b0t (@mr_r0b0t)
Don’t miss this @sgl_project update!
v0.5.13 brings SM120 DSV4 Optimizations, StepFun 3.7 Flash support, Nemotron Ultra support, updated speculative decoding, diffusion model support, and more!
😍
— https://nitter.net/mr_r0b0t/status/2065801366769914083#m