DwarfStar branchk "ds4f-mxfp4" now can run the lossless MXFP4 DeepSeek v4 Flash GGUF I published on my Hugging Face account. It rocks even with SSD streaming in 128GB systems at > 20 t/s in case you want to try the actual DS4F weights released without any quantization.
DwarfStar branch "ds4f-mxfp4" can run the lossless MXFP4 DeepSeek v4 Flash GGUF…
Brief
DwarfStar's branch ds4f-mxfp4 now supports the lossless MXFP4 DeepSeek v4 Flash GGUF model that @antirez published on Hugging Face. The author says the unquantized DS4F weights run well even with SSD streaming, reaching over 20 t/s on systems with 128 GB of RAM.
Why it matters
DwarfStar branch "ds4f-mxfp4" can run the lossless MXFP4 DeepSeek v4 Flash GGUF model published by @antirez on Hugging Face.
Key details
- The author reports it achieves >20 t/s with SSD streaming on 128 GB systems using the unquantized DS4F weights.