It looks like I should merge the MXFP4 branch
mzba (@LiMzba)
Deepseek v4 flash 0731 running on M2 Ultra 192GB speed via @antirez's ds4 mxfp4, very usable, now we are pretty much token free.. will use it to try some interesting idea 🧙♂️
Video
— https://nitter.net/LiMzba/status/2083875127587164185#m