I uploaded the imatrix 2 bit quants on my Hugging Face. They should be better than the old version, but before updating the download script, if you could help me with some testing reporting the feelings here, I would appreciate :)
antirez uploaded the imatrix 2-bit quantizations to his Hugging Face repo on…
Brief
antirez uploaded the imatrix 2-bit quantizations to his Hugging Face repo on 2026-05-11. He claims they should outperform the previous release and is asking users to run tests and “report the feelings” in replies so he can gather feedback before modifying the download script.