Just added 2 new model compressions:
Hy3-FP8 & NVFP4
I recommend trying this model it's very strong and fits on 256gb of vram with full context
huggingface.co/0xSero/Hy3-pr…
0xSero announced on 2026-05-10 they've added two model compressions—Hy3-FP8 and…
Brief
0xSero announced on 2026-05-10 they've added two model compressions—Hy3-FP8 and NVFP4—and recommends trying the Hy3 variant. They claim the compressed model is "very strong" and can fit on 256 GB of VRAM while preserving full context. Model files are available at huggingface.co/0xSero/Hy3-pr…