If you have 2-4 RTX pro 6000s reach out maybe we can try self hosting models over WAN see if we can get GLM-5.2 at reasonable speeds
Author @0xSero seeks collaborators who own 2–4 NVIDIA RTX Pro 6000 GPUs to…
Brief
0xSero is asking people with 2–4 NVIDIA RTX Pro 6000 GPUs to contact them to try a WAN-based, multi-GPU self-hosting setup. The planned experiment aims to shard or distribute GLM-5.2 across those GPUs to test whether acceptable inference performance can be achieved over wide-area network connections.
Why it matters
Author @0xSero seeks collaborators who own 2–4 NVIDIA RTX Pro 6000 GPUs to attempt a distributed self-hosting experiment over WAN.
Key details
- Objective is to evaluate whether GLM-5.2 can run at 'reasonable speeds' when sharded across multiple RTX Pro 6000s connected over wide-area network links.