Launching @OpenRelayInc : One Endpoint to Rule Them All
- 100B tokens/week across 22 locations on 4 continents
- 8 accelerator SKUs: NVIDIA, TPU, Trainium, AMD
- Up to 20% cheaper than renting the hardware yourself
Every chip on earth. None of them your problem.
Run inference on the world’s compute
piped.video/7uNhqcjBXJg?si=rsBj…
Link
OpenRelay Launch
OpenRelay is building an Inference Delivery Network on our CDN of G...
youtube.com