We've open-sourced MoonEP, our high-performance communication library for distributed MoE workloads.
Built to make expert-parallel communication more efficient at scale, MoonEP helps reduce communication overhead in large MoE training and inference systems.
Explore on GitHub:
github.com/MoonshotAI/MoonEP
Link
GitHub - MoonshotAI/MoonEP: MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic...
MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts - MoonshotAI/MoonEP
github.com