local-studio backend can be deployed on arbitrary hardware to turn individual devices into inference machines; the system already supports controller-to-controller communication. The author seeks collaborators to implement clustering and remote-clustering features they say they cannot build themselves and links a video demonstrating the setup.
local-studio backend can be run on any hardware to convert that device into an inference machine
Multi-device orchestration.
You can run the local-studio backend on any hardware to turn it into an inference machine.
Your controllers can talk to each other. I want to make clustering and remote clustering possible but I'm too dumb. If anyone with the skill wants to help.
Video