The Challenge of Communication Bottlenecks in Scalability

We expect most models to work out of the box. As an example we took the recently released stable diffusion model and got it running on dojo in minutes. The communication phase of a background begins with nodes computing their local mean and standard deviations. Then coordinating to reduce these values then broadcasting them back. Here's some pictures of a Cybertruck on Mars generated by stable diffusion running ondojo. Looks like it still has some data.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.