Gradient Dissent: Conversations on AI cover image

Emad Mostaque — Stable Diffusion, Stability AI, and What’s Next

Gradient Dissent: Conversations on AI

00:00

Is Scalability a Bottleneck for Open Source Research?

It was difficult to build a cluster even in the thousands of a one which just as it wasn't availability. But now you look at next year, I know of 320,000 H100 clusters that are being built. So compute is no longer really a bottleneck. It's about optimal models. And we don't know what optimal foundation model is across the data training and other architectural parameters yet because we've been so constrained by compute and data and tablet.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app