2min chapter

Gradient Dissent: Conversations on AI cover image

Emad Mostaque — Stable Diffusion, Stability AI, and What’s Next

Gradient Dissent: Conversations on AI

CHAPTER

Is Scalability a Bottleneck for Open Source Research?

It was difficult to build a cluster even in the thousands of a one which just as it wasn't availability. But now you look at next year, I know of 320,000 H100 clusters that are being built. So compute is no longer really a bottleneck. It's about optimal models. And we don't know what optimal foundation model is across the data training and other architectural parameters yet because we've been so constrained by compute and data and tablet.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode