Gradient Dissent: Conversations on AI cover image

Scaling LLMs and Accelerating Adoption with Aidan Gomez at Cohere

Gradient Dissent: Conversations on AI

00:00

The Importance of Saturating Compute

Transformers has just done phenomenally well is scale as compute gets bigger. What does it take though for an architecture to saturate compute? It requires tons and tons of matmalls and very few unnecessary ops.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app