Learning from Machine Learning cover image

Maxime Labonne: Designing beyond Transformers | Learning from Machine Learning #12

Learning from Machine Learning

00:00

Exploring Mixture of Experts and Advanced Model Architectures

This chapter explores the innovative mixture of experts approach in machine learning, focusing on its efficient inference capabilities. It highlights recent advancements, such as the 4TB model and Hyena Edge, which merges convolutional techniques with Transformers to enhance performance while minimizing memory usage.

Play episode from 40:55
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app