The Scrimba Podcast cover image

The Making of an Industry: The Rise of AI Engineering, with Swyx

The Scrimba Podcast

00:00

The Scale and Memory Requirements of AI Models

This chapter explores the scale of AI models, discussing the number of parameters and the memory requirements. It explains the challenges of stripping out irrelevant numbers from the massive configuration file and highlights the need for distributed systems beyond a certain scale.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app