Software Engineering Daily cover image

Modal and Scaling AI Inference with Erik Bernhardsson

Software Engineering Daily

00:00

Accelerating Machine Learning Development

This chapter discusses the challenges of slow feedback loops in machine learning engineering compared to traditional application development. It introduces Modal, a platform designed to simplify and accelerate the deployment of machine learning workloads with a user-friendly Python SDK and a shared GPU cluster model. The chapter also explores the technical aspects of running functions in the cloud, including container management and efficient communication between services.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app