AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min chapter
Max Woolf: Data Science at BuzzFeed and AI Content Generation
The Gradient: Perspectives on AI
How to Scale Up a Language Model
With today's models, I guess this really depends on where you are and if you actually have any real use for them. But a lot of the advances we've seen are just from that scaling hypothesis, take the big language model and make it even bigger. The work on making transformers smaller is more interesting. And then when you're speaking about two, I think these packaging questions, I feel like even a lot of people in ML who may be familiar with data and model parallel haven't thought about those quite as much.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode