Vanishing Gradients cover image

Vanishing Gradients

Episode 22: LLMs, OpenAI, and the Existential Crisis for Machine Learning Engineering

Nov 27, 2023
01:20:07

Jeremy Howard (Fast.ai), Shreya Shankar (UC Berkeley), and Hamel Husain (Parlance Labs) join Hugo Bowne-Anderson to talk about how LLMs and OpenAI are changing the worlds of data science, machine learning, and machine learning engineering.

Jeremy Howard is co-founder of fast.ai, an ex-Chief Scientist at Kaggle, and creator of the ULMFiT approach on which all modern language models are based. Shreya Shankar is at UC Berkeley, ex Google brain, Facebook, and Viaduct. Hamel Husain has his own generative AI and LLM consultancy Parlance Labs and was previously at Outerbounds, Github, and Airbnb.

They talk about

  • How LLMs shift the nature of the work we do in DS and ML,
  • How they change the tools we use,
  • The ways in which they could displace the role of traditional ML (e.g. will we stop using xgboost any time soon?),
  • How to navigate all the new tools and techniques,
  • The trade-offs between open and closed models,
  • Reactions to the recent Open Developer Day and the increasing existential crisis for ML.

LINKS

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode