Generally Intelligent cover image

Episode 36: Ari Morcos, DatologyAI: On leveraging data to democratize model training

Generally Intelligent

00:00

Navigating Data Complexities in Machine Learning

This chapter explores the evolution of link and language modeling with an emphasis on token masking techniques and their impact on model training. It highlights the importance of data selection, addressing challenges related to biases in datasets and the need for a balanced approach to redundancy and variance for optimal performance. The discussion also critiques traditional methodologies and emphasizes the benefits of specialized models over generic ones, particularly in leveraging private data as a competitive advantage.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app