3min chapter

The Data Scientist Show cover image

The power of error analysis, tree models for search relevancy, what ChatGPT means for data scientists - Sergey Feldman - The Data Scientist Show #059

The Data Scientist Show

CHAPTER

How Do You Know if You're Not Overfitting the Model?

There will never be a certain way to make all subset of data perfectly predicted. How do you decide, how do you prioritize? I have two main techniques that I use to make sure I didn't overfit this training set for too long. Having more training data that you can pull out towards the end of the process is really useful. It's very useful because later when you're going to do retraining for a production model, which you often have to do,. it might break because it was over fit to the training data.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode