AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Far Does Saint Get Us to Solve the Problem?
On small data sets, anywhere from 0 to 50,000 training samples, it's hard to beat a well-trained XGBoose model tuned hyperparameters. You start to see some of these deep learning methods exceed that when you get above 50,000. So maybe we'll get there with tabular data. Maybe there will be this notion of large pre-trained tabular data models that can then be used on small data sets and effectively transfer their encoding.