Revisiting Big Data, Training Costs, and Competitive Moats in Data Models

There's a lot of debate on big and small data. For systems and compute, some say "Big Data is Dead", while others challenge this notion. In AI and ML, big tech companies can pour tons of money and data into building massive LLMs, while open source provides compelling "small data" alternatives to the LLM walled gardens.
So which is it? Will Big Data reign supreme or will small data become more popular? Matt and I riff on these topics and more.
#data #dataengineering #chatgpt #ai #bigdata