AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Overcome the Data Bottleneck
GPT-3 is training in a self-supervised way on basically Internet data. People often use bottlenecks as a way to argue against exponential growth. I don't know how you overcome the data bottleneck, but probably more efficient training algorithms. We also are just capturing a lot more data than we used to, especially in China and all around us.