2min chapter

Exhaustion of High-Quality Data Could Slow Down AI Progress in Coming Decades

The Data Exchange with Ben Lorica

CHAPTER

The Trends in Model Size

So model size trends. I mean, I guess we just keep getting bigger. Is that what you're is that the prediction generally of epoch? I guess, depends on the data type, right? And basically algorithmic improvement has been halving the compute requirements to reach a certain accuracy for, for example, for vision. So even if Moore's law stops completely just by getting more efficient algorithms, we might probably still scale. But that's only for vision. What about language? For language, it's a bit more blurry. We're also about to release a paper on that. It seems that returns to increasing size are currently lower than returns to increasing data. That means every time you

00:00

Transcript

Episode notes

Speaker 5

Hello and welcome to this podcast from the BBC World Service. Please let us know what you think and tell other people about us on social media. Podcasts from the BBC World Service are supported by advertising. So, if you haven't already, catch up with the first season now while you're waiting for season 2. Search for Dear Daughter wherever you get your BBC podcast.

Speaker 3

Hello and welcome to the conversation, the programme that amplifies women's voices. I'm Kim Chaka-Netza. Hardly a day goes by without news of a company laying off workers and cutting jobs. Redundancy or the prospect of it is the reality for many workers across the world. With the uncertainty and stress of losing your job, can come an opportunity to redefine your career path, a chance to reinvent yourself. Today I'm joined by two women who did just that, after they were made redundant. Dawn Kelly was 53 when she suddenly lost her job after 35 plus years in the communications industry. With the help of her two children, she started her own company in 2017. Dawn is now the CEO and founder of the Narrow Spot, a juice and salad bar in New York.

Speaker 2

Dawn, welcome. Thank you. Thank you for having me here today.