Ilia Shumailov

Ilia Shumailov, a computer scientist specializing in large language models, joins to explore intriguing AI concerns. He discusses the rise of machine-generated internet content and its potential dangers for language models. Ilia reveals how training on synthetic data can lead to errors, systematically amplifying mistakes. They liken this phenomenon to a game of telephone, where accuracy deteriorates over iterations. However, he reassures that with better practices, the issue of model collapse can be addressed, keeping AI evolution on a positive track.