Sebastian Borgeaud

In his first podcast interview, Sebastian Borgeaud, a pre-training lead at Google DeepMind, shares insights from the groundbreaking Gemini 3 project. He discusses the shift from an 'infinite data' approach to a data-limited era, emphasizing the importance of curation and evaluation. Sebastian highlights how scaling laws are evolving and why continual learning is crucial for future AI advancements. He also touches on the challenges of benchmarks, the complexities of multimodal data, and advocates for a full-stack understanding in AI research.