Ashley Llorens hosts Chris Bishop to discuss the state of deep learning, their new textbook on the subject, and the potential for 'super copilots' in scientific breakthroughs. They explore advancements in deep learning, including pre-training and zero-shot learning, and highlight the applications of AI in healthcare and materials, such as molecule design and sustainable energy solutions.

A panel of luminaries join us live on stage at MIT Technology Review’s flagship conference, EmTech MIT, and discuss the path forward for AI research.We Meet:Will Douglas Heaven, Senior Editor of AI at MIT Technology ReviewAshley Llorens, Vice President & Managing Director at Microsoft ResearchRaia Hadsell, Senior Director of Research and Robotics at DeepMindYann LeCun, NYU Professor, VP & Chief AI Scientist at MetaCredits:This episode was recorded in front of a live audience at the MIT Media Lab in Cambridge, Massachusetts with special thanks to Will Douglas Heaven, Amy Lammers and Brian Bryson. It was produced by Jennifer Strong, Emma Cillekens and Anthony Green, directed by Erin Underwood, edited by Mat Honan and mixed by Garret Lang. 

AI scientists Ahmed Awadallah and Ashley Llorens discuss the future of scale in AI, including advancements in large-scale models like GPT-4 and their impact on reasoning and problem-solving. They explore the dynamics between model size and data, the use of large-scale models to improve smaller ones, and the need for better evaluation strategies. They also delve into topics such as spending compute budget on bigger models, the capabilities and limitations of AI models, the concept of post-training in language model training, and advancements in AI and adaptive alignment.