Alan Chan, a research fellow at the Center for the Governance of AI and a PhD student at Mila, delves into the fascinating world of agent infrastructure. He highlights parallels with road safety, discussing how similar interventions can prevent negative outcomes from AI agents. The conversation covers the evolution of intelligent agents, the necessity of understanding threat models, and a trichotomy of approaches to manage AI risks. Chan also emphasizes the importance of distinct communication channels for AI to enhance decision-making and promote safe interactions.

In this talk, Alan Chan, a PhD student at Mila with a focus on AI alignment and governance, shares insights from his research on aligning AI with human values. He discusses the skepticism around AI alignment and the complexities of defining intelligence in AI systems. The conversation touches on the moral implications of AI decision-making, the risks of oversimplifying reward mechanisms in reinforcement learning, and the urgent need for collaborative safety measures in AI development. Chan's enthusiasm for the ethical aspects of AI governance is truly infectious.