In this discussion, Tan Zhi Xuan, an MIT PhD student specializing in AI alignment, critiques traditional preference-based methods. They propose role-based AI systems shaped by social consensus, emphasizing the necessity of aligning AI with societal norms instead of mere preferences. The conversation touches on how AI can learn ethical standards through Bayesian reasoning and the exploration of self-other overlap to enhance cooperation. Xuan's innovative insights pave the way for a safer, more socially aware approach to AI development.