Yoshua Bengio, a leading AI researcher and Founder of Mila, joins California Senator Scott Wiener, an advocate for AI regulation. They dive into the urgent need for legislation to address AI risks, particularly in light of SB 1047. The conversation unpacks psychological biases that cloud public perception of AI threats and debates state versus federal regulation dynamics. They also explore accountability in AI development amid investor skepticism and the implications of AI advancements like ChatGPT 4.0, while emphasizing the necessity for international cooperation and proactive safety measures.
The introduction of California Senate Bill 1047 emphasizes the necessity for AI companies to perform safety evaluations to mitigate potential risks associated with advanced models.
The podcast highlights the divided opinions among AI experts regarding regulation, stressing the urgency for dialogue to address safety concerns and technological innovation balance.
Deep dives
Regulating AI Safety
The discussion emphasizes the importance of regulating artificial intelligence to mitigate risks associated with its rapid advancement. California Senate Bill 1047 has been introduced to ensure that companies creating powerful AI models conduct thorough safety evaluations prior to releasing their technologies. This bill focuses on models that exceed specified thresholds in operational capacity and financial investment, effectively holding companies accountable for the potential harms that could arise if they neglect safety measures. By proactively addressing these risks, the legislation aims to prevent catastrophic outcomes and enhance public safety while still allowing for technological innovation.
AI Risks and Perspectives
The conversation highlights a spectrum of opinions among AI experts regarding the risks associated with artificial intelligence, ranging from extreme concern to outright denial. Leading voices in the AI community express the need to prepare for potential dangers, especially with the advent of powerful models like ChatGPT, which have accelerated the pace of development. Many experts advocate for a precautionary approach, underscoring that the risks could be imminent and that society needs to be prepared for various scenarios surrounding AI's future. This reflection on differing viewpoints reveals the necessity for ongoing dialogue and regulation in the face of uncertainty.
Liability and Accountability in AI Development
The impact of liability on AI companies is a central theme, with the proposed legislation focusing on establishing liability safeguards for businesses that adhere to safety requirements. By conducting reasonable safety tests prior to the release of powerful AI models, companies may avoid legal repercussions in the event of harm caused by their technologies. This framework not only addresses potential mishaps but also promotes transparency and accountability in an industry often accused of reckless innovation. The dialogue emphasizes that firms failing to conduct safety evaluations could be held liable, addressing concerns about the accountability of AI developers in an unprecedented technological landscape.
The Role of Stakeholders in AI Regulation
The discourse reveals a fragmented response from various stakeholders in the tech industry regarding Senate Bill 1047, with some companies showing tentative support while others express opposition. Key players in AI development, such as Google and Meta, have voiced their concerns about the bill, suggesting fears of regulatory overreach that could stifle innovation. In contrast, companies like Anthropic have indicated a willingness to support the legislation contingent on specific amendments, showcasing a willingness among some stakeholders to engage in constructive dialogue. The reactions from these companies underscore the need for a balanced approach that fosters innovation while ensuring public safety in AI development.
Sam Harris speaks with Yoshua Bengio and Scott Wiener about AI risk and the new bill introduced in California intended to mitigate it. They discuss the controversy over regulating AI and the assumptions that lead people to discount the danger of an AI arms race.
Yoshua Bengio is full professor at Université de Montréal and the Founder and Scientific Director of Mila - Quebec AI Institute. Considered one of the world’s leaders in artificial intelligence and deep learning, he is the recipient of the 2018 A.M. Turing Award with Geoffrey Hinton and Yann LeCun, known as the Nobel Prize of computing.
He is a Canada CIFAR AI Chair, a member of the UN’s Scientific Advisory Board for Independent Advice on Breakthroughs in Science and Technology, and Chair of the International Scientific Report on the Safety of Advanced AI.
Scott Wiener has represented San Francisco in the California Senate since 2016. He recently introduced SB 1047, a bill aiming to reduce the risks of frontier models of AI. He has also authored landmark laws to, among other things, streamline the permitting of new homes, require insurance plans to cover mental health care, guarantee net neutrality, eliminate mandatory minimums in sentencing, require billion-dollar corporations to disclose their climate emissions, and declare California a sanctuary state for LGBTQ youth. He has lived in San Francisco's historically LGBTQ Castro neighborhood since 1997.
Learning how to train your mind is the single greatest investment you can make in life. That’s why Sam Harris created the Waking Up app. From rational mindfulness practice to lessons on some of life’s most important topics, join Sam as he demystifies the practice of meditation and explores the theory behind it.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode