
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Responsible AI in the Generative Era with Michael Kearns - #662
Dec 22, 2023
Michael Kearns, a professor at the University of Pennsylvania and Amazon scholar, dives into the new challenges of responsible AI in the generative era. He discusses the evolution of service card metrics and their limitations in evaluating AI performance. Kearns also tackles the complexities of evaluating large language models and introduces the concept of clean rooms in machine learning, emphasizing privacy through differential techniques. With insights from his work at AWS, he advocates for collaboration between AI developers and stakeholders to enhance ethical practices.
36:04
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Generative AI models present challenges for responsible AI, such as hallucinations, toxicity, and intellectual property issues.
- Adapting service cards to generative AI models requires new considerations like hallucination and toxicity.
Deep dives
AWS ML&AI Services
AWS offers a range of ML&AI services at different layers of the machine learning technology stack, including cost-efficient generative AI with Amazon EC2-inf2 instances, easier app development with Amazon Bedrock, and Amazon Code Whisperer with support for multiple programming languages.
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.