NEJM AI Grand Rounds

AI Frontiers with James Zou: The Future of Multi-Modal AI in Medicine

Feb 21, 2024

Expert in AI research, James Zou, discusses the future of multi-modal AI in medicine. Topics include using social media for medical data, ethical implications of AI, and challenges of model drift. Explore the convergence of genomics, machine learning, and medicine, as well as the unique use of Twitter for medical image discussions. Learn about training AI algorithms in medicine and the behavior changes of Chat GPT-4 over time. Dive into personal interests and AI art perception in the field of medicine.

52:00

Creator website

Episode guests

James Zou

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Social media like Twitter can be a valuable resource for gathering medical data and fostering informative communities in healthcare.

Continuous monitoring and evaluation of AI language models like GPT-4 is crucial due to behavior changes over time that can impact safety and reasoning abilities.

Reinforcement Learning from Human Feedback (RLHF) is essential for aligning AI models with human preferences, but it can lead to behavior drift and unintended consequences.

Deep dives

Twitter as Diverse Community Platform for Medical Professionals

Twitter is not just a noisy space, but a collection of diverse communities, including medical professionals who use it to build informative communities and engage in educational dialogues. The platform curates a dataset of high-quality Twitter discussions, which includes pathology images and corresponding conversations among professionals.

Introduction

3min

Exploring Convergence of Genomics, Machine Learning, and Medicine

8min

Exploring the Use of Twitter for Medical Image Discussion

5min

Utilizing Twitter for Training AI Algorithms in Medicine

7min

Behavior Changes of Chat GPT-4

20min

Exploring Personal Interests and AI Art Perception

10min

In this episode of the AI Grand Rounds podcast, Dr. James Zou shares his personal journey to discovering machine learning during his graduate studies at Harvard. Fascinated by the potential of AI and its application to genomics and medicine, Dr. Zou embarked on a journey that took him from journalism to the forefront of AI research. He has been instrumental at Stanford in translating machine learning advancements into clinical settings, particularly through genomics. The discussion also delves into the unique use of social media for gathering medical data, showcasing an innovative approach to AI model training with real-world medical discussions. Dr. Zou touches on the ethical implications of AI, the importance of responsible AI development, and the potential of language models like GPT-4 in medicine, despite the challenges of model drift and alignment with human preferences.

Transcript.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.

NEJM AI Grand Rounds

AI Frontiers with James Zou: The Future of Multi-Modal AI in Medicine

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Twitter as Diverse Community Platform for Medical Professionals

James Zoh's Contributions to AI and Biomedicine

Behavior Changes in AI Language Models

The Role of Human Feedback in AI Model Training

Implications and Challenges of AI in Healthcare

Remember Everything You Learn from Podcasts