Episode 16: Med-PaLM or Facepalm? A Second Opinion On LLMs In Healthcare (feat. Roxana Daneshjou), August 28, 2023
Sep 28, 2023
auto_awesome
Guest Roxana Daneshjou, incoming assistant professor of dermatology and biomedical data science at Stanford, joins the hosts to discuss the use of large language models in healthcare. They evaluate the performance of these models, explore the challenges of evaluating them in clinical settings, and highlight the importance of multimodal processing in medicine. They also touch on the controversial use of AI in school libraries and transportation, and discuss the issue of fake books on Amazon.
Microsoft and Epic Systems are collaborating to integrate generative AI tools into Epic's electronic health record system, potentially transforming healthcare workflows.
The use of AI tools, such as OpenAI's ChatGPT, to determine the content of school libraries in Iowa resulted in flawed transportation routes for students and delays in getting home.
Amazon has introduced AI-generated review summaries on its platform, offering the potential for streamlined customer review experiences but also the risk of fake summaries based on fake reviews.
Deep dives
Microsoft and Epic Systems collaborate to integrate generative AI tools into electronic health record system
Microsoft is teaming up with Epic Systems to integrate generative AI tools into Epic's electronic health record system. This partnership aims to incorporate AI-generated review summaries, note summarization, text suggestion, transcription of doctor-patient conversations, AI-powered coding and billing procedures, and generative AI exploration for filling gaps in clinical evidence. The collaboration between Microsoft and Epic Systems is significant given Epic's extensive market reach in the US, potentially impacting the workflow of healthcare providers.
School district uses ChatGPT for book removal
An Iowa school district employed OpenAI's ChatGPT to determine whether certain books contained descriptions or depictions of sex acts, in compliance with a new state law. The decision to use this AI tool for book removal was a response to controversial statewide laws surrounding specific content in schools. However, the implementation resulted in transportation issues, with students experiencing significant delays getting home due to flawed routes generated by the AI system.
Political article highlights integration of AI in healthcare
Microsoft and Epic Systems are working together to integrate generative AI tools into Epic's electronic health record system. This integration aims to enhance workflows by providing AI assistance to doctors through note summarization, transcription services, and AI-powered coding and billing procedures. It is noteworthy that Epic's extensive presence in the US makes this collaboration impactful, potentially resulting in the expanded use of AI tools in healthcare settings.
Amazon employs AI-generated review summaries
Amazon has introduced AI-generated review summaries on its platform. This feature utilizes generative AI tools to automatically produce concise summaries of customer reviews. While this technology has the potential to streamline and enhance the review experience for customers, there is also the risk of generating fake summaries based on fake reviews.
Generative AI's use in policy advising scrutinized
Researchers have conducted an experiment to assess the capabilities of generative AI in complex writing tasks. The study examined the use of generative AI in creating a policy brief for the Bank of Italy. The results indicated that AI can potentially expedite workflows, but critics argue that complex policy advice should be exercised with caution and rely on robust evaluation frameworks.
Alex and Emily are taking another stab at Google and other companies' aspirations to be part of the healthcare system - this time with the expertise of Stanford incoming assistant professor of dermatology and biomedical data science Roxana Daneshjou. A look at the gap between medical licensing examination questions and real life, and the inherently two-tiered system that might emerge if LLMs are brought into the diagnostic process.
Mason City Globe Gazette: “Each of these texts was reviewed using AI software to determine if it contains a depiction of a sex act. Based on this review, there are 19 texts that will be removed from our 7-12 school library collections and stored in the Administrative Center while we await further guidance or clarity.”