In this discussion, Paige Nong, an Assistant Professor at the University of Minnesota specializing in AI's influence on healthcare, reveals the current landscape of AI use in hospitals. She highlights the concerning lack of bias testing in predictive algorithms, particularly those affecting marginalized patients. The conversation emphasizes the urgent need for consistent governance to ensure equitable treatment. Nong also addresses challenges faced by safety net hospitals and calls for robust evaluations of AI tools to enhance patient experiences and support health equity.