AI Testing and Evaluation: Reflections

Amanda Craig Deckard, Senior Director of Public Policy in Microsoft's Office of Responsible AI, shares insights on AI testing and evaluation. She discusses the need for effective governance, highlighting lessons learned about pre-deployment and post-deployment testing. The conversation emphasizes the importance of rigor, standardization, and interpretability in AI evaluation. Deckard also explores the sociotechnical impacts of AI and the necessity of collaborative efforts across sectors to ensure responsible AI development, drawing parallels from fields like cybersecurity.