

AI Testing and Evaluation: Learnings from cybersecurity
Jul 14, 2025
Ciaran Martin, a professor at Oxford and former head of the UK's National Cybersecurity Center, and Tori Westerhoff, Principal Director at Microsoft’s AI Red Team, dive deep into the intersection of AI and cybersecurity. They discuss the importance of differentiated cybersecurity standards and the role of public-private partnerships in enhancing security. Martin shares insights from historical events, while Westerhoff highlights how red teaming can pinpoint AI vulnerabilities during development, ensuring safer technological advancements.
AI Snips
Chapters
Transcript
Episode notes
Origin of UK Cybersecurity Centre
- The National Cyber Security Centre was created as a response to the Snowden disclosures impacting UK intelligence.
- Kieran Martin was tasked to build the center and lead it for seven years, shaping UK cybersecurity policy and practice.
Cybersecurity Risk and Testing Challenges
- Risk assessment in cybersecurity prioritizes threats: disruption, data breaches, and theft.
- Testing is vital but challenging due to scarce metrics on effectiveness, especially with fast-changing tech.
Tailor Cybersecurity by Business Scale
- Differentiate cyber defense standards for small businesses versus critical infrastructure.
- Unrealistic to expect small businesses to meet nation-state level cybersecurity; tailor requirements accordingly.