ChinaTalk How Can the Pentagon Trust AI?
Aug 1, 2023
Jane Pinelis, Chief AI Engineer at The Johns Hopkins University Applied Physics Laboratory, and Karson Elmgren, a researcher at CSET, dive into the complexities of AI integration in the military. They discuss the urgent need for AI assurance in defense, contrasting agile methodologies used in recent conflicts with bureaucratic challenges. The conversation also explores transparency and trust in AI systems, emphasizing the importance of human-AI collaboration and risk assessment as critical factors in military operations and decision-making.
AI Snips
Chapters
Transcript
Episode notes
Ukraine's Agile AI Development
- In Ukraine, hackers working alongside warfighters quickly developed helpful algorithms.
- Deploying similar tech in the DoD takes over a year due to bureaucracy and testing.
What is AI Assurance?
- AI assurance involves building evidence and arguments for system trustworthiness.
- It includes testing, stakeholder consideration (warfighter, acquisition official, taxpayer), and ethical considerations.
AI Assurance vs. Traditional T&E
- DoD traditionally uses linear test and evaluation, primarily for hardware.
- AI assurance acknowledges multiple stakeholders and emphasizes agile, iterative testing, involving testers earlier.