The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

CTIBench: Evaluating LLMs in Cyber Threat Intelligence with Nidhi Rastogi - #729

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

00:00

Evaluating Knowledge Cutoffs and Emerging Threats in Cyber Threat Intelligence

This chapter explores the importance of knowledge cutoffs in model evaluation benchmarks for cyber threat intelligence. It emphasizes the need for updates to reflect current vulnerabilities and addresses the challenges introduced by new AI-related threat vectors while identifying gaps in the accuracy of existing mitigation techniques.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app