Red Teaming LLMs // Ron Heichman // #252

8 snips

Aug 6, 2024

Ron Heichman, an AI researcher from SentinelOne, delves into the pressing challenges and practical strategies in integrating AI APIs for reliable applications. He discusses 'jailbreaking' large language models to enhance their performance and the importance of context in AI fraud detection. The conversation also highlights accessibility barriers for non-technical users, advocating for user-friendly AI tools. Heichman emphasizes the significance of red teaming to safeguard AI outputs, ensuring robustness against malicious activities while improving model performance.

Ask episode

Chapters

Transcript

Episode notes

Intro

00:00 • 4min

Overcoming Challenges in AI Fraud Detection

03:54 • 16min

Bridging the Accessibility Gap in AI Technology

20:10 • 2min

The Accessibility Challenge in AI Tools and Upcoming Data Conference

21:41 • 4min

Jailbreaking Large Language Models

25:39 • 19min

Enhancing Diversity in Language Model Outputs

44:32 • 8min

Red Teaming Language Models: Safeguarding AI Outputs

52:21 • 17min

Ron Heichmn is an AI researcher specializing in generative AI, AI alignment, and prompt engineering. At SentinelOne, Ron actively monitors emerging research to identify and address potential vulnerabilities in our AI systems, focusing on unsupervised and scalable evaluations to ensure robustness and reliability.

Harnessing AI APIs for Safer, Accurate, & Reliable Applications // MLOps Podcast #252 with Ron Heichman, Machine Learning Engineer at SentinelOne. // Abstract Integrating AI APIs effectively is pivotal for building applications that leverage LLMs, especially given the inherent issues with accuracy, reliability, and safety that LLMs often exhibit. I aim to share practical strategies and experiences for using AI APIs in production settings, detailing how to adapt these APIs to specific use cases, mitigate potential risks, and enhance performance. The focus will be testing, measuring, and improving quality for RAG or knowledge workers utilizing AI APIs. // Bio Ron Heichman is an AI researcher and engineer dedicated to advancing the field through his work on prompt injection at Preamble, where he helped uncover critical vulnerabilities in AI systems. Currently at SentinelOne, he specializes in generative AI, AI alignment, and the benchmarking and measurement of AI system performance, focusing on Retrieval-Augmented Generation (RAG) and AI guardrails. // MLOps Jobs board https://mlops.pallet.xyz/jobs // MLOps Swag/Merch https://mlops-community.myshopify.com/ // Related Links Website: https://www.sentinelone.com/

All the Hard Stuff with LLMs in Product Development // Phillip Carter // MLOps Podcast #170: https://www.youtube.com/watch?v=DZgXln3v85s&ab_channel=MLOps.community --------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Ron on LinkedIn: https://www.linkedin.com/in/heichmanron/