Super Data Science: ML & AI Podcast with Jon Krohn 901: Automating Legal Work with Data-Centric ML (feat. Lilith Bat-Leah)
61 snips
Jul 1, 2025 
Lilith Bat-Leah, Senior Director of AI Labs at Epiq, discusses the game-changing impact of AI in the legal industry. She explains how large language models and retrieval-augmented generation revolutionize e-discovery processes. Lilith dives into the nuances of data-centric machine learning, emphasizing the importance of data quality. She shares insights on balancing automation with legal standards and the collaborative efforts in improving data representation for low-resource languages, providing a fascinating glimpse into the intersection of law and cutting-edge technology.
AI Snips
Chapters
Transcript
Episode notes
Leverage Expertise With AI Tools
- Law firms should partner with legal tech experts to manage AI tools effectively.
- Domain expertise and understanding evaluation metrics remain crucial for defensible AI workflows.
Defensibility in Legal AI
- Legal cases require balancing speed and automation with high standards of defensibility and due diligence.
- Evaluation metrics like recall and precision are legally negotiated and must be defensible in court.
Illusion Rate in Legal Tech
- Illusion rate in legal tech measures the false negatives among predicted non-relevant documents.
- It helps estimate recall intervals and is a unique metric only found in e-discovery.