

02/28/25: California bar exam faces technical difficulties, experiments with Deep Research, and more
Mar 6, 2025
Steve Embry, a tech-savvy legal blogger, joins Nikki Black, a strategic mind at Affinapay, and Stephanie Wilkins, director at Legal Tech Hub. They dive into the chaos surrounding the California bar exam's online format, revealing the technical hiccups that could lead to legal battles. The trio also discusses the VALS AI benchmarks, questioning the transparency of AI tools in legal practices. Plus, they examine the intriguing evolution of e-discovery technologies and the looming competition from accounting firms stepping into the legal realm.
AI Snips
Chapters
Transcript
Episode notes
AI Benchmarking Study Results
- VALS AI's benchmarking study revealed AI's legal capabilities.
- AI matched or exceeded lawyer performance on many tasks, much faster.
Concerns about Study Methodology
- Jackie Schaefer questioned Clearbrief's exclusion and VALS AI's relationships with evaluated companies.
- Bob Ambrosio clarified Legal Tech Hub's non-financial involvement.
Harvey's Performance
- Harvey's high score is attributed to its participation in most tasks.
- Co-counsel performed well but participated less, affecting overall score.