Law://WhatsNext GPT5 - Pt 2 with Sigge Labor (CTO) and Jacob Johnsson (Legal Eng) of Legora
5 snips
Aug 14, 2025 Sigge Labor, CTO at Legora, and Jacob Johnsson, Legal Engineer, dive into the revolutionary capabilities of GPT-5. They discuss how this new model enhances legal reasoning and how their battle evaluations show GPT-5 outperforms other models over 80% of the time. The conversation also explores GPT-5's steerability, enabling more interactive workflows that empower lawyers in their tasks. With real-time insights from one of the fastest-growing AI companies, this chat shines a light on the future of legal tech and its transformative potential.
AI Snips
Chapters
Transcript
Episode notes
Battle Evals Show GPT‑5 Leap
- Legora runs 'battle evals' comparing models by having one LLM judge outputs from two models to see which is preferred.
- GPT-5 was preferred about 80–85% of the time in these comparative evaluations, indicating a substantial improvement.
GPT‑5 Thinks Like A Lawyer
- Sigge found GPT-5's outputs resemble how a lawyer thinks, capturing legal linguistic nuance and reasoning depth.
- Jacob agreed GPT-5 delivers exhaustive, precise legal analyses with concise conclusions and deeper supporting detail.
Benchmark Models With Curated Tests
- Evaluate new models with curated, context-specific tests to judge real product impact rather than hype.
- Use precision metrics like correct citations and task-specific benchmarks to choose preferred models for features.