The Geek In Review

Sarah Glassmeyer and Niki Black on Legal Tech in 2024 – Highlights, Hiccups, and Hopes for 2025

Dec 23, 2024

Legal tech experts Sarah Glassmeyer, Director of Data Curation at Legal Technology Hub, and Niki Black, Principal Legal Insight Strategist at AffiniPay, dive into the evolving landscape of AI in the legal field. They discuss the impact of generative AI on legal research, evaluating its reliability amid concerns about bias and user trust. The conversation highlights challenges in adopting AI within law firms, the potential of recent acquisitions to drive innovation, and the urgent need for legal education to adapt to these technological changes.

53:21

Creator website

Episode guests

Nikki Black

Sarah Glassmeyer

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Generative AI's rapid evolution in legal tech highlights the need for unbiased evaluations due to discrepancies in marketing claims versus actual performance.

The significant trend of integrating user-friendly generative AI interfaces into legal software aims to simplify complex data retrieval processes for professionals.

Addressing the gap in legal education, experts stress the importance of training law students on AI tools to prepare them for future demands.

Deep dives

The Discrepancy in AI Tool Performance

A significant issue highlighted is the disparity between the marketing claims of AI legal research tools and their actual performance. A report from Stanford University revealed error rates between 15 to 30 percent in AI outputs, questioning the validity of claims about hallucination-free tools. This discrepancy exists partly because some tools misidentified their capabilities, often confusing them with those not intended for legal research. As a result, the discussion emphasizes the need for independent evaluations to ascertain the effectiveness of these AI tools.

Intro

4min

Evaluating Generative AI in Legal Practice

16min

Navigating Legal Tech Adoption

16min

Innovations in Legal Tech: Thomson Reuters and the Future of Language Models

2min

Exploring Legal Data Resources and Licensing Challenges

2min

Rethinking Legal Education in the Age of AI

13min

Connecting with Listeners and Sharing Personal Insights

2min

In this year-end episode of The Geek in Review, hosts Marlene Gebauer and Greg Lambert are joined by legal tech experts Niki Black, Principal Legal Insight Strategist at AffiniPay, and Sarah Glassmeyer, Director of Data Curation at Legal Technology Hub, to recap the top stories of 2024. From the evolution of generative AI in legal tech to groundbreaking acquisitions, the conversation delves into the successes and challenges that shaped the year in the legal industry.

The discussion kicks off with a look at AI's growing role in legal research and practice management. Greg recalls the controversial Stanford report that questioned the reliability of AI tools marketed as hallucination-free. The guests explore the importance of unbiased evaluations, the complexity of defining legal research, and the rapid pace of AI development that often outpaces regulatory and academic studies. Sarah highlights the need for peer-reviewed analysis to guide the effective use of these tools, while Niki emphasizes the user-friendly interfaces that generative AI brings to legal software.

Marlene shifts the conversation toward the challenges of integrating AI into law firms’ existing frameworks. The hosts and guests discuss the hesitancy of document management systems to adopt generative AI due to trust and security concerns. Niki and Sarah examine how firms are adapting to AI by organizing data more effectively and addressing client expectations. They also reflect on the potential of AI to bridge access-to-justice gaps, with tools that empower self-represented litigants and underserved communities.

The episode takes a closer look at notable mergers and acquisitions in 2024, such as Bloomberg’s acquisition of Dashboard Legal and Thomson Reuters’ purchase of SafeSign Technologies. Sarah raises concerns about the consolidation of the legal tech market, warning of diminished innovation and competition. Niki observes how cloud-based technologies have facilitated these integrations, making it easier for companies to offer comprehensive solutions that touch multiple aspects of legal practice.

Wrapping up, the group forecasts trends for 2025, including regulatory developments around AI and shifting priorities within law firms regarding tech adoption. While some predictions are cautious, like Sarah’s concern over the impact of external political factors on the tech workforce, others remain optimistic about the growing sophistication of legal tech. The episode concludes with reflections on how the industry can better prepare junior lawyers and law students to navigate an increasingly AI-driven landscape.

Join Marlene, Greg, Niki, and Sarah for this insightful look back at 2024 and an exciting glimpse into the year ahead. As always, we thank our listeners for tuning in, and we encourage you to share this episode with colleagues and connect with us on LinkedIn or Blue Sky!

Listen on mobile platforms: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Apple Podcasts⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Spotify⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠YouTube⁠⁠⁠⁠⁠⁠⁠⁠⁠

Twitter: ⁠⁠⁠⁠⁠@gebauerm⁠⁠⁠⁠⁠, or ⁠⁠⁠⁠⁠@glambert
⁠⁠⁠⁠⁠Email: geekinreviewpodcast@gmail.com
Music: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠⁠⁠⁠⁠⁠

TRANSCRIPT