The Geek In Review

Can AI Bring Both Speed and Accuracy: Josh Broyde of AI21 Labs

Jul 17, 2024

Joshua Broyde from AI21 Labs discusses their work on foundation models like Jamba Instruct for enterprise use. They compare these models to traditional ones and talk about their collaboration with financial institutions. The podcast also covers the development of Jamba Instruct, the balance between model quality and cost, and future trends in AI workflows.

37:06

Creator website

Episode guests

Joshua Broyde

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Foundation models offer versatility and efficiency for diverse tasks.

AI21 Labs prioritizes data security and compliance for AI model deployment.

Deep dives

Introduction to AI 21 Labs and Foundation Models in the Legal Industry

AI 21 Labs specializes in building foundation models and AI systems for enterprise-scale applications. Customers seek them out for building advanced models like Jamba Instruct for tasks such as answering questions and summarizing text. There is a growing interest in task-specific models that can efficiently handle specific functions, reflecting the industry's need for high-performance and cost-effective solutions.

Intro

2min

Exploring Foundation Models for Versatile Tasks in Text Analysis and Finance

5min

Challenges and Opportunities in Training Large Language Models

10min

Exploring the Development of Jamba Instruct Model by AI21 Labs

2min

Industry Reaction and Future Trends in AI Models

16min

Discussion with Principal Solutions Architect at AI21 Labs about connecting with the company

2min

This week, we are joined by Joshua Broyde, PhD and Principal Solutions Architect at AI21 Labs. Broyde discusses AI21 Labs' work in developing foundation models and AI systems for enterprise use, with a focus on their latest model, Jamba-Instruct.

Josh explains the concept of foundation models and how they differ from traditional AI models. He highlights AI21 Labs' work with financial institutions on use cases like term sheet generation and financial document Q&A. The conversation explores the challenges and benefits of training models on company-specific data versus using retrieval augmented generation (RAG) techniques.

The interview delves into the development of Jamba Instruct, a hybrid model combining Mamba and Transformer architectures to achieve both speed and accuracy. Broyde discusses the model's performance, industry reaction, and potential applications.

Safety and security considerations for AI models are addressed, with Broyde explaining AI21 Labs' approach to implementing guardrails and secure deployment options for regulated industries. The discussion also covers the balance between model quality and cost, and the trend towards matching specific models to appropriate tasks.

Josh also shares his thoughts on future developments in the field, including the potential for agent-based approaches and increased focus on cost optimization in AI workflows.

Listen on mobile platforms: ⁠⁠⁠⁠⁠⁠⁠⁠⁠Apple Podcasts⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠Spotify⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠YouTube⁠⁠⁠⁠⁠⁠⁠

Contact Us:

Twitter: ⁠⁠⁠⁠⁠@gebauerm⁠⁠⁠⁠⁠, or ⁠⁠⁠⁠⁠@glambert⁠⁠⁠⁠⁠

Email: geekinreviewpodcast@gmail.com

Music: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠⁠⁠⁠⁠⁠

Transcript on 3 Geeks