The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

The Enterprise LLM Landscape with Atul Deo - #640

Jul 31, 2023

Atul Deo, General Manager of Amazon Bedrock, brings a wealth of experience in software development and product engineering. He dives into the intricacies of training large language models in enterprises, discussing the challenges and advantages of pre-trained models. The conversation highlights retrieval augmented generation (RAG) for improved query responses, as well as the complexities of implementing LLMs at scale. Atul also unveils insights into Bedrock, a managed service designed to streamline generative AI app development for businesses.

37:08

Creator website

Episode guests

Atul Deo

Highlights

AI Chapters

Episode notes

The Challenges of Retrieving Documents at Scale

01:34

Challenges in using pre-trained models

01:01

Intro

2min

Navigating the Future of AI in Enterprises

12min

Harnessing Retrieval Augmented Generation for Enhanced Semantic Search

4min

Navigating LLM Implementation Challenges

11min

Unlocking Generative AI with Bedrock

8min

Exploring Resources and Innovations in Generative AI

2min

Today we’re joined by Atul Deo, General Manager of Amazon Bedrock. In our conversation with Atul, we discuss the process of training large language models in the enterprise, including the pain points of creating and training machine learning models, and the power of pre-trained models. We explore different approaches to how companies can leverage large language models, dealing with the hallucination, and the transformative process of retrieval augmented generation (RAG). Finally, Atul gives us an inside look at Bedrock, a fully managed service that simplifies the deployment of generative AI-based apps at scale.

The complete show notes for this episode can be found at twimlai.com/go/640.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.