Practical AI: Machine Learning, Data Science, LLM

RAG continues to rise

Apr 10, 2024

48:21

Snipd AI

Daniel & Chris chat with Demetrios Brinkmann, 'the funniest guy in AI', about the MLOps Community survey results and the AI Quality Conference. They discuss RAG models, the fusion of traditional ML with generative AI, the 'Hacker Mindset' book, trade-offs between RAG and fine-tuning, the release of the Common Corpus dataset, limitations of transformers in AI, and future visions in the field.

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Shift towards using generative models for AI tasks as assistants rather than predictors.

Companies are allocating new budgets for generative AI exploration and focusing on high leverage AI use cases.

Deep dives

Rags vs. Fine Tuning in AI Models

Generative models like rags are gaining popularity over fine-tuning for various AI tasks. The discussion highlighted the shift towards using generative models as assistants and automators rather than predictors or for analytical tasks. The emergence of 'rag as a service' was noted, indicating a trend in utilizing generative models effectively.

The Debate on RAG vs Fine Tuning in Highly Specialized Fields

03:44

Distinction between Traditional ML Workloads and Generative AI Workloads

00:50

Transformers: A Band aid or Root Fix?

01:42

Challenges in Evaluating Machine Learning Models

02:18

Introduction

3min

Exploring the Intersection of Traditional ML and Generative AI Workloads

5min

Exploring the Growing Interest in a Specific Use Case and Promoting 'The Hacker Mindset' Book

2min

Exploring the Trade-offs between RAG and Fine-tuning for AI Models

25min

Release of Common Corpus and Discussion on Transformers in AI

3min

Exploring Beyond Transformers

5min

Future Vision and Appreciation

4min

Daniel & Chris delight in conversation with “the funniest guy in AI”, Demetrios Brinkmann. Together they explore the results of the MLOps Community’s latest survey. They also preview the upcoming AI Quality Conference.

Join the discussion

Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

The Hacker Mindset – “The Hacker Mindset” written by Garrett Gee, a seasoned white hat hacker with over 20 years of experience, is available for pre-order now. This book reveals the secrets of white hat hacking and how you can apply them to overcome obstacles and achieve your goals. In a world where hacking often gets a bad rap, this book shows you the white hat side – the side focused on innovation, problem-solving, and ethical principles.
Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today.
Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.

Featuring:

Demetrios Brinkmann – Twitter
Chris Benson – Twitter, GitHub, LinkedIn, Website
Daniel Whitenack – Twitter, GitHub, Website

Show Notes:

Something missing or broken? PRs welcome!

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export