AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Data Exchange with Ben Lorica
Orchestration for LLM and RAG applications
Nov 16, 2023
Malte Pietsch, co-founder & CTO of Deepset, discusses the importance of orchestration frameworks for LLM applications, the usage patterns of the Haystack framework, and optimizing RAG applications with metadata and knowledge graphs. They also explore the evolution of data engineering pipelines, real-time indexing, and the highlights and features of Haystack 2.0.
49:58
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Haystack 2.0 is being redesigned to offer more customizability and ease of use for building pipelines, introducing loops, branching, and parallel branches for greater flexibility.
- Haystack 2.0 will address monitoring and robustness by integrating with open telemetry for tracing and providing async execution for scaling OpenAI efficiently, ensuring it can handle scale and latency challenges with ease in production environments.
Deep dives
Haystack 2.0: Customizability and Ease of Use
Haystack 2.0 is being redesigned to offer more customizability and ease of use for building pipelines. The update will introduce loops, branching, and parallel branches for greater flexibility in creating pipelines. It will also make it easier to create custom nodes, allowing users to connect to specific data sources or implement customized retriever mechanisms. The goal is to provide a framework that is both highly customizable and beginner-friendly, with simpler paths for getting started and a clear progression to advanced usage.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode