AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Practical AI
The new AI app stack
Aug 23, 2023
The podcast explores the new AI app stack, including model 'middleware' for caching and control and app orchestration. They discuss the importance of understanding the ecosystem and tooling around large language models. They also explore AI playgrounds and the use of vector databases and embeddings. They break down the components of the new generative AI stack and emphasize the importance of AI engineering. The hosts reflect on their exploration of the infrastructure components and the value of the conversation.
45:07
AI Summary
Highlights
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- The AI app stack includes components such as model middleware, app orchestration, caching, and control for effective AI implementation.
- Caching, logging, and validation are crucial aspects of the AI app stack, ensuring improved performance, monitoring, and reliability in generative AI models.
Deep dives
The AI app stack and its components
The podcast episode explores the components of the AI app stack, which includes the application side, the data and resources side, and the model side. It emphasizes that the model is only a small part of the whole stack. The episode discusses the concept of model middleware, which connects the orchestration layer between the application, data, and model. It mentions different components within the stack, such as playgrounds for interactive model testing, app hosting for deploying AI applications, and tools for orchestration, caching, logging, validation, and security. The episode also highlights the importance of AI engineering in understanding and implementing these components.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode