AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
4min chapter
Building LLM Apps & the Challenges that come with it. The What's AI Podcast Episode 16: Jay Alammar
What's AI Podcast by Louis-François Bouchard
The Challenges of Building a Cohere or Open AI-Based App
The big models allow you to prototype and they do amazing behaviors. Once you have the model able to do the behaviors that you want using one example in the prompt or five examples in the prompt, you can then make it cheaper for you by fine-tuning a smaller model. That saves on context size because you're not sending the same five few shot examples with every prompt. Sematic Search is this way of caching that knowledge and retrieving the important bits. It's great to know that it's possible.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode