2min chapter

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

The Enterprise LLM Landscape with Atul Deo - #640

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

CHAPTER

The Cost of Fine Tuning in Context Learning

If you want to do pure in context learning, two things have to happen. One is you need a model with the longer context lengths because let's just take that example of kind of auto GPT where you are going to probably pass a lot of kind of API expects and recursively it's going to keep adding context. The second thing is you need is a well trained model which can be large in size and typically larger in size means that the hosting can be expensive. Because of these two factors like again, they tend to make inference more costlier.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode