2min snip

The MAD Podcast with Matt Turck cover image

AI, Data and Blockchain: a VC perspective | Tomasz Tunguz, Founder of Theory Ventures

The MAD Podcast with Matt Turck

NOTE

Value of Small Language Models and Constellation Model in AI Innovation

Small language models are becoming more beneficial for BDB applications with their improving performance and cost-effectiveness compared to larger models. The rapid commoditization of out-of-date models is evident in the significant pricing difference between models. This trend is expected to lead to a bifurcation of model sizes, with smaller models like llama three proving effective for certain tasks while larger models like the 440 billion parameter model are still being developed. The concept of a constellation model, where a query is processed by a classifier that could be generative or classical, is emerging as a strategy to optimize AI performance by using a combination of big and small models based on specific use cases.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode