2min snip

Software Engineering Daily cover image

Scaling Large ML Models to Small Devices with Atila Orhon

Software Engineering Daily

NOTE

Adopting New Technology: Understanding the Evolution of Commercial Models

Implementing new technologies like advanced AI models into production requires companies to evaluate various factors including technological maturity, hardware capabilities, and commercial model spectrum. The uncertainty lies in whether the technology will be feasible in the long run, depending on the commercial models available. The evolution of commercial models, such as the emergence of smaller yet powerful models like Lama 3 with 8 billion parameters performing almost equally well as larger models like Lama 2 with 70 billion parameters, indicates a positive trend. The expectation is that commercial models will continue to expand in both directions; larger models will grow in size while smaller models relevant for commercial use will become more efficient. This evolution enables companies to harness the capabilities of advanced models on the cloud, ensuring optimal performance and energy efficiency over time.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode