Embedded Executive Podcast cover image

Embedded Executive Podcast

Embedded Executive: AI Effects All Subsystems Including Memory, with Micron

May 1, 2024
Mark Montierth, Corporate VP of Micron's Memory Business, discusses the critical role of memory in AI projects, the impact of memory demands on AI models, and the relationship between AI and memory subsystems. The podcast explores Micron's advancements in memory supply for mobile devices and the need for efficiency improvements in edge devices.
09:58

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Memory subsystems are now crucial for AI performance due to the shift towards massive models and billions of parameters.
  • Micron is focusing on delivering industry-leading memory products for mobile devices to meet the demands of AI workloads.

Deep dives

The Impact of Memory on AI Workloads

In the podcast, Mark Montyr discusses how memory and storage play a crucial role in the latest trends in the mobile industry, particularly in the realm of generative AI at the edge. Traditionally, workloads focused more on compute performance rather than memory usage. However, the advent of AI with massive models and billions of parameters has shifted the landscape, making memory bandwidth and capacity crucial for performance. Increasing memory capacity and bandwidth directly improve model responsiveness and quality.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode