Embedded Executive: AI Effects All Subsystems Including Memory, with Micron
May 1, 2024
auto_awesome
Mark Montierth, Corporate VP of Micron's Memory Business, discusses the critical role of memory in AI projects, the impact of memory demands on AI models, and the relationship between AI and memory subsystems. The podcast explores Micron's advancements in memory supply for mobile devices and the need for efficiency improvements in edge devices.
Memory subsystems are now crucial for AI performance due to the shift towards massive models and billions of parameters.
Micron is focusing on delivering industry-leading memory products for mobile devices to meet the demands of AI workloads.
Deep dives
The Impact of Memory on AI Workloads
In the podcast, Mark Montyr discusses how memory and storage play a crucial role in the latest trends in the mobile industry, particularly in the realm of generative AI at the edge. Traditionally, workloads focused more on compute performance rather than memory usage. However, the advent of AI with massive models and billions of parameters has shifted the landscape, making memory bandwidth and capacity crucial for performance. Increasing memory capacity and bandwidth directly improve model responsiveness and quality.
Micron's Innovations in Memory Technology
Mark Montyr highlights Micron's focus on delivering industry-leading memory products, especially in the mobile space. Micron's latest process node, the Win Beta node, offers enhanced power efficiency and performance, catering to the demands of AI workloads. Additionally, Micron unveiled fast on-device storage solutions for mobile devices, recognizing the growing need for ample storage in the era of generative AI. Micron's collaborative approach with OEMs ensures alignment with industry requirements and a commitment to advancing performance per watt in memory technology.
In this era of AI, designers have to think differently about every aspect of their projects. That includes the memory subsystem. To that end, Micron had a series of announcements to help facilitate AI, particularly on mobile devices. But beyond each subsystem, there’s just so much that needs to be learned and still so much that’s unknown. That’s where this week’s Embedded Executives podcast takes us. On this episode, I spoke to Mark Montierth, a Corporate VP and the General Manager of Micron’s Mobile Business Unit.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode