12min chapter

OnTrack: The PCB Design Podcast cover image

Edge Devices and LLMs: What's Ahead for AI

OnTrack: The PCB Design Podcast

CHAPTER

Edge Computing, AI, and Software Development

The chapter delves into the integration of edge computing, AI, and software development, emphasizing the importance of running AI and machine learning models locally on edge devices. It discusses various hardware options such as microcontrollers, GPUs, Jetson Nano, FPGAs, and specialized silicon for AI at the edge, focusing on power efficiency and cost-effectiveness. The conversation also explores future scenarios for AI integration, including customizing AI per model, integrating AI into EDA tooling, and the challenges of running large language models on GPUs due to RAM constraints.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode