The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Generative AI at the Edge with Vinesh Sukumar - #623

Apr 3, 2023

Vinesh Sukumar, senior director at Qualcomm Technologies, dives into the future of AI at the edge. He discusses the unique AI needs for mobile and automotive platforms, emphasizing the shift towards text-based inputs and generative content. Vinesh highlights the challenges and innovations surrounding ML Ops and synthetic data use. The conversation includes insights on advanced models like GPT-4 and strategies for optimizing performance in edge computing. His expertise sheds light on the rapid advancements and exciting opportunities in the evolving AI landscape.

39:06

Creator website

Episode guests

Vinesh Sukumar

AI Chapters

Episode notes

Intro

2min

Evolving AI Applications at the Edge

11min

Navigating the Complexities of Autonomous Vehicle Infrastructure

3min

Navigating Edge Computing Post-Pandemic

11min

Localizing Language Models

9min

The Evolution of Generative AI and Dynamic Model Deployment

3min

Today we’re joined by Vinesh Sukumar, a senior director and head of AI/ML product management at Qualcomm Technologies. In our conversation with Vinesh, we explore how mobile and automotive devices have different requirements for AI models and how their AI stack helps developers create complex models on both platforms. We also discuss the growing interest in text-based input and the shift towards transformers, generative content, and recommendation engines. Additionally, we explore the challenges and opportunities for ML Ops investments on the edge, including the use of synthetic data and evolving models based on user data. Finally, we delve into the latest advancements in large language models, including Prometheus-style models and GPT-4.

The complete show notes for this episode can be found at twimlai.com/go/623.