Run local AI on any PC or Mac - Microsoft Foundry Local

9 snips

Nov 20, 2025

Raji Rajagopalan, Vice President of Microsoft's CoreAI Foundry Local team, dives into the transformative world of local AI. He reveals how Foundry Local enables powerful AI apps to run seamlessly on any device, enhancing privacy and reducing latency. Raji highlights the advantages of offline access and the simplicity of app portability across different hardware. He also showcases impressive demos including applications on older devices and macOS, emphasizing the SDK's ease of use for developers venturing into local AI.

Ask episode

AI Snips

Chapters

Transcript

Episode notes

INSIGHT

Local AI Is Production-Ready

Local AI is now practical because hardware, efficient models, and developer tools have converged.
Raji Rajagopalan notes this removes complexity and can run without an Azure subscription.

ADVICE

Prioritize On-Device Inference

Use local inference to avoid internet reliance and reduce latency.
Keep sensitive data on-device to meet privacy and compliance needs.

INSIGHT

One Runtime For Many Chips

Foundry Local solves app portability by abstracting device selection and execution providers.
Microsoft worked with silicon partners so models run across Intel, NVIDIA, Qualcomm, AMD, etc.

Get the Snipd Podcast app to discover more snips from this episode

Get the app

Build powerful AI apps that run locally on any device—Windows, macOS, or mobile—without relying on the cloud using Foundry Local. Leverage full hardware performance, keep data private, reduce latency, and predict costs, even in offline or low-connectivity scenarios.

Simplify development and deploy AI apps across diverse hardware and OS platforms with the Foundry Local SDK. Manage models locally, switch AI engines easily, and deliver consistent, multi-modal experiences, voice or text, without complex cross-platform setup.

Raji Rajagopalan, Microsoft CoreAI Vice President, shares how to start quickly, test locally, and scale confidently.

► QUICK LINKS:

00:00 - Run AI locally

01:48 - Local AI use cases

02:23 - App portability

03:18 - Run apps on any device

05:14 - Run on older devices

05:58 - Run apps on MacOS

06:18 - Local AI is Multi-modal

07:25 - How it works

08:20 - How to get it running on your device

09:26 - Start with AI Toolkit in VS Code with new SDK

10:11 - Wrap up

► Link References

Check out https://aka.ms/foundrylocalSDK

Build an app using code in our repo at https://aka.ms/foundrylocalsamples

► Unfamiliar with Microsoft Mechanics?

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics