Super Data Science: ML & AI Podcast with Jon Krohn 883: Blackwell GPUs Are Now Available at Your Desk, with Sama Bali and Logan Lawler
61 snips
Apr 29, 2025 
Join Sama Bali, an AI solutions leader at NVIDIA, and Logan Lawler, who heads Dell Pro Max AI Solutions, as they unveil the impressive Blackwell GPUs designed to elevate AI-model training at your desk. They discuss the collaboration that birthed Dell’s Pro Max PCs, catering specifically to data scientists. Tune in as they share insights on transitioning from Unix to Windows systems, the expanding accessibility of AI tools, and their predictions for the future of AI technology, making complex innovations easier and more powerful for everyday users.
AI Snips
Chapters
Books
Transcript
Episode notes
NVIDIA GTC: The Super Bowl of AI
- Sama Bali described NVIDIA GTC as the "Super Bowl of AI", with massive developer enthusiasm and town-wide events in San Jose.
- She shared seeing people camping out at 6 a.m. just to attend keynote talks, highlighting the event's immense draw.
Blackwell GPUs Enable Local AI Power
- NVIDIA's Blackwell GPUs double the memory per GPU from 48GB to 96GB, enabling bigger models and local AI experimentation.
- This memory capacity allows developers to run large AI models right on their desktops without relying solely on cloud resources.
Memory Size Maps Model Scale
- Roughly, every billion parameters in a model requires about 2GB of GPU memory, so Blackwell's large memory supports models around 8 billion parameters easily.
- This advancement finally makes running large LLMs locally more feasible for data scientists and developers.
