Latent Space: The AI Engineer Podcast
swyx + Alessio
The podcast by and for AI Engineers! In 2024, over 2 million readers and listeners came to Latent Space to hear about news, papers and interviews in Software 3.0.We cover Foundation Models changing every domain in Code Generation, Multimodality, AI Agents, GPU Infra and more, directly from the founders, builders, and thinkers involved in pushing the cutting edge. Striving to give you both the definitive take on the Current Thing down to the first introduction to the tech you'll be using in the next 3 months! We break news and exclusive interviews from OpenAI, Anthropic, Gemini, Meta (Soumith Chintala), Sierra (Bret Taylor), tiny (George Hotz), Databricks/MosaicML (Jon Frankle), Modular (Chris Lattner), Answer.ai (Jeremy Howard), et al.Full show notes always on https://latent.space
Episodes
Mentioned books
42 snips
Apr 29, 2023 • 1h 16min
Mapping the future of *truly* Open Models and Training Dolly for $30 — with Mike Conover of Databricks
Mike Conover, a Staff Software Engineer at Databricks with a PhD in Complex Systems, leads the charge for truly open-source AI models. He reveals how his team developed Dolly, a customizable LLM that can be trained for just $30. The conversation dives deep into the evolution of AI, comparing it to biological concepts, and explores innovative training methods. Conover also addresses the practical applications of generative AI, emphasizing the importance of blending creativity with business utility. Don't miss insights into AI's potential across various domains!
34 snips
Apr 22, 2023 • 1h 4min
AI-powered Search for the Enterprise — with Deedy Das of Glean
Deedy Das, Founding Engineer at Glean and former Tech Lead at Google Search, dives into the world of AI-powered enterprise solutions. He discusses Glean's innovative search technology, designed to enhance workplace efficiency with features like AI answers and expert detection. Deedy shares his views on the startup landscape, critiquing those who offer solutions without clear problems and highlights the challenges of navigating AI innovations. He also sheds light on issues in standardized testing in India, connecting it to broader societal impacts.
44 snips
Apr 13, 2023 • 1h 20min
Segment Anything Model and the Hard Problems of Computer Vision — with Joseph Nelson of Roboflow
Joseph Nelson, a passionate instructor and founder of Roboflow, joins the discussion to unveil the cutting-edge Segment Anything Model (SAM). He shares insights on how SAM enhances image segmentation and streamlines data workflows, revolutionizing the computer vision landscape. The conversation highlights the challenges of image annotation and the shift towards multimodal AI. Tune in for fascinating tales from hackathons and the practical applications of SAM in various industries, showcasing its potential to change the game for data preparation and video editing.
13 snips
Apr 7, 2023 • 51min
AI Fundamentals: Benchmarks 101
Dive into the fascinating world of AI benchmarks, tracing their evolution from basic word associations to complex reasoning tasks. Discover the unsung heroes behind these benchmarks and their pivotal roles in advancing language models. Explore Super Glue, a benchmark that requires deeper understanding of conversation. The discussion also tackles unexpected performance discrepancies in models like GPT-4 and highlights the stark contrasts between AI and human learning capabilities. Get ready to rethink how we evaluate artificial intelligence!
5 snips
Mar 29, 2023 • 42min
Grounded Research: From Google Brain to MLOps to LLMOps — with Shreya Shankar of UC Berkeley
In this engaging conversation, Shreya Shankar, a talented ML Engineer with a rich background at Facebook and Google Brain, shares her path to becoming a PhD candidate at UC Berkeley. She dives into the complexities of MLOps, highlighting crucial aspects like velocity, validation, and risks such as data leakage. Shreya emphasizes the importance of supporting underrepresented minorities in tech and discusses innovative AI tools that enhance creativity. Her insights into the evolving landscape of AI and data management spark excitement about the future of technology.
16 snips
Mar 24, 2023 • 1h 36min
Emergency Pod: ChatGPT's App Store Moment (w/ OpenAI's Logan Kilpatrick, LindyAI's Florent Crivello and Nader Dabit)
Logan Kilpatrick, a key player at OpenAI, shares insights on the groundbreaking launch of ChatGPT plugins, likening it to a modern app store. Florent Crivello discusses his AI assistant startup, emphasizing personalization in workflow management. Nader Dabit dives into the revolutionary capabilities of plugins, like executing Python code for video editing. They explore the competitive landscape among tech giants, innovative monetization strategies, and the potential of AI in transforming everyday tasks, sparking excitement for the future of technology.
18 snips
Mar 10, 2023 • 38min
From Astrophysics to AI: Building the future AI Data Stack — with Sarah Nagy of Seek.ai
In this conversation, Sarah Nagy, founder of Seek.ai and former astrophysicist, dives into the fascinating world of AI and data. She explains how Seek.ai empowers non-technical users to access insights effortlessly, transforming data querying with natural language interfaces. The discussion touches on the interplay between improv and AI in crafting responses, the significance of the semantic layer for better data management, and the evolving demands in the data engineering space. Sarah also shares her predictions for rapid advancements in AI productivity tools.
52 snips
Mar 2, 2023 • 51min
97% Cheaper, Faster, Better, Correct AI — with Varun Mohan of Codeium
Varun Mohan, CEO of Codeium and former tech lead at Nuro, dives deep into the evolving landscape of AI infrastructure. He shares insights on achieving GPU efficiency and dynamic multiplexing for optimal model performance. The discussion tackles the significance of robust infrastructure in model development and the impact of AI in code generation, noting that 60-70% of AI-generated code is retained. Varun also explores the challenges of scaling AI applications and the transformative potential of AI in both software and legal industries.
98 snips
Feb 23, 2023 • 52min
ChatGPT, GPT4 hype, and Building LLM-native products — with Logan Kilpatrick of OpenAI
Logan Kilpatrick, First Developer Advocate at OpenAI, shares insights from the forefront of AI technology. He discusses the rapid acceleration of AI, focusing on tools like ChatGPT and their transformative potential across sectors such as education and mental health. Logan also dives into the importance of prompt engineering for maximizing AI capabilities. He explores exciting developments like Apple's Neural Engine and advances in content creation via AI, highlighting the need for ethical considerations and innovation in this fast-evolving field.
