Software Engineering Daily

LiveKit and OpenAI with Russ d’Sa

May 1, 2025

Russ d’Sa, the Founder of LiveKit and a startup veteran, dives into the exciting intersection of real-time technology and AI. He shares insights from his journey through Y Combinator and discusses the significance of scalable communication tools in a post-pandemic world. The conversation highlights LiveKit's innovative shift to server-mediated models and collaboration with OpenAI for advanced voice features. D’Sa also explores the challenges of audio-video synchronization and the potential of voice-driven interfaces as the future of human-computer interaction.

47:29

Creator website

Episode guests

Russ d'Sa

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

LiveKit offers developers an open-source WebRTC stack, enabling the creation of scalable real-time audio and video applications.

Russ d’Sa emphasizes the transformative role of AI in user interactions, highlighting a shift towards voice and vision as primary interfaces.

Deep dives

The Evolution of LiveKit and Real-Time Communication

LiveKit is a platform designed for developers to create real-time audio and video applications using an open-source WebRTC stack. Initially inspired by earlier ventures, Russ Dussa found renewed purpose during the pandemic, highlighting the surge in demand for effective communication tools. Prior attempts at real-time streaming in 2007 faced technical limitations, but advancements in WebRTC technology post-2012 provided a robust framework. In 2021, the combination of significant market needs and the lack of scalable open-source infrastructure prompted the creation of LiveKit as a dedicated solution for building real-time experiences.

Intro

5min

From Startup Struggles to Communication Solutions

14min

Navigating the Shift from Peer-to-Peer to Server-Mediated Models

5min

Overcoming Server Limitations with a Multi-Cloud Approach

7min

Routing Cloud Packets with Minimal Latency

2min

Synchronizing Audio and Video in Online Communication

15min

LiveKit is a platform that provides developers with tools to build real-time audio and video applications at scale. It offers an open-source WebRTC stack for creation of live, interactive experiences like video conferencing, streaming, and virtual events. LiveKit has gained significant attention for its partnership with OpenAI for the Advanced Voice feature.

Russ d’Sa is the Founder of LiveKit and has an extensive career in startups. In this episode he joins Sean Falconer to talk about his startup journey, the early days of Y Combinator, LiveKit, WebRTC, LiveKit’s partnership with OpenAI, voice and vision as the future paradigm for computer interaction, and more.

Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from AI to quantum computing. Currently, Sean is an AI Entrepreneur in Residence at Confluent where he works on AI strategy and thought leadership. You can connect with Sean on LinkedIn.