MLOps Coffee Sessions #99 with Ronen Dar and Gijsbert Janssen van Doorn, Getting the Most Out of your AI Infrastructure co-hosted by Vishnu Rachakonda.
// Abstract
Run:AI is building a cloud-based platform for building with AI. In this talk, we hear all about why this need exists, how this works, and what value it creates.
// Bio
Ronen Dar
Run:AI Co-founder and CTO Ronen was previously a research scientist at Bell Labs and has worked at Apple and Intel in multiple R&D roles. As CTO, Ronen manages research and product roadmap for Run:AI, a startup he co-founded in 2018. Ronen is the co-author of many patents in the fields of storage, coding, and compression. Ronen received his B.S., M.S., and Ph.D. degrees from Tel Aviv University.
Gijsbert Janssen van Doorn
Gijsbert is Director of Technical Product Marketing at Run:AI. He is a passionate advocate for technology that will shape the future of how organizations run AI. Gijsbert comes from a technical engineering background, with six years in multiple roles at Zerto, a Cloud Data Management and Protection vendor.
Timestamps:
[00:00] Introduction to Ronen Dar & Gijsbert Janssen van Doorn
[01:25] Takeaways
[04:24] Thank you Run:AI for sponsoring this episode!
[05:13] Run:AI products and components
[09:27] Companies coming to Run:AI and problems they solve
[13:30] Why is this problem hard?
[18:56] Run:AI's Vision
[22:12] Run-on-the-mill workload
[25:36] Engineering challenges and requirements building Run:AI
[32:47] Process of solving problems on the same page
[35:45] Power to give data scientists
[37:38] Avoiding horror stories that might cost a lot of money
[44:23] Running multiple models on a single GPU
[47:17] Never scale down to zero
[48:28] So many ML Start-ups in Israel
[53:00] Vision for the future at GPUs and how will Kubernetes advance
[55:55] Future of AI accelerators
[57:03] Lightning round
[1:02:26] Wrap up
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode