707: Vicuña, Gorilla, Chatbot Arena and Socially Beneficial LLMs, with Prof. Joey Gonzalez
Super Data Science: ML & AI Podcast with Jon Krohn
00:00
Evolution of MLOps Framework and Importance of LLM Technology
The chapter explores the journey of Aqueduct, a startup simplifying prediction infrastructure for data science teams by merging serverless and prediction serving technologies. There is a focus on integrating Language Model Models (LLMs) into real-time chatbot interactions and managing compute resources effectively. The conversation also covers the evolution of the speaker's first company, GraphLab, which eventually led to a successful acquisition by Apple.
Transcript
Play full episode
