Routing Prompts and Fine-Tuned Models

MLOps podcast #191 with Gregory Kamradt, Founder of  @DataIndependent, Building Defensible AI Apps sponsored by  @MilvusVectorDatabase . // Abstract Demetrios engages in a captivating conversation with Gregory Kamradt, an AI visionary deeply immersed in technology and product development. The discussion spans various challenges businesses encounter in implementing AI, the transformative potential of AI in revolutionizing business processes, and the growth and possibilities associated with OpenAI. Gregory shares insights into his latest project, a smart companion app designed to analyze and summarize startup pitches. The episode unfolds as a rich source of knowledge, exploring diverse topics such as AI experimentation, the concept of an AI gateway, the future of finely tuned models for niche applications, and insights into the intricate landscape of AI within big tech, including Google's strategic direction and OpenAI's copyright protection measures. // Bio Greg has mentored thousands of developers and founders, empowering them to build AI-centric applications. By crafting tutorial-based content, Greg aims to guide everyone from seasoned builders to ambitious indie hackers. Greg partners with companies during their product launches, feature enhancements, and funding rounds. His objective is to cultivate not just awareness, but also a practical understanding of how to optimally utilize a company's tools. He previously led Growth @ Salesforce for Sales & Service Clouds in addition to being early on at Digits, a FinTech Series-C company. // MLOps Jobs board https://mlops.pallet.xyz/jobs // MLOps Swag/Merch https://mlops-community.myshopify.com/ // Related Links Website: https://gregkamradt.com/ Greg Kamradt (Data Indy): https://www.youtube.com/@DataIndependent Milvus Vector Database: https://zilliz.com/what-is-milvus ⁠ --------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Greg on LinkedIn: https://www.linkedin.com/in/gregkamradt/ Timestamps: [00:00] Greg's preferred coffee [00:12] Takeaways [02:56] Quick word from our sponsor [04:22] DevDay [06:19] YouTube's unique perspective on the technological revolution [09:34] GPT assistance [13:36] AI Streamlining Fax Orders [18:13] AI Marketplace Dynamics: GPT vs. Specialized [22:04] Data Tooling Platform Challenges [27:17] The Shield against copyright [29:27] Llama Index vs OpenAI [31:56] DS Pie and Compiler Tangent [34:31] Orchestration Layer is dead! [36:49] Personalized AI Models: Understanding Integration [38:00] AI Defensibility [43:00] Green Field AI Opportunities [46:57] LLMs for live event pitch [53:38] Exciting content creation process [58:03] New context window benchmark [1:02:23] AI Gateway [1:04:35] Wrap up