The Pros and Cons of Using Open Source Models in Enterprise-Level Use Cases

MLOps podcast #187 with Faizaan Charania, Product Manager, AI at LinkedIn, Building Effective Products with GenAI. // Abstract Faizaan outlines his AI product development approach, starting broadly and refining details with tech leads, emphasizing the value of a simplified MVP. He also explores integrating generative AI, highlighting its role in enhancing user experiences through LLMs. In this discussion, Faizaan shares wisdom on feedback integration, user trust, and the collaboration challenges between product managers and AI teams. Let's delve into evaluating AI-driven experiences and the complexities that arise in this dynamic landscape! // Bio Faizaan is an AI Product lead at LinkedIn working on Personalization and Generative AI use cases for Creators and Conversations on LinkedIn. He's been in the field of machine learning for 8+ years now he started as a research assistant eventually transitioning to being a Product Manager during his time at Yahoo. // MLOps Jobs board https://mlops.pallet.xyz/jobs // MLOps Swag/Merch https://mlops-community.myshopify.com/ // Related Links ⁠ --------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/ Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Faizaan on LinkedIn: https://www.linkedin.com/in/faizaan-charania/ Timestamps: [00:00] Faizaan's preferred beverage [00:22] Takeaways [02:54] The Bollywood actor [05:23] Faizaan's in tech [07:45] Technical pieces to learn about before working at LinkedIn [09:23] Tech Team Data Strategy [12:01] Gradual vs. Advanced ML Implementation [13:36] Shipping on time [14:11] Thoughts on building products with AI [18:20] Push and pull mechanism [21:47] Costs and Choices with AI Models [25:06] AI ROI Evaluation [27:02] Thoughts on open source [28:17] Building Generative AI focus [31:50] Prompts and Anomalies [34:57] Where to have a human in the loop [35:45] Problem-driven AI Tool [37:56] Creator of AI-generated post on LinkedIn [39:50] Product Impact on AI Democratization [41:15] Distinct signals to measure ROI [44:38] PMs learning AI while ML teams learn product [47:22] Gotchas seen when adding a new AI feature [50:00] Evaluation Challenges in Responses [51:55] Who's more confident? [52:55] Wrap up