Chain of Thought

The “ROI of AI” has been marketed as a panacea, a near-magical solution to all business problems. Following that promise, many companies have invested heavily in AI over the past year and are now asking themselves, “What is the return on my AI investment?” This week on Chain of Thought, Galileo’s CEO, Vikram Chatterji joins Conor Bronsdon to discuss AI's value proposition, from the initial hype to the current search for tangible returns, offering insights into how businesses can identify the right AI use cases to maximize their investment. Next, we’re joined by a panel of AI experts to discuss the ROI of Enterprise AI, featuring Alex Klug, Head of Product, Data Science & AI at HP; Sriram Palapudi, Sr. Dir, ML Platform Engineering at ServiceNow; and Jay Subrahmonia, Global MD for AI Research & Products at Accenture. Together, they explore effective implementation strategies, how to measure the returns of AI adoption in the enterprise, and why AI's ROI isn't always just about the bottom line. Chapters: 00:00 Current State of AI Investments 03:59 Challenges and Solutions in AI Implementation 08:30 Identifying and Prioritizing AI Use Cases 10:53 Ensuring Trust and Explainability in AI 15:29 Measuring ROI and Efficiency Gains 21:10 Panel Discussion Begins 21:54 Trust and Risk Management at HP 23:27 Accenture's Approach to Operationalizing AI 26:06 ServiceNow's Trade-offs and Prioritization 31:17 Measuring the success of AI for customers 36:29 Frameworks and Best Practices 40:57 Conclusion and Final Thoughts Follow: Vikram Chatterji: ⁠https://www.linkedin.com/in/vikram-chatterji/ Conor Bronsdon: https://www.linkedin.com/in/conorbronsdon/ Alex Klug: https://www.linkedin.com/in/alex-klug-67ba3655/ Sriram Palapudi: https://www.linkedin.com/in/sriram-palapudi-11294b1/ Jay Subrahmonia: https://www.linkedin.com/in/jayashree-subrahmonia-99963a/ Show notes: Watch all of Productionize 2.0: ⁠⁠https://www.galileo.ai/genai-productionize-2-0⁠⁠

Will 2025 be the year open-source LLMs catch up with their closed-source rivals? Will an established set of best practices for evaluating AI emerge? This week on Chain of Thought, we break out the crystal ball and give our biggest AI predictions for 2025. Listen as Sara Hooker, VP of Research at Cohere and Head of Cohere for AI predicts a trend towards smaller, more optimized AI models; Craig Wiley, Senior Director of Product, Mosaic AI at Databricks, dives into the future of multimodal AI; and Galileo’s CEO, Vikram Chatterji, shares his predictions, including the rise of open-source LLMs. Chapters: 00:00 Introduction 02:01 Vikram's top 3 predictions 06:19 AI and nuclear energy 08:30 Giving power back to the people 13:46 Craig's predictions 20:46 The "era of toolification" 30:38 Sara's predictions 35:07 AI safety Follow: Vikram Chatterji: ⁠⁠https://www.linkedin.com/in/vikram-chatterji/⁠ Yash Sheth: https://www.linkedin.com/in/yash-sheth-/ Conor Bronsdon: ⁠⁠https://www.linkedin.com/in/conorbronsdon/⁠⁠ Sara Hooker: https://www.linkedin.com/in/sararosehooker/ Craig Wiley: https://www.linkedin.com/in/craigwiley/ Show notes: Watch all of Productionize 2.0: ⁠⁠⁠https://www.galileo.ai/genai-productionize-2-0⁠⁠

AI agents have quickly emerged as the next ‘hot thing’ in AI, but what constitutes an AI agent and do they live up to the hype? Join Brian Raymond, founder & CEO at Unstructured.io, Bob van Luijt, co-founder & CEO at Weaviate, and João Moura, founder at crewAI as they discuss the shift to agentic workflows, dissect their architecture, and tackle real-world challenges in agent deployment.  From data management tips to generative feedback loops, this episode is your essential guide to operationalizing agents effectively. Chapters: 00:00 Defining AI Agents 01:16 Components of Agentic Architecture 02:16 Challenges and Solutions in Agent Deployment 03:58 Data Management and Quality Issues 05:23 Operationalizing Agents in Production 06:56 API and Security Considerations 09:04 Multimodal Information and Agentic Workflows 12:42 Future of Agentic Workflows 20:20 Best Practices for Agentic Strategies 25:30 Generative Feedback Loops 28:29 Agentic Evaluations Follow: Yash Sheth: https://www.linkedin.com/in/yash-sheth- Bob van Luijt: https://nl.linkedin.com/in/bobvanluijt Brian Raymond: https://www.linkedin.com/in/brian-s-raymond ⁠⁠⁠⁠⁠⁠⁠João Moura: https://br.linkedin.com/in/joaomdmoura Show notes: ⁠⁠⁠Watch all of Productionize 2.0: https://www.galileo.ai/genai-productionize-2-0

From ChatGPT's search engine to Google's AI-powered code generation, artificial intelligence is transforming how we build and deploy technology.  In this inaugural episode of Chain of Thought, the co-founders of Galileo explore the state of AI, from open-source models to establishing trust in enterprise applications. Plus, tune in for a segment on the impact of the Presidential election on AI regulation. The episode culminates with an interview of May Habib, CEO of Writer, who shares practical insights on implementing generative AI at scale. Chapters: 00:00 Introduction to Chain of Thought Podcast 01:27 Big News in AI: ChatGPT and Anthropic 06:34 Open Source vs Proprietary AI 12:17 The Importance of Trust in AI 20:12 Challenges in AI Development and Deployment 22:07 The Role of Human Input in AI Development 28:45 The Future of AI Regulation 34:41 Interview with May Habib co-founder & CEO at Writer 40:01 What’s Writer’s secret sauce? 43:31 Challenges in productionizing GenAI 48:08 Conclusion Follow: Vikram Chatterji: ⁠⁠⁠https://www.linkedin.com/in/vikram-chatterji/⁠⁠ Atin Sanyal: ⁠https://www.linkedin.com/in/atinsanyal/ Yash Sheth: ⁠https://www.linkedin.com/in/yash-sheth-/⁠ Conor Bronsdon: ⁠⁠⁠https://www.linkedin.com/in/conorbronsdon/⁠⁠⁠ May Habib: https://www.linkedin.com/in/may-habib/ Show notes: Watch all of Productionize 2.0: ⁠⁠⁠⁠https://www.galileo.ai/genai-productionize-2-0⁠⁠

We are living in the age of AI. It's transforming everything around us, from the way we work and communicate, to how we solve global challenges. But for many, AI still feels like a black box. Introducing Chain of Thought, the podcast for software engineers and leaders that demystifies artificial intelligence. We’ll be joined by AI innovators, tech founders, and expert researchers such as Cohere’s Sara Hooker. Join us as we unravel actionable strategies and practical techniques for building effective GenerativeAI applications. Discover how AI is being productionized at companies like HP, Twilio and Databricks, as each week we’ll discuss the rapid-evolving AI industry, exploring its potential to create a more productive world, and build a better, trustworthy future. Subscribe now to Chain of Thought wherever you get your podcasts. Chain of Thought.  Trace the logic of innovation.