On this episode of Deployed: The AI Product Podcast, we sit down with Ben Kus, CTO of Box, to unpack how they built a secure, scalable AI platform within their enterprise content management system. Ben shares candid insights from Box's journey integrating AI capabilities while maintaining enterprise-grade security for sensitive customer data. Learn practical strategies for evaluating AI quality without accessing customer data, building internal platforms that engineering teams want to use, and designing architecture that can evolve with rapid AI advances. Whether you're integrating LLMs into an established product or building new AI features, this conversation offers valuable lessons on balancing innovation with enterprise requirements. Join Ian, Co-Founder and CEO of Freeplay, for this in-depth discussion on scaling AI responsibly in the enterprise.

Ben Kus, CTO of Box, leads their AI initiatives by integrating secure and scalable AI solutions into enterprise content management. He discusses the transformative potential of generative AI, sharing how Box navigated the shift from skepticism to enthusiasm among customers. Ben emphasizes the importance of collaboration in AI implementation and maintaining strict quality standards while ensuring data security. He also highlights the evolving expectations within enterprises and the need for adaptive engineering teams to stay ahead in the rapidly evolving AI landscape.

In this discussion with Arya Asemanfar, a Product and Engineering leader at Sierra, listeners discover how AI-powered agents are revolutionizing customer interactions. Arya explains the critical differences between traditional chatbots and advanced agents that take meaningful actions. The conversation dives into Sierra's innovative 'Agent OS' that ensures robust, scalable development and addresses challenges like tool hallucination. Arya highlights the importance of collaboration with customers, showing how tailored solutions enhance customer service while reflecting brand values.

Nick Francis, CEO of Help Scout, and Luis Morales, VP of Engineering, dive into their journey transforming a 13-year-old customer support platform into an AI-first company. They discuss their shift from skepticism to embracing AI for enhancing customer experiences. The duo shares insights on experimenting with AI features, evolving business models, and the challenges of prompt engineering. They emphasize the importance of an experimentation-driven culture and the new role of AI product quality experts, offering valuable advice for companies navigating AI integration.

Kyle Nesbit, a longtime Googler with 17 years of experience in AI and distributed systems, shares invaluable insights about building AI at scale. He discusses the challenges of transitioning traditional engineering teams to embrace LLM development and underscores the importance of starting with solid evaluation metrics. Kyle reveals strategies for iterative improvement, tackling data discovery issues, and balancing product quality during scaling. He also provides a peek into the real story behind AI demos and the complexities of integration within organizations.

Sara Beykpour, Co-founder and CEO of Particle, discusses how her news app uses AI to revolutionize news consumption. She highlights the challenges of summarization and the importance of maintaining quality and trust in AI-generated content. Sara shares insights on prompt engineering and integrating user feedback into product development. The conversation also touches on evolving attitudes towards AI in journalism and how tech firms can collaborate with publishers to enhance reliability in news. A must-listen for anyone curious about AI's role in media!

Eliza Cabrera, Principal Product Manager at Workday, and Beau Lyddon, Principal Engineer, share their insights on implementing generative AI at scale. They discuss the journey of integrating AI into enterprise products, emphasizing user adoption and effective collaboration. Key topics include selecting initial use cases, prompt engineering, and maintaining data privacy. Eliza and Beau highlight the balance between innovation and reliability, offering practical lessons for teams navigating the complexities of AI in a corporate environment.

Mike Conover, co-founder and CEO of Brightwave, dives into the challenges and capabilities of AI in financial research. He discusses limitations of large language models (LLMs) and the importance of effective information retrieval. Mike shares insights on building strong AI engineering teams and the significance of practical collaboration between analysts and engineers. He emphasizes the need for customized AI solutions to enhance product outcomes, illustrating how Brightwave revolutionizes market analysis.

Jeff Seibert, co-founder and CEO of Digits, dives into the transformative role of AI in finance. He discusses how choosing the right AI model is crucial for tackling real-world challenges, such as invoice processing and transaction categorization. Seibert highlights the synergy between AI and human expertise, revealing how customer feedback enhances machine learning. The conversation touches on the hurdles of implementing autonomous agents and the importance of refining AI tools to meet customer needs, while maintaining a focus on delivering tangible value.