Deployed: The AI Product Podcast The Secrets To Being A Great AI PM: Evals, Quality & More | Apollo.io AI Product Lead, Tyler Phillips
Mar 27, 2025
Tyler Phillips, AI Product Lead at Apollo.io, dives into the art of crafting successful AI products for sales. He shares valuable insights on the often-overlooked tasks of AI product management, like evaluating AI outputs and creating quality frameworks. Highlighting the significance of prompt writing from domain experts, Tyler discusses how personalized outreach enhances customer experiences. He also reveals strategies for ensuring data quality and constructing effective evaluation criteria, making for a treasure trove of tips for aspiring AI PMs.
AI Snips
Chapters
Transcript
Episode notes
AI PMs Must Focus on Quality Evaluation
- Great AI PMs spend a majority of their time evaluating AI outputs for quality.
- Building systematic evaluation spreadsheets of results is critical to product success.
AI Powers Every Sales Stage
- AI improves sales by automating lead search, prioritization, research, meeting prep, and follow-up analysis.
- Combining multiple AI models creates a seamless sales engagement workflow.
Agents vs Workflows Clarified
- Agents and deterministic workflows are distinct; not all automation needs an agentic AI.
- Deterministic workflows are better solved step-by-step, reserving agents for less structured tasks.