Behind the Craft

Hamel Husain, an expert in AI evaluation methods, shares his vast experience training PMs and engineers at top tech firms. He breaks down how to effectively analyze real production traces, emphasizing the power of binary pass/fail ratings over complex scoring systems. Hamel explains common pitfalls in evaluation metrics and introduces practical tools for continuous monitoring. Listeners gain insights into building simple annotation tools and the importance of grounding evaluations in real problems to drive meaningful improvements.

Meaghan Choi, design lead for Claude Code at Anthropic, merges design with engineering by actively shipping code. In this chat, she reveals why shipping to production feels both "terrifying and magical." Discover her top three design workflows using Claude Code and learn how designers can collaborate with engineers for effective coding. Meaghan also showcases a live demo transitioning from Figma to working code in minutes, shares clever shortcuts, and discusses the evolving landscape of design roles in an AI-driven world.

Cat Wu, the product lead for Claude Code, shares fascinating insights into the operations of an AI-native team. Discover how they gather user feedback every 10 minutes and prioritize prototyping over documentation. Cat explains how designers contribute directly to coding and the importance of internal communication in development. She also offers her top three tips for maximizing the Claude Code experience and hints at exciting future features on the horizon for the product.

In this episode, Alex Finn, founder of the "Claude Life" operating system and Creator Buddy, shares his innovative approaches to automating life with AI. He discusses how Claude Code streamlines research and curates AI news, saving hours in productivity. Alex reveals the secrets to using custom commands for personal efficiency. He emphasizes the importance of brain dump analysis for content creation and identifies essential skills needed for the future. Tune in for insights on transforming daily tasks with AI!

In this discussion with Nan Yu, Head of Product at Linear, the talk ranges from the astonishing scalability of a two-PM team to a ranking of essential PM skills in the AI era. Nan dives into how AI disrupts strategic roles and the necessity for new skills like context and agent management. He shares insights on Linear's unique 10% rule for rapid shipping and demonstrates how AI agents can streamline tasks, transforming project management into a futuristic collaboration of humans and machines.

Aman Khan, Head of Product at Arise, specializes in AI evaluations and large language models. He shares insights on creating AI evaluations, including four essential types every product manager should know. The podcast features a live demo of building evals for a customer support agent, discussing the importance of a golden dataset and aligning AI with human judgment. Aman emphasizes effective prompt crafting and the iterative process critical for enhancing AI performance in real-world applications, particularly in customer service scenarios.

Lee Robinson, VP of Developer Experience at Cursor and a veteran in tech, breaks down how AI is revolutionizing software development. He shares insights on essential setup phases, including tests and git, often overlooked by beginners. The conversation emphasizes the importance of blending human expertise with AI tools. A live demo of building a music tracking app showcases practical applications. Robinson also discusses the evolving role of generalists in tech, encouraging PMs to embrace technical skills in an AI-driven landscape.

Ben Erez, a former PM at Meta, shares insights on acing product management interviews. He reveals the current job market dynamics and the structure of product sense interviews. Learn how to build a personalized AI co-pilot that acts as a supportive interviewer. Ben discusses common mistakes candidates make and the importance of clear communication in interviews. He emphasizes using AI tools for realistic practice, likening it to sports training, as well as strategies for prioritizing user needs.

Jeremy Epling, CPO of Vanta and a former VP at GitHub, shares his insights on leveraging AI for prototyping in product management. He reveals a versatile template that transformed his team’s workflow and discusses why prototypes can surpass traditional product requirement documents. Jeremy conducts a live demo of Vanta’s AI agent and talks about the evolving roles of product managers. He emphasizes the significance of cross-disciplinary relationships and offers practical advice for navigating today's tech landscape.

Meng To, the founder of Aura, specializes in leveraging AI for innovative design, steering clear of generic outputs. He delves into effective prompting techniques and discusses the importance of blending AI with personal creativity. Listeners will learn about crafting unique landing pages, incorporating testimonials, and using animation tools like Spline. Meng emphasizes the significance of manual adjustments alongside AI automation to produce stunning, customized designs. His insights provide a roadmap for designers eager to enhance their creative processes.