From A to B Exploring Velocity vs. Quality in Experimentation ft. Emma Travis
We back out here with the amazing Emma Travis to dig into 'quality vs. quantity' when it comes to experimentation programs. The conversation Ben Labay keeps trying to force, but a bit more nuance to it.
There is a time and place for quality. But there is a time and place for velocity and scaling your program up in terms of number of tests run. How do you know when to do it? And what are triggers to get you .... ahem.... From A to B.
Emma "Biscuits and Gravy" Travis joined me on this episode to go DEEP into this topic.
Emma was sick and still trooped through this episode - give her all the flowers!!!
We got into:
- When to focus on velocity vs. when to focus on ‘quality’ of experiment
- Tips on auditing your program to know if you’re too focused on quality vs. quantity
- Smart ways to focus on research when resources are limited
Timestamps:
00:00 Episode Start
3:57 Is Velocity Appropriate In Tracking Metric For Experimentation Maturity?
9:23 Velocity Increase Doesn't Always Mean A Decline In Quality
11:51 Experimentation Velocity Is Like Flying A Plane
19:19 When To Scale Velocity Vs. When To Focus On Quality
24:33 Run A Heuristic Audit Of Your Cro Program (*Bonus Points For Doing It In Miro)
28:00 What Defines "Quality" In A Test?
36:35 How Do You Communicate A Decline In Velocity Knowing You're Increasing Quality?
40:35 Good Ways To Use Ai To Help You Speed Up Research
Go follow Emma Travis on LinkedIn: https://www.linkedin.com/in/emma-travis/
Also go follow Shiva Manjunath on LinkedIn: https://www.linkedin.com/in/shiva-manjunath/
Subscribe to our newsletter for more memes, clips, and awesome content!