AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Implementing persistent holdouts is recommended as an ongoing assessment of the overall marketing efficacy program. This approach helps determine whether the marketing efforts are delivering incremental results or not. By setting a constant holdout and analyzing the data, businesses can understand the true ROI of their campaigns. While it might not be feasible for all companies, having a regular cadence of performing tests, whether quarterly or monthly, is encouraged. A regular check-in on the marketing program helps identify areas for improvement and optimization. It is important to keep the methodology simple, specific, and focused on the most important lower-funnel key performance indicators (KPIs) like sales, revenue, or profitability. Recycling holdouts at a quarterly or annual frequency is recommended, considering market dynamics and the life cycle of the product or service. While implementing persistent holdouts can be more challenging for brand campaigns and non-targetable channels such as linear TV or podcasts, approaches like marketing mix modeling (MMM) can provide insights into incrementality. Overall, the goal is to strive for measurement methodologies that derive the causal impact of ads, understand the true efficacy of the marketing program, and continuously improve.