Season 2, Episode 5: How to measure a marketing campaign (with Olivia Kory)
Dec 6, 2023
auto_awesome
Olivia Kory, Head of Go-To-Market at Haus and former senior marketing roles at Netflix, Quibi, and Sonos, discusses the role of causal inference in marketing measurement, skill set gaps in transition to probabilistic measurement, challenges faced by marketing teams, and the concept of probabilistic measurement for non-marketing teams. They also explore challenges in measuring marketing campaigns, understanding app store search prioritization and ad targeting, and the shift to probabilistic attribution in marketing. Olivia shares her experience transitioning to a measurement company and the impact of leading on incrementality work.
Causal inference allows marketers to determine the true impact of their interventions and understand the effectiveness of their marketing efforts in terms of cost per acquisition and channel performance.
Transitioning to probabilistic measurement requires overcoming skill set gaps, educating finance teams about the benefits of probabilistic measurement, and having data science and analytical resources in place.
Deep dives
The Role of Causal Inference in Marketing Measurement
Causal inference is a scientific method used in marketing measurement. It aims to establish a cause-effect relationship by creating conditions for experiments. Unlike traditional attribution models based on correlation, causal methods focus on determining the actual impact of interventions or treatments on desired outcomes, such as sign-ups or app downloads. Causal inference provides insights into the effectiveness of marketing efforts, revealing the true cost per acquisition and uncovering the channels that deliver the best results. It helps businesses understand the true value of their marketing efforts and make more informed decisions.
Challenges in Transitioning to Probabilistic Measurement
Transitioning to probabilistic measurement for marketing teams comes with several challenges. Skill set gaps commonly arise when companies adopt probabilistic measurement, particularly in understanding and embracing the concept of incrementality. Educating finance teams about the limitations of traditional attribution models and the benefits of probabilistic measurement is critical for driving successful transitions. Additionally, having the necessary data science and analytical resources is crucial for implementing and utilizing probabilistic measurement effectively. Overcoming internal barriers, such as siloed structures and competing stakeholder interests, is essential for organizations to fully embrace and integrate probabilistic measurement into their marketing workflows.
The Shift in Marketing Workflow and the Importance of Creative
As organizations transition to probabilistic measurement and adopt a more data-driven approach, marketing workflows undergo significant changes. The focus shifts away from day-to-day tactical optimizations and towards a more structured, experiment-driven approach. Rather than running different campaigns every month, marketing teams prioritize continuous testing and optimization. Creative plays a crucial role in this new paradigm, as it becomes the primary driver of tangible performance improvements. Teams need to invest in diverse and impactful creative concepts that both capture audience attention and exclude irrelevant segments. The role of creative becomes pivotal in driving results and optimizing marketing strategies.
From Marketing Operator to Measurement Vendor
Olivia Corey, now working at House, made the transition from being a marketing operator to working at a measurement vendor due to her experience leading incrementality work at Sonos. Seeing the impact and progress made in collaboration with finance partners and witnessing the challenges arising from privacy changes in the industry, she realized the increasing need for businesses to adopt the Netflix model of probabilistic measurement. Olivia recognized the critical role of building in-house systems to validate ad platform results and the importance of embracing a more holistic approach to measurement. The transition highlights the growing significance of measurement in marketing and its potential to drive business success.
My guest on this episode is Olivia Kory, the Head of Go-To-Market at Haus, a marketing decision science platform. Before Haus, Olivia held senior marketing roles at Netflix, Quibi, and Sonos.
Olivia and I discuss a wide range of topics within the subject of advertising measurement in this episode, including:
The role of causal inference in marketing measurement;
The common skillset gaps that Olivia witnesses when observing companies making the transition to probabilistic measurement;
The unforeseen challenges in transitioning to probabilistic measurement for marketing teams;
The amount of coaching required for the non-marketing teams within the organization to socialize the concept of probabilistic measurement.
Olivia leads customer support, marketing, and partnerships at Haus, which is productizing incrementality, experimentation, and econometrics to help brands quantify marketing ROI. Before Haus, Olivia was the Director of Growth Marketing at Sonos and has held marketing positions at Quibi and Netflix.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode