We talk misleading metrics with Mike Menkes of Analytic Partners, NY
Aug 19, 2023
auto_awesome
Mike Menkes, analytics expert specializing in marketing metrics, discusses the pitfalls of exposure and impact metrics, challenges of ROI metrics in marketing, the connection between radio ads and conversions, market mix modeling as a diagnostic and prescriptive method, and the risks of misleading metrics in business.
Exposure metrics measure the number of individuals or households exposed to an ad, while impact metrics analyze the impact of these exposures on business performance.
Misunderstanding and misuse of impact metrics often lead to inaccurate business decisions and ineffective allocation of advertising budgets.
Deep dives
Understanding Exposure Metrics and Impact Metrics
In this podcast episode, Mike Menkes from Analytic Partners discusses the difference between exposure metrics and impact metrics in tracking effectiveness. Exposure metrics focus on measuring the number of individuals or households exposed to an ad, while impact metrics analyze the impact of these exposures on business performance. It is important to note that exposure metrics are generally better understood in the industry compared to impact metrics, which can be more complex and misleading. Organizations should focus on understanding the various metrics, how they are created, and their reliability to make informed decisions.
The Pitfalls of Misleading Impact Metrics
Mike Menkes highlights the challenges and pitfalls associated with impact metrics. Many metrics in the industry lack transparency and are often misleading. Metrics like ROI and ROAS are commonly misunderstood and misused. Metrics that solely rely on user-level data tend to overstate the impact of clickable activities and overlook the influence of offline marketing, non-clickable actions, and other external factors such as competition and seasonality. The lack of understanding and misuse of impact metrics often leads to inaccurate business decisions and ineffective allocation of advertising budgets.
The Role of Econometrics and Market Mix Modeling
Econometrics and market mix modeling play a crucial role in understanding the complex dynamics of marketing effectiveness. These methods collect and analyze data across different channels, regions, and factors to measure the impact of various marketing activities. They go beyond user-level data and take into account non-addressable media, offline sales, and non-marketing factors. By adopting a comprehensive and customer-centric approach, organizations can gain valuable insights into the performance of different marketing channels, optimize their investments, and achieve their business goals.
The Importance of Reliable Data and Asking the Right Questions
To maintain the integrity of analytics and ensure the validity of metrics, it is crucial to source reliable data and regularly update it based on privacy regulations and data partnerships. Analytic partners like Analytic Partners work with their customers to ensure the data used represents their business accurately. It is also essential for leaders and decision-makers to ask the right questions about the source, quality, and methodology behind the metrics they encounter. Relying solely on silo metrics can lead to significant losses in advertising investments, highlighting the importance of understanding and utilizing comprehensive analytics methodologies.