AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Monitoring and Guarding Metrics
This chapter emphasizes the importance of monitoring and guarding metrics during experimentation. It discusses the need for infrastructure that can provide guardrails and notify you of any negative effects on important metrics. It also introduces the concept of heterogeneous treatment effects and the significance of segmenting results to identify any bugs or issues affecting specific groups.