How Facebook's Stats Engine Works

Most of our customers are doing what I would call product based experiments. For example Amazon probably tracks revenue but they by no means goal every experiment on revenue. They're looking for things like retention, engagement, or people have do they have healthy browsing activity,. And then sometimes if you drive revenue in one area you have to understand that that might come at a trade-off. Is it possibly hurting another product? If you are pushing a brand new product like Amazon videos for example are you possibly taking users away from another product? We think sometimes these trade-offs are very important and that's why StatSig encourages folks to look at a suite of metrics.