AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Are You Using a Time Split Test?
The idea of doing the switchback tests, as opposed to the more traditional a b tests that or sequential testing. The granularity of distribution shifts is so small you cannot have to do them very quickly. We are working on finer grain versions of that, where it's a little bit more rsoomed in maybe we can say, circumscribe some time and space and give treatment in a little bit more precise way. It needs to be more coarse than a user level randomization in order to get something more faithful to what we really care about.