The Product Experience cover image

What Product People need to know about Search - Jonny Brooks-Bartlett on The Product Experience

The Product Experience

00:00

QA - What's the Difference Between Online and Offline Testing?

QA is done within the team to make sure things work, and then essentially what we call an online versus offline testing. We run these A.B. tests where we'll take 50% of users that will have the current experience, the status quo, and then 50%. And then we'll run a test where basically those two different groups will just, some of them won't even know that there's a test running because the changes will be so slight in many cases. So do the people who get the new feature, are they getting to a result that they might stream more quickly? Do they end up with more successful, more things that they actually add to a playlist or things like

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app