Sub Club by RevenueCat cover image

Why You Should Test Everything and How To Do It — Osman Mansur, Duolingo

Sub Club by RevenueCat

NOTE

Duolingo Does an A/B Test for Every Feature

Duolingo tests every feature by running A/B tests, regardless of the scale or expected result. Even small backend changes are tested as A/B tests to ensure there are no regressions or impacts on other parts of the app. The company has a strong in-house data infrastructure and experimentation team that built tools for engineers to set up A/B tests. PMs monitor the experiments using the in-house tool and generate reports on the new data every day. Duolingo avoids running multiple tests on the same area simultaneously and checks for any weird effects when multiple experiments intersect. On iOS and Android, different experiments are often run on the same area with the goal of aligning for platform parity based on the winning result.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner