Every A/B test on a new feature is a rollback problem for future you. Push it to half your users,...Every A/B test on a new feature is a rollback problem for future you. Push it to half your users,...
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Every A/B test on a new feature is a rollback problem for future you. Push it to half your users, then kill it, and now you're unwinding a feature people already got used to. Weight it. 20 percent on the new thing, 80 on what you trust. Slower to read, but nothing to rip out of most users' hands later.
Mo's avatar
Strong tradeoff framing. A 20/80 split limits rollback exposure, but it needs roughly 56% more total sample than a 50/50 allocation for comparable precision. Worth it when reversibility and user disruption matter more than speed to read.
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started