The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
What makes an A/B test readout useful to a product team?
My preferred first page answers four questions:
What changed, and by how much?
How uncertain is the estimate?
Did an important guardrail get worse?
What decision does the evidence support, and what remains unresolved?
A result can be statistically significant and still too small to matter. An inconclusive result can still leave a meaningful gain or loss plausible. The decision needs more than a green badge.
I built an independent A/B analyzer to make these checks easier to inspect. The project includes a live demo, downloadable reports and documented limitations:
https://contra.com/p/mgoXb3qY-ab-test-analyzer-correct-p-values-power-and-fdr
If you work on product or CRO, what do you wish analysts put on the first page more often?
This is a strong framing of experiment readouts: separating signal, uncertainty, guardrails, and the actual decision keeps the team honest. The reminder that significance is not the same as usefulness is especially important.
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Trending
retrofuturism
Share your favorite designs from the past exploring the distant future. Or your own take on the aesthetic 🚀
halftone
Dots. Texture. Grain. Let's see your designs using the halftone technique.
Midjourney
Creatives are showing off what they're making with Midjourney.
colorgrade
Video editors sound off: How do you enhance the mood of your video in color grading?
Related posts
Designed and built a Framer marketing site for Matrice, clarifying its enterprise Vision AI platform, use cases, and value.
the green background feels calm
Benefits section we designed for LOAM Science. Full page here:
The numbered benefit list next to that pour shot is a strong pairing, it reads fast but still feels premium instead of like a supplement facts label. Was the illustration style a client ask, or something you pushed for to stand out from the usual gut health pages?
SOLENE Paris pt. 4
SOLENE Paris is an elevated perfume house that creates fragrances that are designed to be an everyday luxury. I developed a brand identity rooted in restraint, featuring a chic wordmark, a neutral palette, and minimalist packaging.
The bottles were designed to feel less like a display piece left untouched on a shelf, and more like something you'd toss in your handbag and cherish as part of your everyday routine. Texture and natural image shots were incorporated to make the brand feel human, effortless, chic, and lived-in. The result is a brand that feels quietly luxurious and entirely timeless. SOLENE's fragrances are the kind of staple that belong in your everyday life, not just on display.
View the full project here
so nice
