Free PM Tool

A/B Test Significance Calculator

Calculate if your A/B test results are statistically significant. Get p-values, confidence intervals, and power analysis.

Variant A (Control)

Conversion Rate

4.00%

Variant B (Test)

Conversion Rate

4.60%

Result

βœ… Statistically Significant

At 95% confidence β€’ p-value = 0.0365

Variant A CVR

4.00%

Variant B CVR

4.60%

Absolute lift

0.60pp

Relative lift

+15.00%

Z-score

2.091

95% CI (diff)

[0.04pp, 1.16pp]

Statistical power

55.2%

πŸ’‘ How to interpret

A statistically significant result at 95% confidence means there's less than a 5% chance the observed difference is due to random noise. If power is below 80%, your sample size may be too small to detect a real effect β€” run the test longer.

Related Tools

Want Personalized PM Coaching?

Get 1:1 coaching, live feedback, and proven strategies in our 12-week bootcamp.