A/B Test Significance calculator.

Determine if your A/B test results are statistically significant or just random noise.

Control Group (Original)

Visitors Conversions

Conversion Rate

3.00%

Variant Group (Test)

Visitors Conversions

Conversion Rate

3.70%

Not Significant Yet

At 94.83% confidence, there is not enough data to prove the variant is different. Keep testing.

Observed Lift

+23.33%

Confidence Level

94.83%

Understanding the Math

This calculator uses a two-tailed Z-test to determine statistical significance. We typically look for a confidence level of 95% or higher (p-value < 0.05) before declaring a winner. This means there is less than a 5% chance the result occurred by random luck.

Frequently Asked Questions

Statistical significance tells you how likely it is that the difference between your control and variant is a real effect rather than random chance in who happened to visit and convert. Marketers typically require at least 95% confidence (a p-value below 0.05) before declaring a winner, meaning there is less than a 5% chance the observed gap is just noise.

Know your number. Now see the rest.

Import a campaign export and every metric lands against the benchmark for your industry and channel.

Get started free Browse the library

Invite-only right now · 14-day free trial when you join