1. A/B Testing Conversion Rates
Growth MarketerBackground
A marketing team ran an A/B test on a landing page. The control group had 45 conversions out of 100 visitors, while the variant had 60 conversions out of 100 visitors.
Problem
Determine if the variant's higher conversion rate is statistically significant or just random noise.
How to use
Input 60 successes and 100 trials for Group 1 (variant), and 45 successes and 100 trials for Group 2 (control). Keep the hypothesized difference at 0, use a two-sided alternative, and set alpha to 0.05.
Group 1 Successes: 60, Group 1 Trials: 100, Group 2 Successes: 45, Group 2 Trials: 100, Alternative: two-sided, Alpha: 0.05Outcome
The calculator outputs a Z-statistic of 2.124 and a P-value of 0.0337. Since the P-value is less than 0.05, 'rejectNull' is true, confirming the variant performs significantly better.