Scenario 1: Significant Improvement
Control Group Impressions: 10,000; Control Group Conversions: 500; Test Group Impressions: 10,000; Test Group Conversions: 600
Test Group Conversion Rate: 6 %; Control Group Conversion Rate: 5 %; Conversion Rate Difference: 1 %
Scenario 2: Slight Improvement
Control Group Impressions: 10,000; Control Group Conversions: 500; Test Group Impressions: 10,000; Test Group Conversions: 520
Test Group Conversion Rate: 5.2 %; Control Group Conversion Rate: 5 %; Conversion Rate Difference: 0.2 %
Scenario 3: No Change
Control Group Impressions: 10,000; Control Group Conversions: 500; Test Group Impressions: 10,000; Test Group Conversions: 500
Test Group Conversion Rate: 5 %; Control Group Conversion Rate: 5 %; Conversion Rate Difference: 0 %