How a one-column format donation page affects donor conversion rate
Scouts
Experiment Summary
Timeframe: 03/03/2022 - 03/26/2022
Upon reviewing the existing Boy Scouts of America donation page layout and flow, we recognized an opportunity to conduct an experiment based on previous NextAfter experiments and learnings. Based on this library of experiments, we made several significant changes to the layout of this critical donation page.
We first removed the imagery to elevate the communication priority of the reinforcing copy on the page. Next, we refined the layout from a two-column layout to a single-column format, introducing a more linear flow we believe reduces cognitive load that leads to a higher percentage of donors completing the form and making a donation. We also emphasized the perceived security of this form by boxing the payment information fields and reinforcing trust with the use of a lock icon, a web standard that most online shoppers today are familiar with.
Research Question
We believe that reformatting the existing two-column donation form page layout to a single column for potential donors will reduce cognitive friction, increasing focus and improving donor conversion rate.
Design
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Control | 22.7% | |||
| T1: | One-column Donation Page | 51.4% | 126.3% | 98.0% |
This experiment has a required sample size of 22 in order to be valid. Since the experiment had a total sample size of 57, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 126.3% increase in conversion rate
× 0% increase in average gift
Key Learnings
The redesigned single-column donation page layout produced a 126% lift in donor conversion rate. This experiment shows us that the single-column form layout reduces user friction, introducing a more linear user journey that produced a much more likely positive donation outcome.
This provides many future opportunities for experimentation for BSA, demonstrating conclusively that relatively simple to execute form optimizations can measurably reduce friction and increase donor conversion.
Additional observations of the impact of this experiment show that this CVR was improved across all core visitor segments:
- Organic Search visitors had a 312.5% increase in donations with a 100% level of confidence.
- Mobile visitors had a 414.3% increase in donations with a 97% level of confidence.
- New visitors had a 108.0% increase in donations with an 89% level of confidence.
- Returning visitors had a 180.0% increase in donations with a 90% level of confidence.
- Referral visitors had a 40.0% increase in donations with a 93% level of confidence.