How a one-column format donation page affects donor conversion rate - NextAfter
Scouts

How a one-column format donation page affects donor conversion rate

Experiment ID: #87480

Scouts

Experiment Summary

Timeframe: 03/03/2022 - 03/26/2022

Upon reviewing the existing Boy Scouts of America donation page layout and flow, we recognized an opportunity to conduct an experiment based on previous NextAfter experiments and learnings. Based on this library of experiments, we made several significant changes to the layout of this critical donation page.

We first removed the imagery to elevate the communication priority of the reinforcing copy on the page. Next, we refined the layout from a two-column layout to a single-column format, introducing a more linear flow we believe reduces cognitive load that leads to a higher percentage of donors completing the form and making a donation. We also emphasized the perceived security of this form by boxing the payment information fields and reinforcing trust with the use of a lock icon, a web standard that most online shoppers today are familiar with.

Research Question

We believe that reformatting the existing two-column donation form page layout to a single column for potential donors will reduce cognitive friction, increasing focus and improving donor conversion rate.

Design

C: Control
T1: One-column Donation Page

Results

  Treatment Name Conv. Rate Relative Difference Confidence Average Gift
C: Control 22.7% $0.00
T1: One-column Donation Page 51.4% 126.3% 98.0% $0.00

This experiment has a required sample size of 22 in order to be valid. Since the experiment had a total sample size of 57, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 126.3% increase in conversion rate
× 0% increase in average gift

Key Learnings

The redesigned single-column donation page layout produced a 126% lift in donor conversion rate. This experiment shows us that the single-column form layout reduces user friction, introducing a more linear user journey that produced a much more likely positive donation outcome.

This provides many future opportunities for experimentation for BSA, demonstrating conclusively that relatively simple to execute form optimizations can measurably reduce friction and increase donor conversion.

Additional observations of the impact of this experiment show that this CVR was improved across all core visitor segments:

  • Organic Search visitors had a 312.5% increase in donations with a 100% level of confidence.
  • Mobile visitors had a 414.3% increase in donations with a 97% level of confidence.
  • New visitors had a 108.0% increase in donations with an 89% level of confidence.
  • Returning visitors had a 180.0% increase in donations with a 90% level of confidence.
  • Referral visitors had a 40.0% increase in donations with a 93% level of confidence.


Experiment Documented by NextAfter

Question about experiment #87480

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.