Buckner International

How simplifying the design and expanding the content affects revenue

Experiment ID: #11511

Buckner International

Buckner International is a global ministry dedicated to the transformation and restoration of the lives we serve. We are a Christ-centered organization that delivers redemptive ministry to the most vulnerable from the beginning to the ending of life.

Experiment Summary

Timeframe: 12/21/2014 - 12/28/2014

For their year end campaign, Online for Life used their unique process for reaching abortion-determined women and the cost that it takes to save a child as the primary value proposition. The question became how much the page needed to explain the details of the process vs. keeping it high level. We created two treatments to find out.

Research Question

A longer explanation of OFL’s unique process coupled with a simpler page design will allow donors to get a better understanding of their value proposition which will, in turn, increase the overall revenue for the campaign.

Design

C: Design Page with Shorter Copy
T1: Simple Design with Longer Copy

Results

 Treatment NameRevenue per VisitorRelative DifferenceConfidence
C: Design Page with Shorter Copy $16.06
T1: Simple Design with Longer Copy $3.51-78.2% 100.0%

This experiment was validated using 3rd party testing tools. Based upon those calculations, a significant level of confidence was met so these experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 50.5% decrease in conversion rate
× 55.9% decrease in average gift
78.2% decrease in revenue

Key Learnings

It would appear that less explanation was needed than we had originally thought. This may be the result of previous efforts to explain how OFL works or the urgency that comes with year end. In any case, we will know that less is more for future campaigns.


Experiment Documented by NextAfter

Question about experiment #11511

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.