Harvest Ministries

How a radical donation page redesign affects donor conversion

Experiment ID: #7301

Harvest Ministries

Harvest Christian Fellowship exists to bring Christians closer to God and to bring nonbelievers to a saving relationship with Him by showing how God's Word and faith in Him are applicable and relevant to everyday life.

Experiment Summary

Timeframe: 08/22/2017 - 08/30/2017

Harvest Ministries had a donation page that produced above-average conversion rates (at nearly 20%). However, they viewed this as an 80% failure rate, and wanted to run an experiment to optimize for donor conversion.

Their control donation page kept the same template as their website (which is common for ministries and nonprofits). This template included navigation that gave many opportunities to leave the page and take other actions. The page copy also started with a premium ask, with little value proposition language to hook the visitor.

The donation form started with radio buttons, which presented possible usability friction for the visitor. The prospective donor was then presented with the choice to make a single gift or a recurring gift, the details of which were located on another page. This introduced possible decision friction into the funnel. Next was a designation. Designations can be helpful for the organization, but research has showed that they present another decision for the user and can bring the donation process to a halt.

Next, the visitor was asked to claim their premium, and fill out the typical information and payment fields, with a question about where they engage with Harvest in the middle.

The treatment removed all the excess navigation from the page and began with a simple, clear value proposition: “Your gift helps reach the lost with the gospel of Jesus Christ”. It then unpacked the value proposition, providing evidentials to each claim of value and connecting the gift to different forms of impact. Then, it repositioned the premium as a thank-you in response to the gift, rather than the reason for the gift.

The gift array was reworked into larger buttons that were easier to click and see which amount was selected. The information and payment fields were moved to the second step of a two-step screen.

Harvest launched an A/B test to discover which donation page flow resulted in more donations and revenue.

Research Question

Will a radical redesign that removes friction and strengthens and emphasizes the value proposition increase donor conversion?

Design

C: Control

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: Control 30.9%
T1: Radical Redesign 44.7%44.8% 100.0%

This experiment has a required sample size of 97 in order to be valid. Since the experiment had a total sample size of 1,478, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 44.8% increase in conversion rate
× 0% increase in average gift

Key Learnings

The treatment page generated a 44.8% lift in donations — a big feat for a page that was already attracting highly motivated donors. This showed that some combination of all the elements of friction on the page were distracting would-be donors. It also proved that focusing on the clarity of the value proposition (rather than the incentive alone) can increase motivation to give.

This prompted a series of tests to remove more friction from the giving process and further clarify the value proposition.


Experiment Documented by Jeff Giddens
Jeff Giddens is President of NextAfter.

Question about experiment #7301

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.