How communicating the impact of a recurring gift can increase conversion with new visitors Experiment ID: #18659

Billy Graham Evangelistic Association

Experiment Summary

Timeframe: 9/1/2019 - 11/1/2019

On the BGEA primary donation page, we hypothesized that adding a line of copy communicating the impact of a recurring gift at the point of a person’s gift decision may influence a person’s decision to change their one-time gift to a recurring gift. No other elements were changed to the giving process. 

Research Question

Can we increase recurring giving by  communicating the impact of a recurring gift at the point a person decides on the kind of gift to give?

Design

C: Control
T1: Recurring gift value prop

Results

Treatment Name Conv. Rate Relative Difference Confidence
C: Control 1.5%
T1: Recurring gift value prop 2.2% 48.4% 99.6%

This experiment has a required sample size of 2,675 in order to be valid. Since the experiment had a total sample size of 11,494, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 48.4% increase in conversion rate
× 0% increase in average gift

Key Learnings

What we found is that the additional language on the gift type had no impact overall. But when we started looking into the different kind of traffic, the story was much different. For new donors to the BGEA website, this additional value proposition language increased recurring giving by 48%! At the same time, the added copy actually caused a decrease in recurring giving for returning visitors. This is a fascinating discovery in understanding the different motivations of site visitors. New people to the site needed that extra reminder and reinforcement that their gift could go so much further. 


Experiment Documented by...

Courtney Gaines

Courtney is the Senior Director of Optimization at NextAfter. If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.