How a tabbed form on an acquisition offer impacted monthly gifts - NextAfter
The Gospel Coalition

How a tabbed form on an acquisition offer impacted monthly gifts

Experiment ID: #90202

The Gospel Coalition

Experiment Summary

Timeframe: 03/25/2022 - 05/15/2022

Because we have found recurring donors to consistently have a higher lifetime value as well as a higher retention rate than one time donors, we wanted to identify additional ways to convert donation page visitors into recurring donors. The standard donation form control has a checkbox underneath the gift array that says “Make this a monthly gift” but our hypothesis was that asking for the gift amount first was causing friction to then commit the chosen amount as a monthly gift after the fact. We wanted to test introducing a tabbed form on an acquisition offer so we could determine if a tabbed form would have any substantial negative impact on overall giving before we tried to put this option on the main TGC donation page. We split traffic 50/50 between the two pages, making only the change to the donation form presentation of one time vs. monthly giving.

Research Question

We believe that offering a tabbed form for instant donation page visitors will achieve an increase in monthly donations.

Design

C: Control
T1: Treatment

Results

  Treatment Name Conv. Rate Relative Difference Confidence Average Gift
C: Control 0.00% $0.00
T1: Treatment 1.0% 100.0% 100.0% $0.00

This experiment has a required sample size of 382 in order to be valid. Since the experiment had a total sample size of 2,573, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 100.0% increase in conversion rate
× 0% increase in average gift

Key Learnings

The control received 0 monthly donations while the treatment received 13 monthly donations, resulting in a valid 1% increase in recurring donor conversion rate on the treatment with 99.9% level of confidence. As a result. revenue experienced a 1,352.4% increase with a 100% level of confidence. Additionally, overall donations experienced a 16.9% increase with a 100% level of confidence. On future tests, we will look for ways to highlight the value proposition for monthly giving in the body copy to continue to aim for increased recurring donors. It is important to note that we did not reach the desired minimum of 50 transactions to fully validate this test, so we will need to run this on the main donation page where we can get additional traffic and volume of conversions to know for sure if the treatment is producing a true lift.


Experiment Documented by Rebekah Josefy
Rebekah Josefy is an Optimization Director at NextAfter.

Question about experiment #90202

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.