How a lowered and reversed gift array impacts monthly donations
Reasons to Believe
Experiment Summary
Timeframe: 10/05/2023 - 10/13/2023
For Reason to Believe’s Monthly Partner campaign, we hypothesized that adjusting the gift array to better align with their monthly ask would increase recurring gifts. In the control, users are primed on the importance of a monthly gift but are met with a gift array that starts $500 and only then decreases to $50 as the lowest monthly option. Our question was whether this could exclude donors who were ready to make a monthly gift but perhaps couldn’t commit to such a large amount and would then abandon the process entirely. By lowering the gift array and reversing it, the starting amount was $10 a month. We believed this better aligned with the monthly commitment and as a result, would increase monthly donations.
Research Question
We believe that aligning the gift array with a monthly ask for donors will achieve an increase in recurring gifts because this array is inclusive of more donors as well as realistic to a monthly commitment..
Design
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Control | 0.00% | $101.25 | ||
| T1: | Gift Array Treatment | 10.9% | 100.0% | 99.5% | $50.63 |
This experiment has a required sample size of 29 in order to be valid. Since the experiment had a total sample size of 146, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 100.0% increase in conversion rate
× 50.0% decrease in average gift
0% increase in revenue
Key Learnings
The key learning from this experiment is that aligning the gift array with a monthly ask can significantly increase recurring donations. The treatment version, which started the gift array at $10 a month instead of $500, saw a 10.9% increase in recurring donations compared to the control version. This suggests that the previous gift array may have excluded potential donors who were ready to make a monthly commitment but couldn’t commit to such a large amount. It should be noted that the treatment not only garnered more gifts, but it received all recurring gifts in the experiment.
In future experimentation, it would be important to continue testing and refining the gift array to further optimize recurring donations. This could involve testing different price points and messaging to find the most effective combination. Additionally, it would be valuable to segment the data and analyze the impact of the treatment on different donor groups, such as new donors or existing monthly donors. This information can help tailor the gift array and messaging for different donor segments to maximize the likelihood of recurring donations.