How an open field on a donation form affects donor conversion rate
CaringBridge offers free personal, protected websites for people to easily share updates and receive support and encouragement from their community during a health journey. Every 7 minutes, a CaringBridge website is created for someone experiencing a health event.
Timeframe: 05/14/2017 - 06/06/2017
CaringBridge had executed several tests on their main donation page and found that the motivation to give on that page was very different from their “tribute” pages, where most of their revenue came in. Their main donation page had a high average gift, and the motivation to give had proven to be much less personal and much more mission-based.
Since average gifts were high on this page, they wondered if the six-button gift array (which had beaten a three-button array in a previous test) was actually hindering average gift and conversion. The suggested gift amounts were meant to relieve decision friction—but what if they added to it?
CaringBridge decided to test this array against an “open field,” which allowed the donor to decide on their own gift amount, with a stated minimum donation of $10. They split the traffic to determine which had a greater effect on donor conversion rate.
How does an open field on a donation form affect donor conversion rate?
|Treatment Name||Conv. Rate||Relative Difference||Confidence|
This experiment has a required sample size of 226 in order to be valid. Since the experiment had a total sample size of 785, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 125.9% increase in conversion rate
× 0% increase in average gift
The treatment produced a 125.9% lift in conversion on the main donation page. This showed that the array, designed to combat decision friction, might have contributed to it. One danger in the open field treatment was that the average gift would dip without the suggested amounts to provide “anchors.” CaringBridge kept a close eye on the average gift but found no valid difference in the two forms, which meant a valid revenue increase from this test.
This prompted a series of tests to separate desktop traffic from mobile and determine the individual impact of each experience on conversion.
Question about experiment #2594
If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.