How the length of page copy affects donor conversion
Texas State Historical Association
Experiment Summary
Timeframe: 07/15/2015 - 08/30/2015
TSHA’s standard membership form utilized a long version of copy in order to fully explain the mission of the organization, the history, and the associated benefits of becoming a member. There was a hypothesis that this long copy may actually be turned off potential members due to the amount of friction it introduced into the process.
We decided to create a new version of the page that would dramatically reduce the copy in order to validate this hypothesis.
Research Question
Does a shorter version of copy reduce page friction enough to increase donor conversion?
Design
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Long Copy | 5.2% | $51.60 | ||
| T1: | Short Form | 5.2% | 0.5% | 1.6% | $62.00 |
This experiment has a required sample size of 5,597,714 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Key Learnings
The two landing pages had nearly identical conversion rates and there was no statistically significant difference between the average gift amounts. This result supports the conclusion that the length of copy on the page is not a significant factor in the overall conversion of the page.
In the future, it would be recommended that we need to find ways to add value for the potential member through different value propositions, incentives, and other page elements.