How the length of page copy affects donor conversion - NextAfter
Texas State Historical Association

How the length of page copy affects donor conversion

Experiment ID: #1956

Texas State Historical Association

Experiment Summary

Timeframe: 07/15/2015 - 08/30/2015

TSHA’s standard membership form utilized a long version of copy in order to fully explain the mission of the organization, the history, and the associated benefits of becoming a member. There was a hypothesis that this long copy may actually be turned off potential members due to the amount of friction it introduced into the process.

We decided to create a new version of the page that would dramatically reduce the copy in order to validate this hypothesis.

Research Question

Does a shorter version of copy reduce page friction enough to increase donor conversion?

Design

C: Long Copy
T1: Short Form

Results

  Treatment Name Conv. Rate Relative Difference Confidence Average Gift
C: Long Copy 5.2% $51.60
T1: Short Form 5.2% 0.5% 1.6% $62.00

This experiment has a required sample size of 5,597,714 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.

Key Learnings

The two landing pages had nearly identical conversion rates and there was no statistically significant difference between the average gift amounts. This result supports the conclusion that the length of copy on the page is not a significant factor in the overall conversion of the page.

In the future, it would be recommended that we need to find ways to add value for the potential member through different value propositions, incentives, and other page elements.


Experiment Documented by NextAfter

Question about experiment #1956

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.