How premium-specific donation page copy affects donor conversion Experiment ID: #7732
Founded in 1844, Hillsdale College is an independent liberal arts college with a student body of about 1,400. Hillsdale’s educational mission rests upon two principles: academic excellence and institutional independence. The College does not accept federal or state taxpayer subsidies for any of its operations.
Timeframe: 10/11/2017 - 10/26/2017
Hillsdale College was looking for a new way to enhance the experience of those who sign up to take ‘Constitution 101,’ while increasing donor conversion on the ‘Constitution 101’ donation page.They know that the The U.S. Constitution: A Reader is a helpful guide to students looking to get the most out of this course. They wondered: Can we increase donor conversion by adding more specific language about the benefits of The U.S. Constitution: A Reader. They created a treatment and launched a test to find out.
Will focusing more specifically on The U.S. Constitution: A Reader increase donor conversion on the ‘Constitution 101 Thank You!’ page?
|Treatment Name||Conv. Rate||Relative Difference||Confidence|
This experiment has a required sample size of 1,251 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Hillsdale College found that this treatment version did not significantly increase or decrease donor conversion on the ‘Constitution 101’ donation page. It’s apparent that this change in language was not dramatic enough to change the actions of the page visitor. Even though this test wasn’t statistically valid, we can still look at the trend of the test results for clues. We see that the donation page copy that focused more heavily on the premium offer, rather than the value proposition of Hillsdale College, was actually experiencing a lower conversion rate. This is interesting to remember as we develop more tests with donation pages that contain a premium offer.