How an optional phone number field impacts donor conversion Experiment ID: #6086

Hillsdale College

Founded in 1844, Hillsdale College is an independent liberal arts college with a student body of about 1,400. Hillsdale’s educational mission rests upon two principles: academic excellence and institutional independence. The College does not accept federal or state taxpayer subsidies for any of its operations.

Experiment Summary

Timeframe: 1/17/2017 - 2/8/2017

Hillsdale College was looking for ways to continue to improve their donation page. One of the factors that potentially hindered donor conversion is the friction associated with filling out the donation form. In an effort to reduce that friction, we decided to see if removing the phone number field would increase the likelihood of a visitor to make a gift. This field was already optional but the hypothesis was that by simply having this field as an option, it created mental friction in the mind of the visitor.

Research Question

Will removing the optional phone number field increase donor conversion?

MECLABS Conversion Factors Targeted

C = 4m + 3v + 2( i - f) - 2a ©

Copyright 2015, MECLABS

Design

C: With Phone Number
T1: No Phone Number

Results

Treatment Name Conv. Rate Relative Difference Confidence
C: With Phone Number 11.8%
T1: No Phone Number 11.6% -1.6% 16.6%

This experiment has a required sample size of 215,825 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.

Key Learnings

After running for two weeks, we were able to determine that the phone number field did not add a significant level of friction to the donation process. This is actually great news for the college since they are starting up a phone program and collecting donor phone numbers is now becoming a priority. It is good to know that donor conversion does not suffer by simply having it available.


Share this research with a colleague

Our mission is to help elevate the field of fundraising by openly sharing our research and inspiring a wider community of testing and optimization. If you have found our research to be helpful, insightful, or even just interesting—please share it with a fellow fundraiser.






Experiment Documented by...

Kevin Peters

Kevin is a Senior Vice President at NextAfter. If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.