Insider Insights – Positive (Us) vs Negative (InProv)
Jewish Voice Ministries
Experiment Summary
Timeframe: 12/17/2015 - 12/19/2015
We were trying to see if creating a more positive spin of this week’s Insider’s newsletter would create more donations/ increase donation/visitor.
*Because this test was written internally, we did not have the ability to sign the email with Jonathan’s name. Therefore, the positive version was also written using “we” and “us” vs “I”.
Research Question
Will a positive spin, including a prayer, cause more people to donate?
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Negative version | 0.15% | $121.21 | ||
| T1: | Positive version | 0.13% | -16.3% | 34.9% | $167.92 |
This experiment has a required sample size of 175,731 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Key Learnings
We found that the number of donors was down by a very small margin, but overall brought in more revenue and had a higher revenue/visitor.
Question about experiment #2879
If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.