How noting the specific content offer type in the subject line affects conversion
NextAfter
Experiment Summary
Ended On: 01/25/2019
In this experiment, we wondered if clarifying the type of content that the email was about in the subject line would lead to greater conversion.
Research Question
Will noting that the email is about a webinar in the subject line increase conversion rate?
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | A full year’s worth of new fundraising ideas to test | 4.5% | ||
| T1: | A full year’s worth of new fundraising ideas to test [WEBINAR] | 4.5% | -1.0% | 8.0% |
This experiment has a required sample size of 1,603,179 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Key Learnings
This change had no affect on conversion. It’s possible that it may have had a more significant effect if placed at the beginning of the subject line, rather than the end. The end of the subject line could tend to get cut off on many devices and email platforms.
Question about experiment #11511
If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.