How adding specificity and exclusivity language to a subscription form in the footer impacts email acquisition rate
Reasons to Believe
Experiment Summary
Timeframe: 09/20/2022 - 10/15/2022
RTB had run previous experiments on their homepage/website footer email subscription form that did not result in any valid lifts. There were some experiments that ran as a multivariate test that did not isolate a specific variable. In an effort to increase email acquisition rate through this newsletter sign up form, we decided to hone in on the value proposition in the copy. Our hypothesis was that by being clearer in what the recipient was receiving, we would see an increase in email acquisition rate. This is because the end user would understand what is valuable about RTB’s emails instead of just signing up for another email list.
Research Question
We believe that adding specificity and exclusivity language to a newsletter sign up form will result in an increase an email acquisition among website visitors.
Design
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | Average Gift | |
|---|---|---|---|---|---|
| C: | Control | 0.41% | $0.00 | ||
| T1: | Value Copy Change | 1.5% | 258.0% | 100.0% | $0.00 |
This experiment has a required sample size of 638 in order to be valid. Since the experiment had a total sample size of 7,352, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 258.0% increase in conversion rate
× 0% increase in average gift
Key Learnings
This experiment resulted in a valid 258% lift in email acquisition rate. Our hypothesis for this experiment was confirmed in that site visitors were not clear on what they were receiving when they signed up for emails with RTB. When we provided clarity on what they were receiving and why it’s exclusive to RTB, more people were willing to subscribe to their email list.