How banner imagery impacts visitor engagement
Alliance Defending Freedom
Alliance Defending Freedom is an alliance-building legal organization that advocates for the right of people to freely live out their faith.
Experiment Summary
Timeframe: 03/05/2018 - 03/12/2018
Alliance Defending Freedom was quickly approaching the oral arguments date for their NIFLA case. We had done previous testing to determine the ideal messaging tactics (freedom of speech) and the ideal offer (a statement of belief). The emphasis of the campaign was shifting over to fundraising which meant that we needed to find the best way to drive traffic to both the campaign landing page and the donation page from all available channels.
One of the biggest opportunities was the ADF homepage. There was going to be a banner placed at the top of the screen promoting the campaign. The challenge with the campaign was that there was not an individual person that could serve as the “face” of the case. We had been using a “pro-life” image leading up to this point but we had the hypothesis that it did not convey the right message considering that “freedom of speech” had won out over the pro-life messaging. We decided to test a new image to see if we could get increased engagement.
Research Question
Will an image that has both an individual and is centered around freedom of speech increase engagement with the campaign?
Design
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | Original | 2.0% | ||
| T1: | Variation #1 | 3.9% | 100.6% | 99.8% |
This experiment has a required sample size of 559 in order to be valid. Since the experiment had a total sample size of 2,854, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 100.6% increase in conversion rate
× 0% increase in average gift
Key Learnings
The image we selected was of ADF lawyer Kristen Waggoner in front of the Supreme Court. While this image did not have any significant impact on the actual number of gifts to the campaign, we were able to increase traffic to the campaign landing page for people to learn more by over 100%. This goes to prove that these campaigns will gain more interest if we are able to put a face to the cause.