How an image in a Facebook ad affects name conversion rate
The Missionary Oblates of Mary Immaculate
The Missionary Oblates of Mary Immaculate are a Roman Catholic congregation of priests and brothers founded after the French Revolution by St. Eugene De Mazenod to work among the poor. Today there are nearly 4,000 missionaries working in more than 60 countries around the world.
Experiment Summary
Timeframe: 08/28/2017 - 09/05/2017
The Missionary Oblates launched a Facebook campaign to promote their new offer, the 7 Days of Prayer. They launched the test with an illustrated image of the seven day prayers with a cross. Illustrated images have traditionally performed well with their Facebook audience, but they wanted to test an image of a woman praying to see if it would increase conversion due to the congruency to the offer. Copy and all other elements were the same.
Research Question
Does an image that aligns more closely with the offer perform better than an illustrated image with copy?
Design
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | 7 day prayer image | 2.1% | ||
| T1: | Lady praying | 1.1% | -49.2% | 100.0% |
This experiment has a required sample size of 1,328 in order to be valid. Since the experiment had a total sample size of 523,081, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 49.2% decrease in conversion rate
× 0% increase in average gift
Key Learnings
The image of the woman praying decreased conversion rate by nearly 50%. This tells us that the illustrated images, that have traditionally performed well for these offers, should continue to be a best practice for all offers moving forward. In addition, the copy on the image reinforces the value proposition of the offer and what they are getting.