FamilyLife

How using a multi-offer campaign in Facebook affects click through rate

Experiment ID: #59638

FamilyLife

FamilyLife® has been committed to helping individuals find biblical help for their marriage and family relationships. Through the Weekend to Remember® marriage getaways, FamilyLife Today® radio broadcasts, The Art of Marriage® video event, and the many other resources and content, God has used FamilyLife to restore hope for millions of couples and transform their lives.

Experiment Summary

Timeframe: 03/15/2021 - 05/01/2021

The FamilyLife resources team asked us to take on their Facebook marketing and strategy. The first thing we wanted to test was how a multi-offer campaign that combined all of their offers into one campaign performed against campaigns that included one offer each. We tested the multi-offer campaign with four offers in it, against the four offers in individual campaigns. This test was set up as a test and learn in Facebook and ran for 6 weeks. The four campaigns had an equal combined spend with the multi-offer campaign.

 

Research Question

Combining offers into one campaign will reduce cost per click and cost per donor acquired.

Design

C: Multi-Campaign
T1: Single Campaign

Results

 Treatment NameClick RateRelative DifferenceConfidence
C: Multi-Campaign 0.40%
T1: Single Campaign 0.65%62.2% 100.0%

This experiment has a required sample size of 6,366 in order to be valid. Since the experiment had a total sample size of 1,218,852, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    62.2% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

The multi-offer campaign did increase clicks, and so increased traffic to their site, by 62%. That in turn reduced the cost per click from $1.80 to $1.30, a decrease of 28%. We hypothesis that this happened because instead of requiring Facebook to use the budgets to compete for spend in the different audiences, it allowed Facebook to serve the best offer to the best candidate in those different audiences and so allowed the Facebook algorithm to do it’s best work. That meant it had to spend less to reach the best lead.

In addition to decreasing the cost per click and increasing the click through rate, this test also increased the number of purchases by 59% and decreased the cost per acquisition by 26% taking it from $120 CPA to $89 CPA. (This data is according to the Facebook 7-day attribution window. We did not have the capability at this time to confirm this data through Google Analytics tracking.) The same hypothesis applies here. We allowed the algorithm to find the best leads through this campaign set up.


Experiment Documented by NextAfter

Question about experiment #59638

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.