How using Facebook’s native purchase event impact donor conversion Experiment ID: #13973

Focus on the Family

Focus on the Family is a global Christian ministry dedicated to helping families thrive. We provide help and resources for couples to build healthy marriages that reflect God's design, and for parents to raise their children according to morals and values grounded in biblical principles.

Experiment Summary

Timeframe: 3/25/2019 - 4/15/2019

Focus on the Family offers people a free video series on the topic of conflict in their marriage. This content offer is promoted through paid Facebook ads. Historically, we have optimized these campaigns based on a custom conversion we’ve set up that triggers if a person signs up for the particular content offer. This method has worked well to grow email files through paid media, but in recent months we’ve been testing a different kind of conversion goal within Facebook (a native purchase event) to see if we can not only acquire new names for the organization, but acquire new donors more effectively. The purchase conversion in Facebook optimizes the campaign for purchases/donors instead of new names. Would we be able to increase donor conversion just by the kind of conversion event used within our Facebook campaign?

Research Question

How would the kind of conversion event used in paid Facebook ads impact donor conversion?

Design

C: Conflict Series- Custom Conversion
T1: Conflict Series- Purchase

Results

Treatment Name Conv. Rate Relative Difference Confidence
C: Conflict Series- Custom Conversion 0.07%
T1: Conflict Series- Purchase 0.11% 47.0% 100.0%

This experiment has a required sample size of 58,588 in order to be valid. Since the experiment had a total sample size of 416,810, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 47.0% increase in conversion rate
× 0% increase in average gift

Key Learnings

The purchase conversion helped increased instant donor conversion by 47%! This is a significant learning and shift in the way we will set up future acquisition campaigns. The purchase conversion allowed Facebook to optimize the campaign based on people who were making a donation. When someone would make a donation, it would tell Facebook to go find more people like the donor that just gave and target them. Because the purchase conversion optimized for purchasers/donors, instead of names, we did see a slight increase in the cost to acquire a name, but the benefit of increasing donations and revenue far exceeds that metric.


Share this research with a colleague

Our mission is to help elevate the field of fundraising by openly sharing our research and inspiring a wider community of testing and optimization. If you have found our research to be helpful, insightful, or even just interesting—please share it with a fellow fundraiser.






Experiment Documented by...

Courtney Gaines

Courtney is the Senior Director of Optimization at NextAfter. If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.