NextAfter

How the “lowest cost per click” conversion event impacted full video promotional ad views on Facebook Ads Manager

Experiment ID: #103596

NextAfter

Experiment Summary

Ended On: 08/10/2022

As a part of the NIO Summit 2022 promotional paid advertising campaign to sell event tickets, we wanted to experiment with what kind of video conversion event would produce the best balance between impressions, reach, clicks, and full promotional video views.

Our natural thought was to promote the video ads via “reach” campaign types, but our desire as direct response marketers was to test that natural inclination against a more “direct response” like conversion event of “lowest cost per click.”

How would the video ad start and finish rates play out while balanced against clicks and reach?

Research Question

We believe that the optimizing our video ad campaign for lowest cost per click for prospective and known audiences we were targeting in our ad campaign will achieve only increase clicks, but not increase full video completion rates.

Design

C: Control

Results

 Treatment NameOpen RateRelative DifferenceConfidence
C: Control 0.09%
T1: Treatment #1 0.90%851.9% 100.0%

This experiment has a required sample size of 213 in order to be valid. Since the experiment had a total sample size of 95,573, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    851.9% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

With a 100% level of confidence, we observed that full video views on the “lowest cost per click” campaign surprisingly produced a staggering increase of full video views in the amount of +851.9% over the “reach” optimized campaigns.

It’s worth noting that we did reach 85,286 with the “reach” optimized campaign when compared to just 10,287 prospects in the “lowest cost per click” optimized campaign.

Alternatively, we did see 9.5x more clicks (+7805% increase in ad link clicks, with a 100% level of confidence) in the “lowest cost per click” optimized campaign, though.

So, to summarize — although we reached 8.2x more people with the “reach” campaign, we saw 9.5x more link clicks with the “lowest cpc” campaign (and 1.14x more “full video views” as noted in the data above) over the “reach” optimized campaign.

Ultimately, it comes down to what you value and your ultimate goal … if you’re looking to just get your video ads in front of the largest number of people — you should optimize for the “reach” event type. However, if you’re mostly interested in driving site visitors or full video views based upon who you reached, through your video campaigns — it makes sense to optimize for the “lowest cpc” event type.


Experiment Documented by Greg Colunga
Greg Colunga is Executive Vice President at NextAfter.

Question about experiment #103596

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.