Does a targeted lookalike audience convert at a higher rate than a broad lookalike audience on Meta?
Hoover Institution
Experiment Summary
Timeframe: 02/07/2025 - 02/12/2025
This experiment was conducted for the Hoover Institution, a public policy think tank dedicated to promoting ideas for a free society. The goal was to evaluate the impact of audience targeting strategies on Meta by testing a broad lookalike audience against a more targeted lookalike audience based on previous donors from economic content offers. The objective was to determine which approach would yield better cost efficiency for donor acquisition.
Research Question
We believed that using a lookalike audience based on past donors from economic content offers would improve cost efficiency in donor acquisition because the audience would be more aligned with historical donor behavior.
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | Control | 0.09% | ||
| T1: | Treatment #1 | 0.02% | -72.5% | 79.6% |
This experiment has a required sample size of 11,220 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Key Learnings
Main Takeaway
The broad lookalike audience significantly outperformed the targeted lookalike audience, achieving a lower cost per donor and a lower cost per thousand impressions (CPM). With an 80% confidence level, this suggests that Meta favored the broader audience due to the larger data set, leading to more efficient delivery and better results.Performance Metrics and Insights:
Donor Acquisition Efficiency: Cost per donor was 75% lower for the broad audience. CPM (Cost Per Thousand Impressions): The broad lookalike audience had a 22% lower CPM, indicating that it was more cost-efficient to reach potential donors.Next Steps
- Prioritize Broad Targeting: Use broad lookalike audiences when possible, as they provide better cost efficiency and leverage Meta’s optimization.
- Refine Targeted Strategies: Reserve highly targeted lookalikes for campaigns testing strategies that significantly differ from current donor acquisition efforts.
- Lower CPMs for Single Offers: Explore ways to reduce CPMs in single-offer campaigns, such as testing multiple ad sets or adjusting budget allocation to optimize for lower CPM levels (e.g., targeting $35 CPM).
Question about experiment #195475
If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.