How advertising imagery affected the clarity of the value proposition Experiment ID: #4952

Buckner International

Buckner International is a global ministry dedicated to the transformation and restoration of the lives we serve. We are a Christ-centered organization that delivers redemptive ministry to the most vulnerable from the beginning to the ending of life.

Experiment Summary

Timeframe: 8/22/2016 - 8/31/2016

As part of their Shoes for Orphans Souls campaign, Buckner International created a 7-day digital devotional. The e-book guided individuals in prayer as a means to lift up orphans and other vulnerable children.

As part of the advertising for this campaign, we created Facebook ads to drive visitors to a conversion-focused email acquisition page. For similar organizations, past experiments had proven that showing a 3D version of the guide would produce the best response but with the topic of orphans and vulnerable children, we had a hypothesis that images of kids would provoke a better response. We created multiple versions of this ad and tested it across multiple audiences

Research Question

Which ad will produce the highest motivated visitors resulting in the highest conversion rate?

MECLABS Conversion Factors Targeted

C = 4m + 3v + 2( i - f) - 2a ©

Copyright 2015, MECLABS

Design

C: Book Cover
T1: Black & White Image
T2: Color Image

Results

Treatment Name Conv. Rate Relative Difference Confidence
C: Book Cover 0.21%
T1: Black & White Image 0.41% 94.4% 100.0%
T2: Color Image 0.43% 101.3% 100.0%

This experiment has a required sample size of 9,798 in order to be valid. Since the experiment had a total sample size of 101,032, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 101.3% increase in conversion rate
× 0% increase in average gift

Key Learnings

The ads that focused on the images of children had nearly double the email acquisition rate as the ad that just focused on the guide. Our hypothesis is that the images of children served as a reminder of why the prayers were needed whereas the guide was just what would be given. By answering the “why” first, the visitors were more motivated to download the devotional.

The visual aspect of black and white versus color did not seem to make any significant difference.


Share this research with a colleague

Our mission is to help elevate the field of fundraising by openly sharing our research and inspiring a wider community of testing and optimization. If you have found our research to be helpful, insightful, or even just interesting—please share it with a fellow fundraiser.





Get the Detailed Case Study

Get a copy of the slides that highlight the different elements of the experiment, the variables that were changed, and the key takeaways and learnings that you can apply to your own organization.


Pick your format of choice:


Experiment Documented by...

Kevin Peters

Kevin is a Senior Vice President at NextAfter. If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.