Date Added: December 7, 2018Research Partner: Dallas Theological SeminaryElement tested: Advertising
DTS launched a new online course on the books of Jonah & Ruth. They tested two forms of creative for the Facebook ad- one that had contrasting colors and one that was more simple with brighter white letters. They wanted to see which ad performed better in terms of course conversions. Copy remained the same on both.
Date Added: December 7, 2018Research Partner: Care NetElement tested: Email Sender, Email Subject Line
We wanted to see which subject line would perform better during a calendar year end campaign. One that had an element of mystery and alarm or one that was very personal and short, like something a friend would send.
Date Added: December 4, 2018Research Partner: Leadership InstituteElement tested: Advertising
Leadership Institute sought to acquire as many email addresses as possible from their flagship news site, CampusReform.org. They had put email acquisition offers on the site through "sticky bars" and sought to optimize both through testing and optimization on both desktop and mobile. They had tested to a sticky bar that appeared when someone scrolled through 25% of the page at the bottom of the page. They hypothesized that this might be interrupting the user experience too much on mobile, as the content removed their ability to scroll down. They decided to test placement—from the current "bottom anchored" bar to the "top anchored" bar.
Date Added: December 4, 2018Research Partner: Focus on the FamilyElement tested: Donation Page Headline, Donation Page Copy
Focus on the Family offers a free video series for couples on a variety of topics. One of the topics is about how to better cherish your spouse. They sent people to sign-up for this video series through many different channels. After a person signs up for the series, they are immediately given an instant donation ask on the confirmation page. In reviewing the original instant donation page, we hypothesized that a radical redesign - one that focused on the value proposition and how it was presented - might increase donor conversion. To test this, we rewrote the copy on the page, put them in numbered steps, and asked for a specific gift amount attributing the amount back to what it would help do. We then tested this version against the control over four weeks to see the results.
Date Added: December 4, 2018Research Partner: Focus on the FamilyElement tested:
Focus on the Family offers a free video series on a variety of topics for couples. One of the video series is about how to better cherish your spouse. In an effort to offer this video series to people and acquire new names to the organization, they used paid Facebook ads. Through significant testing we have found that longer, conversational style ads can increase conversion and decrease acquisition cost. We used this approach as our control and tested a shorter form ad against it. No other elements changed on the ad.
Date Added: December 4, 2018Research Partner: CRISTA MinistriesElement tested: Advertising
World Concern offers a Global Gift Guide that offers people the opportunity to give practical gifts like goats, water, medicine, etc. to people living in poverty. On the Global Gift Guide homepage, they give people the option to give a gift. We hypothesized that expanding the value proposition of the ask might motivate more people to want to give and increase conversion. We added value proposition to the headline and the body copy to test the impact that value proposition would have on conversion.
Date Added: November 21, 2018Research Partner: Care NetElement tested: Advertising
Last year, one of our most successful ads was for our free Advent Devotional. This year, when we launched the ads we decided to test a new headline. In experiment #6574, we tested a clear CTA headline vs a question based headline and the CTA decreased conversion 47%. However, our control headline for Advent was a time-sensitive question, "Are you ready for Advent." We wanted to know if the clear CTA would perform better than a season, time-sensitive headline like we used last year.
Date Added: November 18, 2018Research Partner: Focus on the FamilyElement tested: Donation Page Copy, Donation Page Form
Focus on the Family had found great success with presenting a popup on their donation pages at the moment of a person's transaction with an opportunity to turn their one-time gift into a recurring gift. This pop-up had resulted in a 64% increase in recurring gifts on their primary donation page. This has significant revenue opportunities for Focus on the Family. That said, we looked at the pop-up and hypothesized we might be able to increase motivation and conversion even more if we communicated the value proposition around the benefits. To do this, we extended the benefits section of the pop-up to communicate what the specific benefits would do for the end user.
Date Added: November 18, 2018Research Partner: CaringBridgeElement tested: Engagement
CaringBridge sought to increase engagement on their site by increasing the number of comments on journal posts. Not only did a comment increase the likelihood that someone would return, it actually provided a positive boost to the patient or author as well who was writing the journal. Their standard comment functionality just said "comments", and didn't have a true call to action. While someone could scroll to read the comments and there was a box, there was no incentive for them to actually leave a comment at the end of the post. The team developed two treatments: one that provided an "informative fact" that told them what the end result of the comment was to the reader: "Did you know? A quick comment, no matter the situation (positive or negative), shows your support". This was designed to encourage people to comment regardless of the news. Their second treatment was designed to get people into the comments, using the language "See comments", and then implicitly encouraged them to "Show [their] love and support" by doing the same. They launched the two treatments in an A/B/C test, monitoring
Date Added: November 18, 2018Research Partner: EWTNElement tested: Advertising
The Catholic News Agency website get significant traffic to their article pages. In an effort to convert some of these website visitors into donors, we hypothesized that putting a contextualized donation ask at the end of the article might motivate people to make a donation. To do this, we created a "Dear Reader" feature at the end of the article with a link to CNA's donation page. We tested this against not having a contextualized donation ask at the end of the article, but kept the "Donate Now" button at the top of the navigation. We did a 50/50 split test.