Jews for Jesus

How personalized copy and tone in an email appeal affects donations

Experiment ID: #11622

Jews for Jesus

Jews for Jesus exists to make the messiahship of Jesus an unavoidable issue to the Jewish people worldwide, utilizing creative evangelistic methods to reach the Jewish community and spread the good news of Jesus Christ.

Experiment Summary

Timeframe: 03/08/2016 - 03/14/2016

Jews for Jesus had a process in place to convert direct mail letters to eAppeals, which they sent on a monthly basis to their email file. While this raised money and kept digital donors engaged, they hypothesized that the tone of a direct mail piece wasn’t really aligning with the medium of email.

So while keeping the value proposition of the email intact, they completely rewrote it with a conversational tone. They also stripped all the elements of branding out of the email to make it seem like it came from a person, rather than email marketing software. Finally, they inserted personalization throughout the appeal.

Then, they split-tested this with their email file, dividing it in half to make sure they could validate a result.

Research Question

Will a personal tone with personalized copy increase donation conversion rate?

Design

C: Control
T1: Treatment 1

Results

 Treatment NameConv. RateRelative DifferenceConfidence
C: Control 0.03%
T1: Treatment 1 0.12%304.8% 100.0%

This experiment has a required sample size of 6,933 in order to be valid. Since the experiment had a total sample size of 119,721, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    0% increase in traffic
× 304.8% increase in conversion rate
× 0% increase in average gift

Key Learnings

The new email produced a 304.8% increase in donation conversion rate. This provided insightful learnings about the Jews for Jesus digital donor:

  1. They want to feel like they are being personally engaged.
  2. They want to feel like the appeal is only written to them.

This is difficult to do in direct mail, but the email provides many great ways to personalize communications. This points a way forward for all emails to be “high-touch”.


Experiment Documented by Jeff Giddens
Jeff Giddens is President of NextAfter.

Question about experiment #11622

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.