The Heritage Foundation

How including a button in an appeal email affects email click-through rates for non-members

Experiment ID: #198892

The Heritage Foundation

Experiment Summary

Ended On: 08/01/2025

The Heritage Foundation conducted this experiment as part of their President’s Challenge matching gift campaign. This campaign was designed to drive donor engagement by offering a limited-time opportunity to double the impact of a donor’s gift through a matching challenge. The email in question was the first send in the campaign sequence, making it a high-leverage moment for influencing donor behavior and maximizing initial response rates.

Given the high stakes of the campaign’s early momentum and the importance of clearly communicating the match opportunity, the Heritage Foundation sought to test whether different call-to-action (CTA) formats would affect click-through and conversion rates.

The test was deployed via email, targeting the Heritage Foundation’s non-member list.

Both versions of the email—control and treatment—were linked to the same donation landing page but differed in their CTA presentation.

The experiment was driven by a hypothesis rooted in behavioral and conversion rate optimization principles: a visually prominent, action-oriented button might outperform a plain-text hyperlink in driving user action.

Key motivations included:

  • Improving clarity and visibility of the CTA: While the raw URL in the control version is technically functional, it lacks the immediate visual weight and action language of a button. The team suspected that this might cause the CTA to be overlooked or feel less urgent.
  • Reducing cognitive friction: A clear, concise button like “Double My Gift” directly mirrors the donor’s intent and may simplify decision-making.
  • Encouraging mobile-friendly design: Buttons often perform better on mobile devices where touch interaction is key, and plain-text links can be harder to tap.

This test is a good example of using micro-optimizations in email fundraising design to explore how seemingly small changes can have an outsized effect on user behavior and conversion rates.

Research Question

We believe that using a visually prominent, action-oriented button that says “Double My Gift” will increase email click-through rate because it draws more attention than a plain-text hyperlink, creates a clearer and more compelling call to action, and reduces friction by making the next step more obvious and easier to complete.

Design

C: Control
Array ( [0] => Array ( [ID] => 720115 [id] => 720115 [title] => Control.png [filename] => Control-166.png [filesize] => 175478 [url] => https://www.nextafter.com/wp-content/uploads/Control-166.png [link] => https://www.nextafter.com/experiments/how-including-a-button-in-an-appeal-email-affects-email-click-through-rates-for-non-members/attachment/control-png-10907/ [alt] => [author] => 0 [description] => [caption] => [name] => control-png-10907 [status] => inherit [uploaded_to] => 720108 [date] => 2025-08-01 15:33:35 [modified] => 2025-08-01 15:33:35 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1338 [height] => 597 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-166-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Control-166-300x134.png [medium-width] => 300 [medium-height] => 134 [medium_large] => https://www.nextafter.com/wp-content/uploads/Control-166-768x343.png [medium_large-width] => 640 [medium_large-height] => 286 [large] => https://www.nextafter.com/wp-content/uploads/Control-166-1024x457.png [large-width] => 640 [large-height] => 286 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Control-166.png [1536x1536-width] => 1338 [1536x1536-height] => 597 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Control-166.png [2048x2048-width] => 1338 [2048x2048-height] => 597 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Control-166-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-166-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Control-166-50x22.png [admin-width] => 50 [admin-height] => 22 [full] => https://www.nextafter.com/wp-content/uploads/Control-166.png [full-width] => 1338 [full-height] => 597 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Control-166-372x166.png [thumb_372-width] => 372 [thumb_372-height] => 166 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-166-980x437.png [single_post_thumbnail-width] => 980 [single_post_thumbnail-height] => 437 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Control-166-32x14.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 14 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Control-166-48x21.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 21 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Control-166-64x29.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 29 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Control-166-128x57.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 57 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Control-166-122x54.png [thumb_122_67-width] => 122 [thumb_122_67-height] => 54 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Control-166-153x68.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 68 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Control-166-130x58.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 58 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Control-166-232x104.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 104 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Control-166-544x243.png [thumb_272_325-width] => 544 [thumb_272_325-height] => 243 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Control-166-271x121.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 121 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Control-166-271x121.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 121 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Control-166-272x121.png [thumb_272_172-width] => 272 [thumb_272_172-height] => 121 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Control-166-372x166.png [thumb_372_461-width] => 372 [thumb_372_461-height] => 166 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Control-166-372x166.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 166 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Control-166-385x172.png [thumb_385_270-width] => 385 [thumb_385_270-height] => 172 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Control-166-416x186.png [thumb_416_241-width] => 416 [thumb_416_241-height] => 186 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Control-166-448x200.png [thumb_448_410-width] => 448 [thumb_448_410-height] => 200 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Control-166-896x400.png [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 400 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Control-166-574x256.png [thumb_574_382-width] => 574 [thumb_574_382-height] => 256 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Control-166-776x346.png [thumb_776_395-width] => 776 [thumb_776_395-height] => 346 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Control-166.png [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 134 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Control-166.png [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 178 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Control-166.png [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 268 ) ) [1] => Array ( [ID] => 720117 [id] => 720117 [title] => Treatment_#1.png [filename] => Treatment_1-123.png [filesize] => 149496 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [link] => https://www.nextafter.com/experiments/how-including-a-button-in-an-appeal-email-affects-email-click-through-rates-for-non-members/attachment/treatment_1-png-4068/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-png-4068 [status] => inherit [uploaded_to] => 720108 [date] => 2025-08-01 15:33:43 [modified] => 2025-08-01 15:33:43 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 953 [height] => 664 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-300x209.png [medium-width] => 300 [medium-height] => 209 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-768x535.png [medium_large-width] => 640 [medium_large-height] => 446 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [large-width] => 640 [large-height] => 446 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [1536x1536-width] => 953 [1536x1536-height] => 664 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [2048x2048-width] => 953 [2048x2048-height] => 664 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-50x35.png [admin-width] => 50 [admin-height] => 35 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [full-width] => 953 [full-height] => 664 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-372x259.png [thumb_372-width] => 372 [thumb_372-height] => 259 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-897x625.png [single_post_thumbnail-width] => 897 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-32x22.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 22 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-48x33.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 33 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-64x45.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 45 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-128x89.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 89 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-96x67.png [thumb_122_67-width] => 96 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-153x107.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 107 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-130x91.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 91 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-232x162.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 162 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-544x379.png [thumb_272_325-width] => 544 [thumb_272_325-height] => 379 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-271x189.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 189 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-271x189.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 189 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-247x172.png [thumb_272_172-width] => 247 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-372x259.png [thumb_372_461-width] => 372 [thumb_372_461-height] => 259 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-372x259.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 259 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-385x268.png [thumb_385_270-width] => 385 [thumb_385_270-height] => 268 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-346x241.png [thumb_416_241-width] => 346 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-448x312.png [thumb_448_410-width] => 448 [thumb_448_410-height] => 312 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-896x624.png [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 624 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-548x382.png [thumb_574_382-width] => 548 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-567x395.png [thumb_776_395-width] => 567 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 209 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 279 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 418 ) ) )
T1: Treatment #1
Array ( [0] => Array ( [ID] => 720115 [id] => 720115 [title] => Control.png [filename] => Control-166.png [filesize] => 175478 [url] => https://www.nextafter.com/wp-content/uploads/Control-166.png [link] => https://www.nextafter.com/experiments/how-including-a-button-in-an-appeal-email-affects-email-click-through-rates-for-non-members/attachment/control-png-10907/ [alt] => [author] => 0 [description] => [caption] => [name] => control-png-10907 [status] => inherit [uploaded_to] => 720108 [date] => 2025-08-01 15:33:35 [modified] => 2025-08-01 15:33:35 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1338 [height] => 597 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-166-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Control-166-300x134.png [medium-width] => 300 [medium-height] => 134 [medium_large] => https://www.nextafter.com/wp-content/uploads/Control-166-768x343.png [medium_large-width] => 640 [medium_large-height] => 286 [large] => https://www.nextafter.com/wp-content/uploads/Control-166-1024x457.png [large-width] => 640 [large-height] => 286 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Control-166.png [1536x1536-width] => 1338 [1536x1536-height] => 597 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Control-166.png [2048x2048-width] => 1338 [2048x2048-height] => 597 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Control-166-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-166-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Control-166-50x22.png [admin-width] => 50 [admin-height] => 22 [full] => https://www.nextafter.com/wp-content/uploads/Control-166.png [full-width] => 1338 [full-height] => 597 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Control-166-372x166.png [thumb_372-width] => 372 [thumb_372-height] => 166 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-166-980x437.png [single_post_thumbnail-width] => 980 [single_post_thumbnail-height] => 437 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Control-166-32x14.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 14 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Control-166-48x21.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 21 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Control-166-64x29.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 29 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Control-166-128x57.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 57 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Control-166-122x54.png [thumb_122_67-width] => 122 [thumb_122_67-height] => 54 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Control-166-153x68.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 68 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Control-166-130x58.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 58 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Control-166-232x104.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 104 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Control-166-544x243.png [thumb_272_325-width] => 544 [thumb_272_325-height] => 243 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Control-166-271x121.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 121 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Control-166-271x121.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 121 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Control-166-272x121.png [thumb_272_172-width] => 272 [thumb_272_172-height] => 121 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Control-166-372x166.png [thumb_372_461-width] => 372 [thumb_372_461-height] => 166 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Control-166-372x166.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 166 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Control-166-385x172.png [thumb_385_270-width] => 385 [thumb_385_270-height] => 172 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Control-166-416x186.png [thumb_416_241-width] => 416 [thumb_416_241-height] => 186 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Control-166-448x200.png [thumb_448_410-width] => 448 [thumb_448_410-height] => 200 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Control-166-896x400.png [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 400 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Control-166-574x256.png [thumb_574_382-width] => 574 [thumb_574_382-height] => 256 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Control-166-776x346.png [thumb_776_395-width] => 776 [thumb_776_395-height] => 346 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Control-166.png [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 134 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Control-166.png [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 178 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Control-166.png [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 268 ) ) [1] => Array ( [ID] => 720117 [id] => 720117 [title] => Treatment_#1.png [filename] => Treatment_1-123.png [filesize] => 149496 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [link] => https://www.nextafter.com/experiments/how-including-a-button-in-an-appeal-email-affects-email-click-through-rates-for-non-members/attachment/treatment_1-png-4068/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-png-4068 [status] => inherit [uploaded_to] => 720108 [date] => 2025-08-01 15:33:43 [modified] => 2025-08-01 15:33:43 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 953 [height] => 664 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-300x209.png [medium-width] => 300 [medium-height] => 209 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-768x535.png [medium_large-width] => 640 [medium_large-height] => 446 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [large-width] => 640 [large-height] => 446 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [1536x1536-width] => 953 [1536x1536-height] => 664 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [2048x2048-width] => 953 [2048x2048-height] => 664 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-50x35.png [admin-width] => 50 [admin-height] => 35 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [full-width] => 953 [full-height] => 664 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-372x259.png [thumb_372-width] => 372 [thumb_372-height] => 259 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-897x625.png [single_post_thumbnail-width] => 897 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-32x22.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 22 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-48x33.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 33 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-64x45.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 45 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-128x89.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 89 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-96x67.png [thumb_122_67-width] => 96 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-153x107.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 107 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-130x91.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 91 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-232x162.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 162 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-544x379.png [thumb_272_325-width] => 544 [thumb_272_325-height] => 379 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-271x189.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 189 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-271x189.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 189 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-247x172.png [thumb_272_172-width] => 247 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-372x259.png [thumb_372_461-width] => 372 [thumb_372_461-height] => 259 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-372x259.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 259 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-385x268.png [thumb_385_270-width] => 385 [thumb_385_270-height] => 268 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-346x241.png [thumb_416_241-width] => 346 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-448x312.png [thumb_448_410-width] => 448 [thumb_448_410-height] => 312 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-896x624.png [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 624 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-548x382.png [thumb_574_382-width] => 548 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123-567x395.png [thumb_776_395-width] => 567 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 209 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 279 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_1-123.png [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 418 ) ) )

Results

  Treatment Name Click Rate Relative Difference Confidence
C: Control 0.28%
T1: Treatment #1 0.40% 42.0% 100.0%

This experiment has a required sample size of 18,560 in order to be valid. Since the experiment had a total sample size of 741,549, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    42.0% increase in traffic
Ă— 0% increase in conversion rate
Ă— 0% increase in average gift

Key Learnings

The key learnings from this experiment are that using a visually prominent, action-oriented button with clear and compelling language can significantly increase click-through rates in email campaigns. In this case, the treatment with the button saying “Double My Gift” outperformed the control with a plain-text hyperlink, resulting in a 42.0% increase in clicks for all traffic. In future experimentation, it is important to continue testing different elements of email design, such as CTAs, to optimize for user engagement and conversion rates. By focusing on creating clear, visually engaging CTAs that reduce cognitive friction and make the next steps obvious and easy to complete, organizations can increase the effectiveness of their email fundraising efforts. Additionally, considering the importance of mobile-friendly design in email campaigns, using buttons rather than plain-text links can further improve user experience and drive better results.


Experiment Documented by NextAfter

Question about experiment #198892

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.