Dallas Theological Seminary

How a time-sensitive value proposition affects conversion rate for donors

Experiment ID: #4998

Dallas Theological Seminary

Experiment Summary

Timeframe: 09/09/2016 - 09/20/2016

Dallas Theological Seminary was running a fundraising campaign for North Texas Giving Day.They had previously tested into a value proposition centered around their mission: growing the kingdom. However, they wanted to test to see if a very time-sensitive specific matching challenge ask would be a greater motivator for donors and nondonors. Since the two segments had different levels of affinity and motivation, they wanted to test them separately. They created a treatment page and showed it to both donors and nondonors independently, with a 50-50 split to try to determine which value proposition was a greater motivator for this specific campaign.

Research Question

Will a matching challenge ask outperform a general value proposition ask during a time sensitive campaign for a donor segment?

Design

C: Teach Truth
Array ( [0] => Array ( [ID] => 13076 [id] => 13076 [title] => Teach_Truth.png [filename] => Teach_Truth.png [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [link] => https://www.nextafter.com/experiments/how-a-time-sensitive-value-proposition-affects-conversion-rate-for-donors/attachment/teach_truth-png/ [alt] => [author] => 6 [description] => [caption] => [name] => teach_truth-png [status] => inherit [uploaded_to] => 13075 [date] => 2021-02-25 05:25:36 [modified] => 2021-02-25 05:25:36 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1440 [height] => 2284 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-189x300.png [medium-width] => 189 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-768x1218.png [medium_large-width] => 640 [medium_large-height] => 1015 [large] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-646x1024.png [large-width] => 640 [large-height] => 1014 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-968x1536.png [1536x1536-width] => 968 [1536x1536-height] => 1536 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-1291x2048.png [2048x2048-width] => 1291 [2048x2048-height] => 2048 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [tp-image-grid-width] => 441 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-32x50.png [admin-width] => 32 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [full-width] => 1440 [full-height] => 2284 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-372x590.png [thumb_372-width] => 372 [thumb_372-height] => 590 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-394x625.png [single_post_thumbnail-width] => 394 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-81x128.png [thumb_128_128-width] => 81 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-42x67.png [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-96x153.png [thumb_153_153-width] => 96 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-103x163.png [thumb_130_163-width] => 103 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-112x177.png [thumb_232_177-width] => 112 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-410x650.png [thumb_272_325-width] => 410 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-218x346.png [thumb_271_346-width] => 218 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-171x271.png [thumb_271_271-width] => 171 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-108x172.png [thumb_272_172-width] => 108 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-291x461.png [thumb_372_461-width] => 291 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-315x500.png [thumb_372_500-width] => 315 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-170x270.png [thumb_385_270-width] => 170 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-152x241.png [thumb_416_241-width] => 152 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-258x410.png [thumb_448_410-width] => 258 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-517x820.png [thumb_448_410_retina-width] => 517 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-241x382.png [thumb_574_382-width] => 241 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-249x395.png [thumb_776_395-width] => 249 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [gform-image-choice-sm-width] => 189 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [gform-image-choice-md-width] => 252 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [gform-image-choice-lg-width] => 378 [gform-image-choice-lg-height] => 600 ) ) [1] => Array ( [ID] => 13077 [id] => 13077 [title] => Matching_Challenge.png [filename] => Matching_Challenge.png [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [link] => https://www.nextafter.com/experiments/how-a-time-sensitive-value-proposition-affects-conversion-rate-for-donors/attachment/matching_challenge-png/ [alt] => [author] => 6 [description] => [caption] => [name] => matching_challenge-png [status] => inherit [uploaded_to] => 13075 [date] => 2021-02-25 05:25:49 [modified] => 2021-02-25 05:25:49 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1440 [height] => 2108 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-205x300.png [medium-width] => 205 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-768x1124.png [medium_large-width] => 640 [medium_large-height] => 937 [large] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-700x1024.png [large-width] => 640 [large-height] => 936 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-1049x1536.png [1536x1536-width] => 1049 [1536x1536-height] => 1536 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-1399x2048.png [2048x2048-width] => 1399 [2048x2048-height] => 2048 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [tp-image-grid-width] => 478 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-34x50.png [admin-width] => 34 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [full-width] => 1440 [full-height] => 2108 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-372x545.png [thumb_372-width] => 372 [thumb_372-height] => 545 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-427x625.png [single_post_thumbnail-width] => 427 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-22x32.png [thumb_32_32-width] => 22 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-33x48.png [thumb_48_48-width] => 33 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-44x64.png [thumb_64_64-width] => 44 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-87x128.png [thumb_128_128-width] => 87 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-46x67.png [thumb_122_67-width] => 46 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-105x153.png [thumb_153_153-width] => 105 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-111x163.png [thumb_130_163-width] => 111 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-121x177.png [thumb_232_177-width] => 121 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-444x650.png [thumb_272_325-width] => 444 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-236x346.png [thumb_271_346-width] => 236 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-185x271.png [thumb_271_271-width] => 185 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-117x172.png [thumb_272_172-width] => 117 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-315x461.png [thumb_372_461-width] => 315 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-342x500.png [thumb_372_500-width] => 342 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-184x270.png [thumb_385_270-width] => 184 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-165x241.png [thumb_416_241-width] => 165 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-280x410.png [thumb_448_410-width] => 280 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-560x820.png [thumb_448_410_retina-width] => 560 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-261x382.png [thumb_574_382-width] => 261 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-270x395.png [thumb_776_395-width] => 270 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [gform-image-choice-sm-width] => 205 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [gform-image-choice-md-width] => 273 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [gform-image-choice-lg-width] => 410 [gform-image-choice-lg-height] => 600 ) ) )
T1: Matching Challenge
Array ( [0] => Array ( [ID] => 13076 [id] => 13076 [title] => Teach_Truth.png [filename] => Teach_Truth.png [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [link] => https://www.nextafter.com/experiments/how-a-time-sensitive-value-proposition-affects-conversion-rate-for-donors/attachment/teach_truth-png/ [alt] => [author] => 6 [description] => [caption] => [name] => teach_truth-png [status] => inherit [uploaded_to] => 13075 [date] => 2021-02-25 05:25:36 [modified] => 2021-02-25 05:25:36 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1440 [height] => 2284 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-189x300.png [medium-width] => 189 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-768x1218.png [medium_large-width] => 640 [medium_large-height] => 1015 [large] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-646x1024.png [large-width] => 640 [large-height] => 1014 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-968x1536.png [1536x1536-width] => 968 [1536x1536-height] => 1536 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-1291x2048.png [2048x2048-width] => 1291 [2048x2048-height] => 2048 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [tp-image-grid-width] => 441 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-32x50.png [admin-width] => 32 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [full-width] => 1440 [full-height] => 2284 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-372x590.png [thumb_372-width] => 372 [thumb_372-height] => 590 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-394x625.png [single_post_thumbnail-width] => 394 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-81x128.png [thumb_128_128-width] => 81 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-42x67.png [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-96x153.png [thumb_153_153-width] => 96 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-103x163.png [thumb_130_163-width] => 103 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-112x177.png [thumb_232_177-width] => 112 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-410x650.png [thumb_272_325-width] => 410 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-218x346.png [thumb_271_346-width] => 218 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-171x271.png [thumb_271_271-width] => 171 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-108x172.png [thumb_272_172-width] => 108 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-291x461.png [thumb_372_461-width] => 291 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-315x500.png [thumb_372_500-width] => 315 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-170x270.png [thumb_385_270-width] => 170 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-152x241.png [thumb_416_241-width] => 152 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-258x410.png [thumb_448_410-width] => 258 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-517x820.png [thumb_448_410_retina-width] => 517 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-241x382.png [thumb_574_382-width] => 241 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Teach_Truth-249x395.png [thumb_776_395-width] => 249 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [gform-image-choice-sm-width] => 189 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [gform-image-choice-md-width] => 252 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Teach_Truth.png [gform-image-choice-lg-width] => 378 [gform-image-choice-lg-height] => 600 ) ) [1] => Array ( [ID] => 13077 [id] => 13077 [title] => Matching_Challenge.png [filename] => Matching_Challenge.png [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [link] => https://www.nextafter.com/experiments/how-a-time-sensitive-value-proposition-affects-conversion-rate-for-donors/attachment/matching_challenge-png/ [alt] => [author] => 6 [description] => [caption] => [name] => matching_challenge-png [status] => inherit [uploaded_to] => 13075 [date] => 2021-02-25 05:25:49 [modified] => 2021-02-25 05:25:49 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1440 [height] => 2108 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-205x300.png [medium-width] => 205 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-768x1124.png [medium_large-width] => 640 [medium_large-height] => 937 [large] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-700x1024.png [large-width] => 640 [large-height] => 936 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-1049x1536.png [1536x1536-width] => 1049 [1536x1536-height] => 1536 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-1399x2048.png [2048x2048-width] => 1399 [2048x2048-height] => 2048 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [tp-image-grid-width] => 478 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-34x50.png [admin-width] => 34 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [full-width] => 1440 [full-height] => 2108 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-372x545.png [thumb_372-width] => 372 [thumb_372-height] => 545 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-427x625.png [single_post_thumbnail-width] => 427 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-22x32.png [thumb_32_32-width] => 22 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-33x48.png [thumb_48_48-width] => 33 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-44x64.png [thumb_64_64-width] => 44 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-87x128.png [thumb_128_128-width] => 87 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-46x67.png [thumb_122_67-width] => 46 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-105x153.png [thumb_153_153-width] => 105 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-111x163.png [thumb_130_163-width] => 111 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-121x177.png [thumb_232_177-width] => 121 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-444x650.png [thumb_272_325-width] => 444 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-236x346.png [thumb_271_346-width] => 236 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-185x271.png [thumb_271_271-width] => 185 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-117x172.png [thumb_272_172-width] => 117 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-315x461.png [thumb_372_461-width] => 315 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-342x500.png [thumb_372_500-width] => 342 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-184x270.png [thumb_385_270-width] => 184 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-165x241.png [thumb_416_241-width] => 165 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-280x410.png [thumb_448_410-width] => 280 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-560x820.png [thumb_448_410_retina-width] => 560 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-261x382.png [thumb_574_382-width] => 261 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge-270x395.png [thumb_776_395-width] => 270 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [gform-image-choice-sm-width] => 205 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [gform-image-choice-md-width] => 273 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Matching_Challenge.png [gform-image-choice-lg-width] => 410 [gform-image-choice-lg-height] => 600 ) ) )

Results

  Treatment Name Conv. Rate Relative Difference Confidence
C: Teach Truth 8.5%
T1: Matching Challenge 6.5% -23.7% 68.0%

This experiment has a required sample size of 1,296 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.

Key Learnings

The treatment page produced a 23% decrease in donor conversion rate although this, like the nondonor test, was not statistically valid due to low traffic for this campaign. Because it was not statistically valid, these numbers cannot be interpreted to infer that the new value proposition was less motivating to donors. This test was closer to validity than the nondonor test, but even when combining the data from the two tests, there was not a clear winner or statistical validity.


Experiment Documented by Jeff Giddens
Jeff Giddens is President of NextAfter.

Question about experiment #4998

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.