Run for Water

How urgency affects clickthrough rate in website popups

Experiment ID: #11640

Run for Water

Experiment Summary

Timeframe: 05/03/2016 - 05/16/2016

Run with Water was raising entry fees before their race event. They used a ‘welcome mat’ pop-up to let visitors know and encourage them to register for the race. However, they hypothesized that time-sensitive language that highlighted the user’s benefit might increase urgency and increase race registrations instead of the cause-based call-to-action. So they created a treatment that highlighted the deadline and presented the benefit to the user, rather than cause-based copy.

Research Question

Will increasing clarity of the call-to-action increase clickthrough rate?

Design

C: Cause + fees
Array ( [0] => Array ( [ID] => 42979 [id] => 42979 [title] => Cause_+_fees.jpg [filename] => Cause__fees-3.jpg [filesize] => 290016 [url] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [link] => https://www.nextafter.com/experiments/how-urgency-affects-clickthrough-rate-website-popups/attachment/cause__fees-jpg-4/ [alt] => [author] => 0 [description] => [caption] => [name] => cause__fees-jpg-4 [status] => inherit [uploaded_to] => 12739 [date] => 2022-10-28 19:49:30 [modified] => 2022-10-28 19:49:30 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1432 [height] => 1017 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-300x213.jpg [medium-width] => 300 [medium-height] => 213 [medium_large] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-768x545.jpg [medium_large-width] => 640 [medium_large-height] => 454 [large] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-1024x727.jpg [large-width] => 640 [large-height] => 454 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [1536x1536-width] => 1432 [1536x1536-height] => 1017 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [2048x2048-width] => 1432 [2048x2048-height] => 1017 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [tp-image-grid-width] => 700 [tp-image-grid-height] => 497 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-50x36.jpg [admin-width] => 50 [admin-height] => 36 [full] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [full-width] => 1432 [full-height] => 1017 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-372x264.jpg [thumb_372-width] => 372 [thumb_372-height] => 264 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-880x625.jpg [single_post_thumbnail-width] => 880 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-48x34.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 34 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-64x45.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 45 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-128x91.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 91 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-94x67.jpg [thumb_122_67-width] => 94 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-153x109.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 109 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-130x92.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 92 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-232x165.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 165 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-544x386.jpg [thumb_272_325-width] => 544 [thumb_272_325-height] => 386 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-271x192.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 192 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-271x192.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 192 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-242x172.jpg [thumb_272_172-width] => 242 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-372x264.jpg [thumb_372_461-width] => 372 [thumb_372_461-height] => 264 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-372x264.jpg [thumb_372_500-width] => 372 [thumb_372_500-height] => 264 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-380x270.jpg [thumb_385_270-width] => 380 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-339x241.jpg [thumb_416_241-width] => 339 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-448x318.jpg [thumb_448_410-width] => 448 [thumb_448_410-height] => 318 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-896x636.jpg [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 636 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-538x382.jpg [thumb_574_382-width] => 538 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-556x395.jpg [thumb_776_395-width] => 556 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 213 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 284 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 426 ) ) [1] => Array ( [ID] => 42982 [id] => 42982 [title] => Time-based_offer.jpg [filename] => Time-based_offer-3.jpg [filesize] => 270973 [url] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [link] => https://www.nextafter.com/experiments/how-urgency-affects-clickthrough-rate-website-popups/attachment/time-based_offer-jpg-4/ [alt] => [author] => 0 [description] => [caption] => [name] => time-based_offer-jpg-4 [status] => inherit [uploaded_to] => 12739 [date] => 2022-10-28 19:50:12 [modified] => 2022-10-28 19:50:12 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1426 [height] => 1016 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-300x214.jpg [medium-width] => 300 [medium-height] => 214 [medium_large] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-768x547.jpg [medium_large-width] => 640 [medium_large-height] => 456 [large] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-1024x730.jpg [large-width] => 640 [large-height] => 456 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [1536x1536-width] => 1426 [1536x1536-height] => 1016 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [2048x2048-width] => 1426 [2048x2048-height] => 1016 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [tp-image-grid-width] => 700 [tp-image-grid-height] => 499 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-50x36.jpg [admin-width] => 50 [admin-height] => 36 [full] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [full-width] => 1426 [full-height] => 1016 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-372x265.jpg [thumb_372-width] => 372 [thumb_372-height] => 265 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-877x625.jpg [single_post_thumbnail-width] => 877 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-48x34.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 34 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-64x46.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 46 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-128x91.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 91 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-94x67.jpg [thumb_122_67-width] => 94 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-153x109.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 109 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-130x93.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 93 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-232x165.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 165 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-544x388.jpg [thumb_272_325-width] => 544 [thumb_272_325-height] => 388 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-271x193.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 193 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-271x193.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 193 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-241x172.jpg [thumb_272_172-width] => 241 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-372x265.jpg [thumb_372_461-width] => 372 [thumb_372_461-height] => 265 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-372x265.jpg [thumb_372_500-width] => 372 [thumb_372_500-height] => 265 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-379x270.jpg [thumb_385_270-width] => 379 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-338x241.jpg [thumb_416_241-width] => 338 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-448x319.jpg [thumb_448_410-width] => 448 [thumb_448_410-height] => 319 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-896x638.jpg [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 638 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-536x382.jpg [thumb_574_382-width] => 536 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-554x395.jpg [thumb_776_395-width] => 554 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 214 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 285 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 427 ) ) )
T1: Time-based offer
Array ( [0] => Array ( [ID] => 42979 [id] => 42979 [title] => Cause_+_fees.jpg [filename] => Cause__fees-3.jpg [filesize] => 290016 [url] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [link] => https://www.nextafter.com/experiments/how-urgency-affects-clickthrough-rate-website-popups/attachment/cause__fees-jpg-4/ [alt] => [author] => 0 [description] => [caption] => [name] => cause__fees-jpg-4 [status] => inherit [uploaded_to] => 12739 [date] => 2022-10-28 19:49:30 [modified] => 2022-10-28 19:49:30 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1432 [height] => 1017 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-300x213.jpg [medium-width] => 300 [medium-height] => 213 [medium_large] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-768x545.jpg [medium_large-width] => 640 [medium_large-height] => 454 [large] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-1024x727.jpg [large-width] => 640 [large-height] => 454 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [1536x1536-width] => 1432 [1536x1536-height] => 1017 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [2048x2048-width] => 1432 [2048x2048-height] => 1017 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [tp-image-grid-width] => 700 [tp-image-grid-height] => 497 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-50x36.jpg [admin-width] => 50 [admin-height] => 36 [full] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [full-width] => 1432 [full-height] => 1017 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-372x264.jpg [thumb_372-width] => 372 [thumb_372-height] => 264 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-880x625.jpg [single_post_thumbnail-width] => 880 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-48x34.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 34 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-64x45.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 45 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-128x91.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 91 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-94x67.jpg [thumb_122_67-width] => 94 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-153x109.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 109 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-130x92.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 92 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-232x165.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 165 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-544x386.jpg [thumb_272_325-width] => 544 [thumb_272_325-height] => 386 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-271x192.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 192 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-271x192.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 192 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-242x172.jpg [thumb_272_172-width] => 242 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-372x264.jpg [thumb_372_461-width] => 372 [thumb_372_461-height] => 264 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-372x264.jpg [thumb_372_500-width] => 372 [thumb_372_500-height] => 264 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-380x270.jpg [thumb_385_270-width] => 380 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-339x241.jpg [thumb_416_241-width] => 339 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-448x318.jpg [thumb_448_410-width] => 448 [thumb_448_410-height] => 318 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-896x636.jpg [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 636 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-538x382.jpg [thumb_574_382-width] => 538 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3-556x395.jpg [thumb_776_395-width] => 556 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 213 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 284 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Cause__fees-3.jpg [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 426 ) ) [1] => Array ( [ID] => 42982 [id] => 42982 [title] => Time-based_offer.jpg [filename] => Time-based_offer-3.jpg [filesize] => 270973 [url] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [link] => https://www.nextafter.com/experiments/how-urgency-affects-clickthrough-rate-website-popups/attachment/time-based_offer-jpg-4/ [alt] => [author] => 0 [description] => [caption] => [name] => time-based_offer-jpg-4 [status] => inherit [uploaded_to] => 12739 [date] => 2022-10-28 19:50:12 [modified] => 2022-10-28 19:50:12 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 1426 [height] => 1016 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-300x214.jpg [medium-width] => 300 [medium-height] => 214 [medium_large] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-768x547.jpg [medium_large-width] => 640 [medium_large-height] => 456 [large] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-1024x730.jpg [large-width] => 640 [large-height] => 456 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [1536x1536-width] => 1426 [1536x1536-height] => 1016 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [2048x2048-width] => 1426 [2048x2048-height] => 1016 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [tp-image-grid-width] => 700 [tp-image-grid-height] => 499 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-50x36.jpg [admin-width] => 50 [admin-height] => 36 [full] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [full-width] => 1426 [full-height] => 1016 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-372x265.jpg [thumb_372-width] => 372 [thumb_372-height] => 265 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-877x625.jpg [single_post_thumbnail-width] => 877 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-48x34.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 34 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-64x46.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 46 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-128x91.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 91 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-94x67.jpg [thumb_122_67-width] => 94 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-153x109.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 109 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-130x93.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 93 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-232x165.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 165 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-544x388.jpg [thumb_272_325-width] => 544 [thumb_272_325-height] => 388 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-271x193.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 193 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-271x193.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 193 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-241x172.jpg [thumb_272_172-width] => 241 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-372x265.jpg [thumb_372_461-width] => 372 [thumb_372_461-height] => 265 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-372x265.jpg [thumb_372_500-width] => 372 [thumb_372_500-height] => 265 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-379x270.jpg [thumb_385_270-width] => 379 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-338x241.jpg [thumb_416_241-width] => 338 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-448x319.jpg [thumb_448_410-width] => 448 [thumb_448_410-height] => 319 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-896x638.jpg [thumb_448_410_retina-width] => 896 [thumb_448_410_retina-height] => 638 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-536x382.jpg [thumb_574_382-width] => 536 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3-554x395.jpg [thumb_776_395-width] => 554 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 214 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [gform-image-choice-md-width] => 400 [gform-image-choice-md-height] => 285 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Time-based_offer-3.jpg [gform-image-choice-lg-width] => 600 [gform-image-choice-lg-height] => 427 ) ) )

Results

  Treatment Name Click Rate Relative Difference Confidence
C: Cause + fees 18.5%
T1: Time-based offer 23.0% 24.8% 98.5%

This experiment has a required sample size of 606 in order to be valid. Since the experiment had a total sample size of 1,854, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    24.8% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

The treatment with urgency-based language delivered a 24.8% increase in clickthrough rate. This shows that while cause-based copy might inspire some people (like existing donors or constituents familiar with the cause), clarity trumps persuasion. While we must continually test, research shows that plainly stating the benefits can often increase conversion in place of inspirational copy.


Experiment Documented by Brady Josephson

Question about experiment #11640

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.