Dallas Theological Seminary

How increasing the clarity in copy for a sticky bar impacts click through rates

Experiment ID: #165274

Dallas Theological Seminary

The DTS mission is, “to glorify God by equipping godly servant-leaders for the proclamation of His Word and the building up of the body of Christ worldwide.” They strive to help men and women fulfill the Great Commission and the Great Commandment, or more simply: Teach Truth. Love Well.

Experiment Summary

Timeframe: 11/21/2023 - 11/26/2023

Dallas Theological Seminary had a survey that they wanted to advertise on their website to encourage people to provide feedback on DTS free online courses. Previously, they had tested the angle of acknowledging that the person reading the sticky bar was a friend of DTS that became the control.

For this test, we wanted to see if that angle was more impactful or if providing clarity on the length of the survey and extending a specific invitation to the person reading the sticky bar would lead to more clicks.

Research Question

We believe that changing the messaging and call-to-action in the sticky bar from a generic request for feedback to a more specific and personalized invitation to take a survey about the user’s learning experience will result in a higher click through rate because it is a more tangible and manageable ask.

Design

C: Control
Array ( [0] => Array ( [ID] => 64653 [id] => 64653 [title] => Control.png [filename] => Control-33.png [filesize] => 13563 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [link] => https://www.nextafter.com/experiments/how-increasing-the-clarity-in-copy-for-a-sticky-bar-impacts-click-through-rates/attachment/control-png-8662/ [alt] => [author] => 0 [description] => [caption] => [name] => control-png-8662 [status] => inherit [uploaded_to] => 64645 [date] => 2024-08-13 14:51:23 [modified] => 2024-08-13 14:51:23 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 374 [height] => 125 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-300x100.png [medium-width] => 300 [medium-height] => 100 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [medium_large-width] => 374 [medium_large-height] => 125 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [large-width] => 374 [large-height] => 125 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [1536x1536-width] => 374 [1536x1536-height] => 125 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [2048x2048-width] => 374 [2048x2048-height] => 125 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-50x17.png [admin-width] => 50 [admin-height] => 17 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [full-width] => 374 [full-height] => 125 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-372x124.png [thumb_372-width] => 372 [thumb_372-height] => 124 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [single_post_thumbnail-width] => 374 [single_post_thumbnail-height] => 125 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-32x11.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 11 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-48x16.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 16 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-64x21.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 21 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-128x43.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 43 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-122x41.png [thumb_122_67-width] => 122 [thumb_122_67-height] => 41 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-153x51.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 51 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-130x43.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 43 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-232x78.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 78 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_272_325-width] => 374 [thumb_272_325-height] => 125 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-271x91.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 91 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-271x91.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 91 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-272x91.png [thumb_272_172-width] => 272 [thumb_272_172-height] => 91 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-372x124.png [thumb_372_461-width] => 372 [thumb_372_461-height] => 124 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-372x124.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 124 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_385_270-width] => 374 [thumb_385_270-height] => 125 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_416_241-width] => 374 [thumb_416_241-height] => 125 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_448_410-width] => 374 [thumb_448_410-height] => 125 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_448_410_retina-width] => 374 [thumb_448_410_retina-height] => 125 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_574_382-width] => 374 [thumb_574_382-height] => 125 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_776_395-width] => 374 [thumb_776_395-height] => 125 ) ) [1] => Array ( [ID] => 64654 [id] => 64654 [title] => Treatment_#1.png [filename] => Treatment_1-14.png [filesize] => 13393 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [link] => https://www.nextafter.com/experiments/how-increasing-the-clarity-in-copy-for-a-sticky-bar-impacts-click-through-rates/attachment/treatment_1-png-2953/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-png-2953 [status] => inherit [uploaded_to] => 64645 [date] => 2024-08-13 14:51:28 [modified] => 2024-08-13 14:51:28 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 370 [height] => 122 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-300x99.png [medium-width] => 300 [medium-height] => 99 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [medium_large-width] => 370 [medium_large-height] => 122 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [large-width] => 370 [large-height] => 122 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [1536x1536-width] => 370 [1536x1536-height] => 122 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [2048x2048-width] => 370 [2048x2048-height] => 122 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-50x16.png [admin-width] => 50 [admin-height] => 16 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [full-width] => 370 [full-height] => 122 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_372-width] => 370 [thumb_372-height] => 122 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [single_post_thumbnail-width] => 370 [single_post_thumbnail-height] => 122 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-32x11.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 11 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-48x16.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 16 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-64x21.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 21 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-128x42.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 42 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-122x40.png [thumb_122_67-width] => 122 [thumb_122_67-height] => 40 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-153x50.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 50 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-130x43.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 43 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-232x76.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 76 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_272_325-width] => 370 [thumb_272_325-height] => 122 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-271x89.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 89 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-271x89.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 89 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-272x90.png [thumb_272_172-width] => 272 [thumb_272_172-height] => 90 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_372_461-width] => 370 [thumb_372_461-height] => 122 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_372_500-width] => 370 [thumb_372_500-height] => 122 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_385_270-width] => 370 [thumb_385_270-height] => 122 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_416_241-width] => 370 [thumb_416_241-height] => 122 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_448_410-width] => 370 [thumb_448_410-height] => 122 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_448_410_retina-width] => 370 [thumb_448_410_retina-height] => 122 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_574_382-width] => 370 [thumb_574_382-height] => 122 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_776_395-width] => 370 [thumb_776_395-height] => 122 ) ) )
T1: Treatment #1
Array ( [0] => Array ( [ID] => 64653 [id] => 64653 [title] => Control.png [filename] => Control-33.png [filesize] => 13563 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [link] => https://www.nextafter.com/experiments/how-increasing-the-clarity-in-copy-for-a-sticky-bar-impacts-click-through-rates/attachment/control-png-8662/ [alt] => [author] => 0 [description] => [caption] => [name] => control-png-8662 [status] => inherit [uploaded_to] => 64645 [date] => 2024-08-13 14:51:23 [modified] => 2024-08-13 14:51:23 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 374 [height] => 125 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-300x100.png [medium-width] => 300 [medium-height] => 100 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [medium_large-width] => 374 [medium_large-height] => 125 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [large-width] => 374 [large-height] => 125 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [1536x1536-width] => 374 [1536x1536-height] => 125 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [2048x2048-width] => 374 [2048x2048-height] => 125 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-50x17.png [admin-width] => 50 [admin-height] => 17 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [full-width] => 374 [full-height] => 125 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-372x124.png [thumb_372-width] => 372 [thumb_372-height] => 124 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [single_post_thumbnail-width] => 374 [single_post_thumbnail-height] => 125 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-32x11.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 11 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-48x16.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 16 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-64x21.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 21 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-128x43.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 43 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-122x41.png [thumb_122_67-width] => 122 [thumb_122_67-height] => 41 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-153x51.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 51 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-130x43.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 43 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-232x78.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 78 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_272_325-width] => 374 [thumb_272_325-height] => 125 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-271x91.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 91 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-271x91.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 91 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-272x91.png [thumb_272_172-width] => 272 [thumb_272_172-height] => 91 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-372x124.png [thumb_372_461-width] => 372 [thumb_372_461-height] => 124 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33-372x124.png [thumb_372_500-width] => 372 [thumb_372_500-height] => 124 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_385_270-width] => 374 [thumb_385_270-height] => 125 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_416_241-width] => 374 [thumb_416_241-height] => 125 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_448_410-width] => 374 [thumb_448_410-height] => 125 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_448_410_retina-width] => 374 [thumb_448_410_retina-height] => 125 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_574_382-width] => 374 [thumb_574_382-height] => 125 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Control-33.png [thumb_776_395-width] => 374 [thumb_776_395-height] => 125 ) ) [1] => Array ( [ID] => 64654 [id] => 64654 [title] => Treatment_#1.png [filename] => Treatment_1-14.png [filesize] => 13393 [url] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [link] => https://www.nextafter.com/experiments/how-increasing-the-clarity-in-copy-for-a-sticky-bar-impacts-click-through-rates/attachment/treatment_1-png-2953/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-png-2953 [status] => inherit [uploaded_to] => 64645 [date] => 2024-08-13 14:51:28 [modified] => 2024-08-13 14:51:28 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://nextafter-1a91a.kxcdn.com/wp-includes/images/media/default.png [width] => 370 [height] => 122 [sizes] => Array ( [thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-300x99.png [medium-width] => 300 [medium-height] => 99 [medium_large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [medium_large-width] => 370 [medium_large-height] => 122 [large] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [large-width] => 370 [large-height] => 122 [1536x1536] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [1536x1536-width] => 370 [1536x1536-height] => 122 [2048x2048] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [2048x2048-width] => 370 [2048x2048-height] => 122 [ab-block-post-grid-landscape] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-600x400.png [ab-block-post-grid-landscape-width] => 600 [ab-block-post-grid-landscape-height] => 400 [ab-block-post-grid-square] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-600x600.png [ab-block-post-grid-square-width] => 600 [ab-block-post-grid-square-height] => 600 [tp-image-grid] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-700x700.png [tp-image-grid-width] => 700 [tp-image-grid-height] => 700 [post-thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-50x16.png [admin-width] => 50 [admin-height] => 16 [full] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [full-width] => 370 [full-height] => 122 [thumb_372] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_372-width] => 370 [thumb_372-height] => 122 [single_post_thumbnail] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [single_post_thumbnail-width] => 370 [single_post_thumbnail-height] => 122 [thumb_32_32] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-32x11.png [thumb_32_32-width] => 32 [thumb_32_32-height] => 11 [thumb_48_48] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-48x16.png [thumb_48_48-width] => 48 [thumb_48_48-height] => 16 [thumb_64_64] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-64x21.png [thumb_64_64-width] => 64 [thumb_64_64-height] => 21 [thumb_128_128] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-128x42.png [thumb_128_128-width] => 128 [thumb_128_128-height] => 42 [thumb_122_67] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-122x40.png [thumb_122_67-width] => 122 [thumb_122_67-height] => 40 [thumb_153_153] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-153x50.png [thumb_153_153-width] => 153 [thumb_153_153-height] => 50 [thumb_130_163] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-130x43.png [thumb_130_163-width] => 130 [thumb_130_163-height] => 43 [thumb_232_177] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-232x76.png [thumb_232_177-width] => 232 [thumb_232_177-height] => 76 [thumb_272_325] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_272_325-width] => 370 [thumb_272_325-height] => 122 [thumb_271_346] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-271x89.png [thumb_271_346-width] => 271 [thumb_271_346-height] => 89 [thumb_271_271] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-271x89.png [thumb_271_271-width] => 271 [thumb_271_271-height] => 89 [thumb_272_172] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14-272x90.png [thumb_272_172-width] => 272 [thumb_272_172-height] => 90 [thumb_372_461] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_372_461-width] => 370 [thumb_372_461-height] => 122 [thumb_372_500] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_372_500-width] => 370 [thumb_372_500-height] => 122 [thumb_385_270] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_385_270-width] => 370 [thumb_385_270-height] => 122 [thumb_416_241] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_416_241-width] => 370 [thumb_416_241-height] => 122 [thumb_448_410] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_448_410-width] => 370 [thumb_448_410-height] => 122 [thumb_448_410_retina] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_448_410_retina-width] => 370 [thumb_448_410_retina-height] => 122 [thumb_574_382] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_574_382-width] => 370 [thumb_574_382-height] => 122 [thumb_776_395] => https://nextafter-1a91a.kxcdn.com/wp-content/uploads/Treatment_1-14.png [thumb_776_395-width] => 370 [thumb_776_395-height] => 122 ) ) )

Results

 Treatment NameClick RateRelative DifferenceConfidence
C: Control 0.21%
T1: Treatment #1 0.93%343.2% 100.0%

This experiment has a required sample size of 842 in order to be valid. Since the experiment had a total sample size of 5,752, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    343.2% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

The key learning from this experiment is that providing a specific and personalized invitation to take a survey resulted in a significantly higher click-through rate compared to a generic request for feedback. The treatment version, which used more specific and tangible language, saw a 343.2% increase in clicks for all traffic with a 100.0% level of confidence.

Based on these results, it is recommended to use the learnings from this experiment in future experimentation. When designing sticky bars or any other call-to-action messaging, it would be beneficial to use specific and personalized language that clearly communicates the purpose of the action and the value it provides to the user. This approach can increase engagement and participation rates. Additionally, it is important to continue testing and iterating on messaging to optimize click-through rates and other desired outcomes.


Experiment Documented by NextAfter

Question about experiment #165274

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.