let us help
Subscribe
The Heritage Foundation

How asking an open-loop question on an ad image affects click through rates

Experiment ID: #96562

The Heritage Foundation

Experiment Summary

Timeframe: 04/25/2022 - 06/06/2022

The Heritage Foundation wanted to improve CTR on their Big Tech Survey campaign. The original ad had long, issue-focused copy and a statement on the ad image telling the audience to take their survey to fight back against big tech.

in an attempt to earn more clicks, Heritage tested two ad treatments: one with the same image/statement but shorter body copy and a second with a new image and an open loop question to encourage people to click to find out what they knew.

Research Question

We believe that asking an open loop question on the ad image for Facebook users will achieve increase donation rates.

Design

C: Control
Array ( [0] => Array ( [ID] => 43881 [id] => 43881 [title] => Control.png [filename] => Control-3439.png [filesize] => 115010 [url] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/control-png-3949/ [alt] => [author] => 0 [description] => [caption] => [name] => control-png-3949 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:53:18 [modified] => 2022-10-31 13:53:18 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 239 [height] => 393 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Control-3439-182x300.png [medium-width] => 182 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [medium_large-width] => 239 [medium_large-height] => 393 [large] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [large-width] => 239 [large-height] => 393 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [1536x1536-width] => 239 [1536x1536-height] => 393 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [2048x2048-width] => 239 [2048x2048-height] => 393 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [tp-image-grid-width] => 239 [tp-image-grid-height] => 393 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Control-3439-30x50.png [admin-width] => 30 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [full-width] => 239 [full-height] => 393 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372-width] => 239 [thumb_372-height] => 393 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [single_post_thumbnail-width] => 239 [single_post_thumbnail-height] => 393 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Control-3439-19x32.png [thumb_32_32-width] => 19 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Control-3439-29x48.png [thumb_48_48-width] => 29 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Control-3439-39x64.png [thumb_64_64-width] => 39 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Control-3439-78x128.png [thumb_128_128-width] => 78 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Control-3439-41x67.png [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Control-3439-93x153.png [thumb_153_153-width] => 93 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Control-3439-99x163.png [thumb_130_163-width] => 99 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Control-3439-108x177.png [thumb_232_177-width] => 108 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_272_325-width] => 239 [thumb_272_325-height] => 393 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Control-3439-210x346.png [thumb_271_346-width] => 210 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Control-3439-165x271.png [thumb_271_271-width] => 165 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Control-3439-105x172.png [thumb_272_172-width] => 105 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372_461-width] => 239 [thumb_372_461-height] => 393 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372_500-width] => 239 [thumb_372_500-height] => 393 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Control-3439-164x270.png [thumb_385_270-width] => 164 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Control-3439-147x241.png [thumb_416_241-width] => 147 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_448_410-width] => 239 [thumb_448_410-height] => 393 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_448_410_retina-width] => 239 [thumb_448_410_retina-height] => 393 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Control-3439-232x382.png [thumb_574_382-width] => 232 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_776_395-width] => 239 [thumb_776_395-height] => 393 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-sm-width] => 182 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-md-width] => 239 [gform-image-choice-md-height] => 393 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-lg-width] => 239 [gform-image-choice-lg-height] => 393 ) ) [1] => Array ( [ID] => 43883 [id] => 43883 [title] => Treatment_#1.png [filename] => Treatment_1-1009.png [filesize] => 116892 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/treatment_1-png-1172/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-png-1172 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:53:32 [modified] => 2022-10-31 13:53:32 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 244 [height] => 394 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-186x300.png [medium-width] => 186 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [medium_large-width] => 244 [medium_large-height] => 394 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [large-width] => 244 [large-height] => 394 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [1536x1536-width] => 244 [1536x1536-height] => 394 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [2048x2048-width] => 244 [2048x2048-height] => 394 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [tp-image-grid-width] => 244 [tp-image-grid-height] => 394 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-31x50.png [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [full-width] => 244 [full-height] => 394 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372-width] => 244 [thumb_372-height] => 394 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [single_post_thumbnail-width] => 244 [single_post_thumbnail-height] => 394 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-79x128.png [thumb_128_128-width] => 79 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-41x67.png [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-95x153.png [thumb_153_153-width] => 95 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-101x163.png [thumb_130_163-width] => 101 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-110x177.png [thumb_232_177-width] => 110 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_272_325-width] => 244 [thumb_272_325-height] => 394 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-214x346.png [thumb_271_346-width] => 214 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-168x271.png [thumb_271_271-width] => 168 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-107x172.png [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372_461-width] => 244 [thumb_372_461-height] => 394 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372_500-width] => 244 [thumb_372_500-height] => 394 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-167x270.png [thumb_385_270-width] => 167 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-149x241.png [thumb_416_241-width] => 149 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_448_410-width] => 244 [thumb_448_410-height] => 394 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_448_410_retina-width] => 244 [thumb_448_410_retina-height] => 394 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-237x382.png [thumb_574_382-width] => 237 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_776_395-width] => 244 [thumb_776_395-height] => 394 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-sm-width] => 186 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-md-width] => 244 [gform-image-choice-md-height] => 394 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-lg-width] => 244 [gform-image-choice-lg-height] => 394 ) ) [2] => Array ( [ID] => 43888 [id] => 43888 [title] => Treatment_#2.png [filename] => Treatment_2-80.png [filesize] => 112742 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/treatment_2-png-87/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_2-png-87 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:54:06 [modified] => 2022-10-31 13:54:06 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 245 [height] => 393 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-187x300.png [medium-width] => 187 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [medium_large-width] => 245 [medium_large-height] => 393 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [large-width] => 245 [large-height] => 393 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [1536x1536-width] => 245 [1536x1536-height] => 393 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [2048x2048-width] => 245 [2048x2048-height] => 393 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [tp-image-grid-width] => 245 [tp-image-grid-height] => 393 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-31x50.png [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [full-width] => 245 [full-height] => 393 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372-width] => 245 [thumb_372-height] => 393 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [single_post_thumbnail-width] => 245 [single_post_thumbnail-height] => 393 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-80x128.png [thumb_128_128-width] => 80 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-42x67.png [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-95x153.png [thumb_153_153-width] => 95 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-102x163.png [thumb_130_163-width] => 102 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-110x177.png [thumb_232_177-width] => 110 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_272_325-width] => 245 [thumb_272_325-height] => 393 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-216x346.png [thumb_271_346-width] => 216 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-169x271.png [thumb_271_271-width] => 169 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-107x172.png [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372_461-width] => 245 [thumb_372_461-height] => 393 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372_500-width] => 245 [thumb_372_500-height] => 393 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-168x270.png [thumb_385_270-width] => 168 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x241.png [thumb_416_241-width] => 150 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_448_410-width] => 245 [thumb_448_410-height] => 393 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_448_410_retina-width] => 245 [thumb_448_410_retina-height] => 393 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-238x382.png [thumb_574_382-width] => 238 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_776_395-width] => 245 [thumb_776_395-height] => 393 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-sm-width] => 187 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-md-width] => 245 [gform-image-choice-md-height] => 393 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-lg-width] => 245 [gform-image-choice-lg-height] => 393 ) ) )
T1: Treatment #1
Array ( [0] => Array ( [ID] => 43881 [id] => 43881 [title] => Control.png [filename] => Control-3439.png [filesize] => 115010 [url] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/control-png-3949/ [alt] => [author] => 0 [description] => [caption] => [name] => control-png-3949 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:53:18 [modified] => 2022-10-31 13:53:18 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 239 [height] => 393 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Control-3439-182x300.png [medium-width] => 182 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [medium_large-width] => 239 [medium_large-height] => 393 [large] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [large-width] => 239 [large-height] => 393 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [1536x1536-width] => 239 [1536x1536-height] => 393 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [2048x2048-width] => 239 [2048x2048-height] => 393 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [tp-image-grid-width] => 239 [tp-image-grid-height] => 393 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Control-3439-30x50.png [admin-width] => 30 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [full-width] => 239 [full-height] => 393 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372-width] => 239 [thumb_372-height] => 393 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [single_post_thumbnail-width] => 239 [single_post_thumbnail-height] => 393 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Control-3439-19x32.png [thumb_32_32-width] => 19 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Control-3439-29x48.png [thumb_48_48-width] => 29 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Control-3439-39x64.png [thumb_64_64-width] => 39 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Control-3439-78x128.png [thumb_128_128-width] => 78 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Control-3439-41x67.png [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Control-3439-93x153.png [thumb_153_153-width] => 93 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Control-3439-99x163.png [thumb_130_163-width] => 99 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Control-3439-108x177.png [thumb_232_177-width] => 108 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_272_325-width] => 239 [thumb_272_325-height] => 393 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Control-3439-210x346.png [thumb_271_346-width] => 210 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Control-3439-165x271.png [thumb_271_271-width] => 165 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Control-3439-105x172.png [thumb_272_172-width] => 105 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372_461-width] => 239 [thumb_372_461-height] => 393 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372_500-width] => 239 [thumb_372_500-height] => 393 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Control-3439-164x270.png [thumb_385_270-width] => 164 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Control-3439-147x241.png [thumb_416_241-width] => 147 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_448_410-width] => 239 [thumb_448_410-height] => 393 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_448_410_retina-width] => 239 [thumb_448_410_retina-height] => 393 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Control-3439-232x382.png [thumb_574_382-width] => 232 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_776_395-width] => 239 [thumb_776_395-height] => 393 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-sm-width] => 182 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-md-width] => 239 [gform-image-choice-md-height] => 393 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-lg-width] => 239 [gform-image-choice-lg-height] => 393 ) ) [1] => Array ( [ID] => 43883 [id] => 43883 [title] => Treatment_#1.png [filename] => Treatment_1-1009.png [filesize] => 116892 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/treatment_1-png-1172/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-png-1172 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:53:32 [modified] => 2022-10-31 13:53:32 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 244 [height] => 394 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-186x300.png [medium-width] => 186 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [medium_large-width] => 244 [medium_large-height] => 394 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [large-width] => 244 [large-height] => 394 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [1536x1536-width] => 244 [1536x1536-height] => 394 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [2048x2048-width] => 244 [2048x2048-height] => 394 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [tp-image-grid-width] => 244 [tp-image-grid-height] => 394 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-31x50.png [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [full-width] => 244 [full-height] => 394 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372-width] => 244 [thumb_372-height] => 394 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [single_post_thumbnail-width] => 244 [single_post_thumbnail-height] => 394 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-79x128.png [thumb_128_128-width] => 79 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-41x67.png [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-95x153.png [thumb_153_153-width] => 95 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-101x163.png [thumb_130_163-width] => 101 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-110x177.png [thumb_232_177-width] => 110 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_272_325-width] => 244 [thumb_272_325-height] => 394 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-214x346.png [thumb_271_346-width] => 214 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-168x271.png [thumb_271_271-width] => 168 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-107x172.png [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372_461-width] => 244 [thumb_372_461-height] => 394 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372_500-width] => 244 [thumb_372_500-height] => 394 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-167x270.png [thumb_385_270-width] => 167 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-149x241.png [thumb_416_241-width] => 149 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_448_410-width] => 244 [thumb_448_410-height] => 394 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_448_410_retina-width] => 244 [thumb_448_410_retina-height] => 394 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-237x382.png [thumb_574_382-width] => 237 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_776_395-width] => 244 [thumb_776_395-height] => 394 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-sm-width] => 186 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-md-width] => 244 [gform-image-choice-md-height] => 394 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-lg-width] => 244 [gform-image-choice-lg-height] => 394 ) ) [2] => Array ( [ID] => 43888 [id] => 43888 [title] => Treatment_#2.png [filename] => Treatment_2-80.png [filesize] => 112742 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/treatment_2-png-87/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_2-png-87 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:54:06 [modified] => 2022-10-31 13:54:06 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 245 [height] => 393 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-187x300.png [medium-width] => 187 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [medium_large-width] => 245 [medium_large-height] => 393 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [large-width] => 245 [large-height] => 393 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [1536x1536-width] => 245 [1536x1536-height] => 393 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [2048x2048-width] => 245 [2048x2048-height] => 393 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [tp-image-grid-width] => 245 [tp-image-grid-height] => 393 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-31x50.png [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [full-width] => 245 [full-height] => 393 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372-width] => 245 [thumb_372-height] => 393 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [single_post_thumbnail-width] => 245 [single_post_thumbnail-height] => 393 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-80x128.png [thumb_128_128-width] => 80 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-42x67.png [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-95x153.png [thumb_153_153-width] => 95 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-102x163.png [thumb_130_163-width] => 102 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-110x177.png [thumb_232_177-width] => 110 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_272_325-width] => 245 [thumb_272_325-height] => 393 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-216x346.png [thumb_271_346-width] => 216 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-169x271.png [thumb_271_271-width] => 169 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-107x172.png [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372_461-width] => 245 [thumb_372_461-height] => 393 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372_500-width] => 245 [thumb_372_500-height] => 393 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-168x270.png [thumb_385_270-width] => 168 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x241.png [thumb_416_241-width] => 150 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_448_410-width] => 245 [thumb_448_410-height] => 393 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_448_410_retina-width] => 245 [thumb_448_410_retina-height] => 393 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-238x382.png [thumb_574_382-width] => 238 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_776_395-width] => 245 [thumb_776_395-height] => 393 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-sm-width] => 187 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-md-width] => 245 [gform-image-choice-md-height] => 393 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-lg-width] => 245 [gform-image-choice-lg-height] => 393 ) ) )
T2: Treatment #2
Array ( [0] => Array ( [ID] => 43881 [id] => 43881 [title] => Control.png [filename] => Control-3439.png [filesize] => 115010 [url] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/control-png-3949/ [alt] => [author] => 0 [description] => [caption] => [name] => control-png-3949 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:53:18 [modified] => 2022-10-31 13:53:18 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 239 [height] => 393 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Control-3439-182x300.png [medium-width] => 182 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [medium_large-width] => 239 [medium_large-height] => 393 [large] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [large-width] => 239 [large-height] => 393 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [1536x1536-width] => 239 [1536x1536-height] => 393 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [2048x2048-width] => 239 [2048x2048-height] => 393 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [tp-image-grid-width] => 239 [tp-image-grid-height] => 393 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Control-3439-30x50.png [admin-width] => 30 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [full-width] => 239 [full-height] => 393 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372-width] => 239 [thumb_372-height] => 393 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [single_post_thumbnail-width] => 239 [single_post_thumbnail-height] => 393 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Control-3439-19x32.png [thumb_32_32-width] => 19 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Control-3439-29x48.png [thumb_48_48-width] => 29 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Control-3439-39x64.png [thumb_64_64-width] => 39 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Control-3439-78x128.png [thumb_128_128-width] => 78 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Control-3439-41x67.png [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Control-3439-93x153.png [thumb_153_153-width] => 93 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Control-3439-99x163.png [thumb_130_163-width] => 99 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Control-3439-108x177.png [thumb_232_177-width] => 108 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_272_325-width] => 239 [thumb_272_325-height] => 393 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Control-3439-210x346.png [thumb_271_346-width] => 210 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Control-3439-165x271.png [thumb_271_271-width] => 165 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Control-3439-105x172.png [thumb_272_172-width] => 105 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372_461-width] => 239 [thumb_372_461-height] => 393 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_372_500-width] => 239 [thumb_372_500-height] => 393 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Control-3439-164x270.png [thumb_385_270-width] => 164 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Control-3439-147x241.png [thumb_416_241-width] => 147 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_448_410-width] => 239 [thumb_448_410-height] => 393 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_448_410_retina-width] => 239 [thumb_448_410_retina-height] => 393 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Control-3439-232x382.png [thumb_574_382-width] => 232 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [thumb_776_395-width] => 239 [thumb_776_395-height] => 393 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-sm-width] => 182 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-md-width] => 239 [gform-image-choice-md-height] => 393 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Control-3439.png [gform-image-choice-lg-width] => 239 [gform-image-choice-lg-height] => 393 ) ) [1] => Array ( [ID] => 43883 [id] => 43883 [title] => Treatment_#1.png [filename] => Treatment_1-1009.png [filesize] => 116892 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/treatment_1-png-1172/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_1-png-1172 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:53:32 [modified] => 2022-10-31 13:53:32 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 244 [height] => 394 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-186x300.png [medium-width] => 186 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [medium_large-width] => 244 [medium_large-height] => 394 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [large-width] => 244 [large-height] => 394 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [1536x1536-width] => 244 [1536x1536-height] => 394 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [2048x2048-width] => 244 [2048x2048-height] => 394 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [tp-image-grid-width] => 244 [tp-image-grid-height] => 394 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-31x50.png [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [full-width] => 244 [full-height] => 394 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372-width] => 244 [thumb_372-height] => 394 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [single_post_thumbnail-width] => 244 [single_post_thumbnail-height] => 394 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-79x128.png [thumb_128_128-width] => 79 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-41x67.png [thumb_122_67-width] => 41 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-95x153.png [thumb_153_153-width] => 95 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-101x163.png [thumb_130_163-width] => 101 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-110x177.png [thumb_232_177-width] => 110 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_272_325-width] => 244 [thumb_272_325-height] => 394 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-214x346.png [thumb_271_346-width] => 214 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-168x271.png [thumb_271_271-width] => 168 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-107x172.png [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372_461-width] => 244 [thumb_372_461-height] => 394 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_372_500-width] => 244 [thumb_372_500-height] => 394 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-167x270.png [thumb_385_270-width] => 167 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-149x241.png [thumb_416_241-width] => 149 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_448_410-width] => 244 [thumb_448_410-height] => 394 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_448_410_retina-width] => 244 [thumb_448_410_retina-height] => 394 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009-237x382.png [thumb_574_382-width] => 237 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [thumb_776_395-width] => 244 [thumb_776_395-height] => 394 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-sm-width] => 186 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-md-width] => 244 [gform-image-choice-md-height] => 394 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_1-1009.png [gform-image-choice-lg-width] => 244 [gform-image-choice-lg-height] => 394 ) ) [2] => Array ( [ID] => 43888 [id] => 43888 [title] => Treatment_#2.png [filename] => Treatment_2-80.png [filesize] => 112742 [url] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [link] => https://www.nextafter.com/experiments/how-asking-an-open-loop-question-on-an-ad-image-affects-click-through-rates/attachment/treatment_2-png-87/ [alt] => [author] => 0 [description] => [caption] => [name] => treatment_2-png-87 [status] => inherit [uploaded_to] => 29374 [date] => 2022-10-31 13:54:06 [modified] => 2022-10-31 13:54:06 [menu_order] => 0 [mime_type] => image/png [type] => image [subtype] => png [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 245 [height] => 393 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x150.png [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-187x300.png [medium-width] => 187 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [medium_large-width] => 245 [medium_large-height] => 393 [large] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [large-width] => 245 [large-height] => 393 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [1536x1536-width] => 245 [1536x1536-height] => 393 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [2048x2048-width] => 245 [2048x2048-height] => 393 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [tp-image-grid-width] => 245 [tp-image-grid-height] => 393 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x150.png [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-31x50.png [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [full-width] => 245 [full-height] => 393 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372-width] => 245 [thumb_372-height] => 393 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [single_post_thumbnail-width] => 245 [single_post_thumbnail-height] => 393 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-20x32.png [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-30x48.png [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-40x64.png [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-80x128.png [thumb_128_128-width] => 80 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-42x67.png [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-95x153.png [thumb_153_153-width] => 95 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-102x163.png [thumb_130_163-width] => 102 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-110x177.png [thumb_232_177-width] => 110 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_272_325-width] => 245 [thumb_272_325-height] => 393 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-216x346.png [thumb_271_346-width] => 216 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-169x271.png [thumb_271_271-width] => 169 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-107x172.png [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372_461-width] => 245 [thumb_372_461-height] => 393 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_372_500-width] => 245 [thumb_372_500-height] => 393 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-168x270.png [thumb_385_270-width] => 168 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-150x241.png [thumb_416_241-width] => 150 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_448_410-width] => 245 [thumb_448_410-height] => 393 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_448_410_retina-width] => 245 [thumb_448_410_retina-height] => 393 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80-238x382.png [thumb_574_382-width] => 238 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [thumb_776_395-width] => 245 [thumb_776_395-height] => 393 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-sm-width] => 187 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-md-width] => 245 [gform-image-choice-md-height] => 393 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Treatment_2-80.png [gform-image-choice-lg-width] => 245 [gform-image-choice-lg-height] => 393 ) ) )

Results

  Treatment Name Click Rate Relative Difference Confidence
C: Control 0.52%
T1: Treatment #1 0.51% -0.8% 5.1%
T2: Treatment #2 2.1% 307.8% 100.0%

This experiment has a required sample size of 766 in order to be valid. Since the experiment had a total sample size of 195,623, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    307.8% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

After running the test for 30 days, Heritage observed that treatment #2 (with open loop question on ad image) produced a dramatic lift of 304% with a 100% LoC. This indicates that by opening a loop of curiosity on the most prominent part of the ad, Heritage was able to inspire more people to click through, presumably because they wanted to test their knowledge — confirming the hypothesis that creating curiosity would result in a lift in clicks.

This test also supports the general supposition that making changes to the ad's most prominent element - the ad image - may have a greater impact than making similar changes to the body copy, which is less prominent.

Next, Heritage may choose to test a single element of this concept — either the ad image or the value prop language — to see which element has a bigger impact when changed. But for now, we can conclude that:

  1. Making changes to the ad image has a larger impact on performance than changing the body copy
  2. Opening a loop of curiosity is likely to encourage more people to click through

Experiment Documented by NextAfter

Question about experiment #96562

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.