How emotive headline copy affects email acquisition rate
Experiment ID: #6417
Hillsdale College
Experiment Summary
Timeframe: 03/10/2017 - 03/31/2017
Hillsdale College launched an updated version of their popular history course, American Heritage. They had received feedback on the original version of the course from many subscribers that the course “taught history the way it should be taught in school.” They decided to test whether this was a value proposition that resonated with others by crafting a similar headline: “Learn the history of America—the way it should be taught in school.” However, they feared that this might be too negative of a headline—and too focused on what is not taught in school, rather than what is taught in the course. So they created a treatment with highly emotive language: “Deepen your understanding of the incredible story of American Liberty.”
They kept all the other elements on the page the same, and launched an A/B headline test.
Research Question
Will emotive headline copy produce an increase in email acquisition rate?
Design
C: Control
Array
(
[0] => Array
(
[ID] => 13539
[id] => 13539
[title] => American Heritage | Hillsdale College
[filename] => hillsdale-control-2.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[link] => https://www.nextafter.com/experiments/how-emotive-headline-copy-affects-email-acquisition/attachment/american-heritage-hillsdale-college/
[alt] =>
[author] => 6
[description] =>
[caption] =>
[name] => american-heritage-hillsdale-college
[status] => inherit
[uploaded_to] => 13538
[date] => 2021-02-25 06:26:10
[modified] => 2021-02-25 06:26:10
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 930
[height] => 1303
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-214x300.jpg
[medium-width] => 214
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-768x1076.jpg
[medium_large-width] => 640
[medium_large-height] => 897
[large] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-731x1024.jpg
[large-width] => 640
[large-height] => 897
[1536x1536] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[1536x1536-width] => 930
[1536x1536-height] => 1303
[2048x2048] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[2048x2048-width] => 930
[2048x2048-height] => 1303
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[tp-image-grid-width] => 500
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[full-width] => 930
[full-height] => 1303
[thumb_372] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-372x521.jpg
[thumb_372-width] => 372
[thumb_372-height] => 521
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-446x625.jpg
[single_post_thumbnail-width] => 446
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-91x128.jpg
[thumb_128_128-width] => 91
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-109x153.jpg
[thumb_153_153-width] => 109
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-116x163.jpg
[thumb_130_163-width] => 116
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-126x177.jpg
[thumb_232_177-width] => 126
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-464x650.jpg
[thumb_272_325-width] => 464
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-247x346.jpg
[thumb_271_346-width] => 247
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-193x271.jpg
[thumb_271_271-width] => 193
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-123x172.jpg
[thumb_272_172-width] => 123
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-329x461.jpg
[thumb_372_461-width] => 329
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-357x500.jpg
[thumb_372_500-width] => 357
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-193x270.jpg
[thumb_385_270-width] => 193
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-172x241.jpg
[thumb_416_241-width] => 172
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-293x410.jpg
[thumb_448_410-width] => 293
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-585x820.jpg
[thumb_448_410_retina-width] => 585
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-273x382.jpg
[thumb_574_382-width] => 273
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-282x395.jpg
[thumb_776_395-width] => 282
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[gform-image-choice-sm-width] => 214
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[gform-image-choice-md-width] => 285
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[gform-image-choice-lg-width] => 428
[gform-image-choice-lg-height] => 600
)
)
[1] => Array
(
[ID] => 13540
[id] => 13540
[title] => American Heritage | Hillsdale College
[filename] => hillsdale-treatment-1.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[link] => https://www.nextafter.com/experiments/how-emotive-headline-copy-affects-email-acquisition/attachment/american-heritage-hillsdale-college-2/
[alt] =>
[author] => 6
[description] =>
[caption] =>
[name] => american-heritage-hillsdale-college-2
[status] => inherit
[uploaded_to] => 13538
[date] => 2021-02-25 06:26:17
[modified] => 2021-02-25 06:26:17
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 930
[height] => 1303
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-214x300.jpg
[medium-width] => 214
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-768x1076.jpg
[medium_large-width] => 640
[medium_large-height] => 897
[large] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-731x1024.jpg
[large-width] => 640
[large-height] => 897
[1536x1536] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[1536x1536-width] => 930
[1536x1536-height] => 1303
[2048x2048] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[2048x2048-width] => 930
[2048x2048-height] => 1303
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[tp-image-grid-width] => 500
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[full-width] => 930
[full-height] => 1303
[thumb_372] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-372x521.jpg
[thumb_372-width] => 372
[thumb_372-height] => 521
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-446x625.jpg
[single_post_thumbnail-width] => 446
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-91x128.jpg
[thumb_128_128-width] => 91
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-109x153.jpg
[thumb_153_153-width] => 109
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-116x163.jpg
[thumb_130_163-width] => 116
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-126x177.jpg
[thumb_232_177-width] => 126
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-464x650.jpg
[thumb_272_325-width] => 464
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-247x346.jpg
[thumb_271_346-width] => 247
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-193x271.jpg
[thumb_271_271-width] => 193
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-123x172.jpg
[thumb_272_172-width] => 123
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-329x461.jpg
[thumb_372_461-width] => 329
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-357x500.jpg
[thumb_372_500-width] => 357
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-193x270.jpg
[thumb_385_270-width] => 193
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-172x241.jpg
[thumb_416_241-width] => 172
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-293x410.jpg
[thumb_448_410-width] => 293
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-585x820.jpg
[thumb_448_410_retina-width] => 585
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-273x382.jpg
[thumb_574_382-width] => 273
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-282x395.jpg
[thumb_776_395-width] => 282
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[gform-image-choice-sm-width] => 214
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[gform-image-choice-md-width] => 285
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[gform-image-choice-lg-width] => 428
[gform-image-choice-lg-height] => 600
)
)
)
T1: Treatment 1
Array
(
[0] => Array
(
[ID] => 13539
[id] => 13539
[title] => American Heritage | Hillsdale College
[filename] => hillsdale-control-2.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[link] => https://www.nextafter.com/experiments/how-emotive-headline-copy-affects-email-acquisition/attachment/american-heritage-hillsdale-college/
[alt] =>
[author] => 6
[description] =>
[caption] =>
[name] => american-heritage-hillsdale-college
[status] => inherit
[uploaded_to] => 13538
[date] => 2021-02-25 06:26:10
[modified] => 2021-02-25 06:26:10
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 930
[height] => 1303
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-214x300.jpg
[medium-width] => 214
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-768x1076.jpg
[medium_large-width] => 640
[medium_large-height] => 897
[large] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-731x1024.jpg
[large-width] => 640
[large-height] => 897
[1536x1536] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[1536x1536-width] => 930
[1536x1536-height] => 1303
[2048x2048] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[2048x2048-width] => 930
[2048x2048-height] => 1303
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[tp-image-grid-width] => 500
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[full-width] => 930
[full-height] => 1303
[thumb_372] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-372x521.jpg
[thumb_372-width] => 372
[thumb_372-height] => 521
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-446x625.jpg
[single_post_thumbnail-width] => 446
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-91x128.jpg
[thumb_128_128-width] => 91
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-109x153.jpg
[thumb_153_153-width] => 109
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-116x163.jpg
[thumb_130_163-width] => 116
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-126x177.jpg
[thumb_232_177-width] => 126
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-464x650.jpg
[thumb_272_325-width] => 464
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-247x346.jpg
[thumb_271_346-width] => 247
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-193x271.jpg
[thumb_271_271-width] => 193
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-123x172.jpg
[thumb_272_172-width] => 123
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-329x461.jpg
[thumb_372_461-width] => 329
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-357x500.jpg
[thumb_372_500-width] => 357
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-193x270.jpg
[thumb_385_270-width] => 193
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-172x241.jpg
[thumb_416_241-width] => 172
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-293x410.jpg
[thumb_448_410-width] => 293
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-585x820.jpg
[thumb_448_410_retina-width] => 585
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-273x382.jpg
[thumb_574_382-width] => 273
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2-282x395.jpg
[thumb_776_395-width] => 282
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[gform-image-choice-sm-width] => 214
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[gform-image-choice-md-width] => 285
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/hillsdale-control-2.jpg
[gform-image-choice-lg-width] => 428
[gform-image-choice-lg-height] => 600
)
)
[1] => Array
(
[ID] => 13540
[id] => 13540
[title] => American Heritage | Hillsdale College
[filename] => hillsdale-treatment-1.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[link] => https://www.nextafter.com/experiments/how-emotive-headline-copy-affects-email-acquisition/attachment/american-heritage-hillsdale-college-2/
[alt] =>
[author] => 6
[description] =>
[caption] =>
[name] => american-heritage-hillsdale-college-2
[status] => inherit
[uploaded_to] => 13538
[date] => 2021-02-25 06:26:17
[modified] => 2021-02-25 06:26:17
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 930
[height] => 1303
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-214x300.jpg
[medium-width] => 214
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-768x1076.jpg
[medium_large-width] => 640
[medium_large-height] => 897
[large] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-731x1024.jpg
[large-width] => 640
[large-height] => 897
[1536x1536] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[1536x1536-width] => 930
[1536x1536-height] => 1303
[2048x2048] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[2048x2048-width] => 930
[2048x2048-height] => 1303
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[tp-image-grid-width] => 500
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-36x50.jpg
[admin-width] => 36
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[full-width] => 930
[full-height] => 1303
[thumb_372] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-372x521.jpg
[thumb_372-width] => 372
[thumb_372-height] => 521
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-446x625.jpg
[single_post_thumbnail-width] => 446
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-23x32.jpg
[thumb_32_32-width] => 23
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-34x48.jpg
[thumb_48_48-width] => 34
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-46x64.jpg
[thumb_64_64-width] => 46
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-91x128.jpg
[thumb_128_128-width] => 91
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-48x67.jpg
[thumb_122_67-width] => 48
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-109x153.jpg
[thumb_153_153-width] => 109
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-116x163.jpg
[thumb_130_163-width] => 116
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-126x177.jpg
[thumb_232_177-width] => 126
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-464x650.jpg
[thumb_272_325-width] => 464
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-247x346.jpg
[thumb_271_346-width] => 247
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-193x271.jpg
[thumb_271_271-width] => 193
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-123x172.jpg
[thumb_272_172-width] => 123
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-329x461.jpg
[thumb_372_461-width] => 329
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-357x500.jpg
[thumb_372_500-width] => 357
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-193x270.jpg
[thumb_385_270-width] => 193
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-172x241.jpg
[thumb_416_241-width] => 172
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-293x410.jpg
[thumb_448_410-width] => 293
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-585x820.jpg
[thumb_448_410_retina-width] => 585
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-273x382.jpg
[thumb_574_382-width] => 273
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1-282x395.jpg
[thumb_776_395-width] => 282
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[gform-image-choice-sm-width] => 214
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[gform-image-choice-md-width] => 285
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/hillsdale-treatment-1.jpg
[gform-image-choice-lg-width] => 428
[gform-image-choice-lg-height] => 600
)
)
)
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | Control | 13.1% | ||
| T1: | Treatment 1 | 35.3% | 168.7% | 100.0% |
This experiment has a required sample size of 28 in order to be valid. Since the experiment had a total sample size of 2,356, and the level of confidence is above 95% the experiment results are valid.
Flux Metrics Affected
The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:
0% increase in traffic
× 168.7% increase in conversion rate
× 0% increase in average gift
Key Learnings
The treatment headline with the emotive language produced a 168.7% lift over the headline related to what is not taught in schools. This produced a valuable learning about motivation to enroll in the free course: we must orient our language around what the course does for the user, rather than align with a belief (even if it is true) about what the course replaces in the public sphere.
When a visitor comes to the page from an ad, they are motivated to do something, and our language must continue that momentum rather than causing their mind to drift elsewhere. Even if they align with the value proposition, a headline that doesn’t focus on what the course will do for them can mentally distract them from the ultimate goal of enrollment.