NextAfter

How a more specific subject line affects opens, clicks, and conversions

Experiment ID: #7403

NextAfter

Experiment Summary

Timeframe: 10/16/2018 - 10/24/2018

In this email experiment, the original subject line posed a question that would be completely normal to receive from a colleague at this time of year…”How are your year-end plans coming?” It felt personal and genuine, but we wondered if it wasn’t doing enough to prime recipients for the upcoming call-to-action. So for the treatment, we created an subject like that maintained the personal nature (using the word “you”) and increased the specificity and clarity around what the content of the email was ultimately leading towards. For the treatment, we said “A new year-end fundraising webinar for you”.

Research Question

Will a more specific subject line lead to greater email performance?

Design

C: How are your year-end plans coming?
Array ( [0] => Array ( [ID] => 24831 [id] => 24831 [title] => How_are_your_year-end_plans_coming?.jpg [filename] => How_are_your_year-end_plans_coming-2.jpg [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [link] => https://www.nextafter.com/experiments/how-a-more-specific-subject-line-affects-opens-clicks-and-conversions/attachment/how_are_your_year-end_plans_coming-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => how_are_your_year-end_plans_coming-jpg-3 [status] => inherit [uploaded_to] => 15405 [date] => 2021-12-31 01:16:39 [modified] => 2021-12-31 01:16:39 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 332 [height] => 240 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-300x217.jpg [medium-width] => 300 [medium-height] => 217 [medium_large] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [medium_large-width] => 332 [medium_large-height] => 240 [large] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [large-width] => 332 [large-height] => 240 [1536x1536] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [1536x1536-width] => 332 [1536x1536-height] => 240 [2048x2048] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [2048x2048-width] => 332 [2048x2048-height] => 240 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [tp-image-grid-width] => 332 [tp-image-grid-height] => 240 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-50x36.jpg [admin-width] => 50 [admin-height] => 36 [full] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [full-width] => 332 [full-height] => 240 [thumb_372] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_372-width] => 332 [thumb_372-height] => 240 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [single_post_thumbnail-width] => 332 [single_post_thumbnail-height] => 240 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-48x35.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 35 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-64x46.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 46 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-128x93.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 93 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-93x67.jpg [thumb_122_67-width] => 93 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-153x111.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 111 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-130x94.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 94 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-232x168.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 168 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_272_325-width] => 332 [thumb_272_325-height] => 240 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-271x196.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 196 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-271x196.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 196 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-238x172.jpg [thumb_272_172-width] => 238 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_372_461-width] => 332 [thumb_372_461-height] => 240 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_372_500-width] => 332 [thumb_372_500-height] => 240 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_385_270-width] => 332 [thumb_385_270-height] => 240 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_416_241-width] => 332 [thumb_416_241-height] => 240 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_448_410-width] => 332 [thumb_448_410-height] => 240 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_448_410_retina-width] => 332 [thumb_448_410_retina-height] => 240 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_574_382-width] => 332 [thumb_574_382-height] => 240 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_776_395-width] => 332 [thumb_776_395-height] => 240 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 217 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [gform-image-choice-md-width] => 332 [gform-image-choice-md-height] => 240 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [gform-image-choice-lg-width] => 332 [gform-image-choice-lg-height] => 240 ) ) [1] => Array ( [ID] => 24832 [id] => 24832 [title] => A_new_year-end_fundraising_webinar_for_you.jpg [filename] => A_new_year-end_fundraising_webinar_for_you-2.jpg [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [link] => https://www.nextafter.com/experiments/how-a-more-specific-subject-line-affects-opens-clicks-and-conversions/attachment/a_new_year-end_fundraising_webinar_for_you-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => a_new_year-end_fundraising_webinar_for_you-jpg-3 [status] => inherit [uploaded_to] => 15405 [date] => 2021-12-31 01:16:44 [modified] => 2021-12-31 01:16:44 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 328 [height] => 240 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-300x220.jpg [medium-width] => 300 [medium-height] => 220 [medium_large] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [medium_large-width] => 328 [medium_large-height] => 240 [large] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [large-width] => 328 [large-height] => 240 [1536x1536] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [1536x1536-width] => 328 [1536x1536-height] => 240 [2048x2048] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [2048x2048-width] => 328 [2048x2048-height] => 240 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [tp-image-grid-width] => 328 [tp-image-grid-height] => 240 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-50x37.jpg [admin-width] => 50 [admin-height] => 37 [full] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [full-width] => 328 [full-height] => 240 [thumb_372] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_372-width] => 328 [thumb_372-height] => 240 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [single_post_thumbnail-width] => 328 [single_post_thumbnail-height] => 240 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-48x35.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 35 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-64x47.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 47 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-128x94.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 94 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-92x67.jpg [thumb_122_67-width] => 92 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-153x112.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 112 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-130x95.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 95 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-232x170.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 170 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_272_325-width] => 328 [thumb_272_325-height] => 240 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-271x198.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 198 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-271x198.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 198 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-235x172.jpg [thumb_272_172-width] => 235 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_372_461-width] => 328 [thumb_372_461-height] => 240 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_372_500-width] => 328 [thumb_372_500-height] => 240 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_385_270-width] => 328 [thumb_385_270-height] => 240 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_416_241-width] => 328 [thumb_416_241-height] => 240 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_448_410-width] => 328 [thumb_448_410-height] => 240 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_448_410_retina-width] => 328 [thumb_448_410_retina-height] => 240 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_574_382-width] => 328 [thumb_574_382-height] => 240 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_776_395-width] => 328 [thumb_776_395-height] => 240 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 220 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [gform-image-choice-md-width] => 328 [gform-image-choice-md-height] => 240 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [gform-image-choice-lg-width] => 328 [gform-image-choice-lg-height] => 240 ) ) )
T1: A new year-end fundraising webinar for you
Array ( [0] => Array ( [ID] => 24831 [id] => 24831 [title] => How_are_your_year-end_plans_coming?.jpg [filename] => How_are_your_year-end_plans_coming-2.jpg [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [link] => https://www.nextafter.com/experiments/how-a-more-specific-subject-line-affects-opens-clicks-and-conversions/attachment/how_are_your_year-end_plans_coming-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => how_are_your_year-end_plans_coming-jpg-3 [status] => inherit [uploaded_to] => 15405 [date] => 2021-12-31 01:16:39 [modified] => 2021-12-31 01:16:39 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 332 [height] => 240 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-300x217.jpg [medium-width] => 300 [medium-height] => 217 [medium_large] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [medium_large-width] => 332 [medium_large-height] => 240 [large] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [large-width] => 332 [large-height] => 240 [1536x1536] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [1536x1536-width] => 332 [1536x1536-height] => 240 [2048x2048] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [2048x2048-width] => 332 [2048x2048-height] => 240 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [tp-image-grid-width] => 332 [tp-image-grid-height] => 240 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-50x36.jpg [admin-width] => 50 [admin-height] => 36 [full] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [full-width] => 332 [full-height] => 240 [thumb_372] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_372-width] => 332 [thumb_372-height] => 240 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [single_post_thumbnail-width] => 332 [single_post_thumbnail-height] => 240 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-48x35.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 35 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-64x46.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 46 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-128x93.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 93 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-93x67.jpg [thumb_122_67-width] => 93 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-153x111.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 111 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-130x94.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 94 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-232x168.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 168 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_272_325-width] => 332 [thumb_272_325-height] => 240 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-271x196.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 196 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-271x196.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 196 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2-238x172.jpg [thumb_272_172-width] => 238 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_372_461-width] => 332 [thumb_372_461-height] => 240 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_372_500-width] => 332 [thumb_372_500-height] => 240 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_385_270-width] => 332 [thumb_385_270-height] => 240 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_416_241-width] => 332 [thumb_416_241-height] => 240 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_448_410-width] => 332 [thumb_448_410-height] => 240 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_448_410_retina-width] => 332 [thumb_448_410_retina-height] => 240 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_574_382-width] => 332 [thumb_574_382-height] => 240 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [thumb_776_395-width] => 332 [thumb_776_395-height] => 240 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 217 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [gform-image-choice-md-width] => 332 [gform-image-choice-md-height] => 240 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/How_are_your_year-end_plans_coming-2.jpg [gform-image-choice-lg-width] => 332 [gform-image-choice-lg-height] => 240 ) ) [1] => Array ( [ID] => 24832 [id] => 24832 [title] => A_new_year-end_fundraising_webinar_for_you.jpg [filename] => A_new_year-end_fundraising_webinar_for_you-2.jpg [filesize] => 0 [url] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [link] => https://www.nextafter.com/experiments/how-a-more-specific-subject-line-affects-opens-clicks-and-conversions/attachment/a_new_year-end_fundraising_webinar_for_you-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => a_new_year-end_fundraising_webinar_for_you-jpg-3 [status] => inherit [uploaded_to] => 15405 [date] => 2021-12-31 01:16:44 [modified] => 2021-12-31 01:16:44 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 328 [height] => 240 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-300x220.jpg [medium-width] => 300 [medium-height] => 220 [medium_large] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [medium_large-width] => 328 [medium_large-height] => 240 [large] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [large-width] => 328 [large-height] => 240 [1536x1536] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [1536x1536-width] => 328 [1536x1536-height] => 240 [2048x2048] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [2048x2048-width] => 328 [2048x2048-height] => 240 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [tp-image-grid-width] => 328 [tp-image-grid-height] => 240 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-50x37.jpg [admin-width] => 50 [admin-height] => 37 [full] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [full-width] => 328 [full-height] => 240 [thumb_372] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_372-width] => 328 [thumb_372-height] => 240 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [single_post_thumbnail-width] => 328 [single_post_thumbnail-height] => 240 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-32x23.jpg [thumb_32_32-width] => 32 [thumb_32_32-height] => 23 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-48x35.jpg [thumb_48_48-width] => 48 [thumb_48_48-height] => 35 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-64x47.jpg [thumb_64_64-width] => 64 [thumb_64_64-height] => 47 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-128x94.jpg [thumb_128_128-width] => 128 [thumb_128_128-height] => 94 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-92x67.jpg [thumb_122_67-width] => 92 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-153x112.jpg [thumb_153_153-width] => 153 [thumb_153_153-height] => 112 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-130x95.jpg [thumb_130_163-width] => 130 [thumb_130_163-height] => 95 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-232x170.jpg [thumb_232_177-width] => 232 [thumb_232_177-height] => 170 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_272_325-width] => 328 [thumb_272_325-height] => 240 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-271x198.jpg [thumb_271_346-width] => 271 [thumb_271_346-height] => 198 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-271x198.jpg [thumb_271_271-width] => 271 [thumb_271_271-height] => 198 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2-235x172.jpg [thumb_272_172-width] => 235 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_372_461-width] => 328 [thumb_372_461-height] => 240 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_372_500-width] => 328 [thumb_372_500-height] => 240 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_385_270-width] => 328 [thumb_385_270-height] => 240 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_416_241-width] => 328 [thumb_416_241-height] => 240 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_448_410-width] => 328 [thumb_448_410-height] => 240 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_448_410_retina-width] => 328 [thumb_448_410_retina-height] => 240 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_574_382-width] => 328 [thumb_574_382-height] => 240 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [thumb_776_395-width] => 328 [thumb_776_395-height] => 240 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [gform-image-choice-sm-width] => 300 [gform-image-choice-sm-height] => 220 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [gform-image-choice-md-width] => 328 [gform-image-choice-md-height] => 240 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/A_new_year-end_fundraising_webinar_for_you-2.jpg [gform-image-choice-lg-width] => 328 [gform-image-choice-lg-height] => 240 ) ) )

Results

  Treatment Name Click Rate Relative Difference Confidence
C: How are your year-end plans coming? 4.2%
T1: A new year-end fundraising webinar for you 6.0% 42.7% 100.0%

This experiment has a required sample size of 1,164 in order to be valid. Since the experiment had a total sample size of 7,814, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    42.7% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

As we've seen in the past, even when the subject line doesn't affect the open rate, it can still have a dramatic effect on downstream metrics. In this case, the open rate remained nearly identical – 36.14% vs 36.16%. But the treatment version increased clicks to the webinar registration page by 42.7% at a 99% level of confidence.

The treatment also increased webinar registrations by 18.8% and was approaching statistical validity at an 89% level of confidence. This shows us 2 important learnings: 1 - The subject line has a powerful effect on how recipients view and respond to the entire email, even if it makes no difference in the open rate. 2 - A subject line that makes a clear tie to the ultimate call-to-action has a greater chance of getting a click and a conversion.


Experiment Documented by Nathan Hill

Question about experiment #7403

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.