The Fund for American Studies

How changing the sender of the newsletter impacted email engagement rates

Experiment ID: #33651

The Fund for American Studies

Experiment Summary

Timeframe: 07/17/2020 - 07/24/2020

As a part of optimizing their program, TFAS wondered if switching who sent their weekly newsletter email to subscribers could improve their email engagement rates. To test this experiment, we decided to send three straight weekly newsletters and combine the results so as to mitigate false readings from a single email send.

Research Question

Would changing the newsletter sender increase email engagement rates?

Design

C: Reply To: rogerream@TFAS.org - From: Roger Ream
Array ( [0] => Array ( [ID] => 43255 [id] => 43255 [title] => Reply_To:_rogerream@TFAS.org_-_From:_Roger_Ream.jpg [filename] => Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [filesize] => 187978 [url] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [link] => https://www.nextafter.com/experiments/how-changing-the-sender-of-the-newsletter-impacted-email-engagement-rates/attachment/reply_to_rogerreamtfas-org_-_from_roger_ream-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => reply_to_rogerreamtfas-org_-_from_roger_ream-jpg-3 [status] => inherit [uploaded_to] => 17241 [date] => 2022-10-28 21:57:54 [modified] => 2022-10-28 21:57:54 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 800 [height] => 1281 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-187x300.jpg [medium-width] => 187 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-768x1230.jpg [medium_large-width] => 640 [medium_large-height] => 1025 [large] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-640x1024.jpg [large-width] => 640 [large-height] => 1024 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [1536x1536-width] => 800 [1536x1536-height] => 1281 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [2048x2048-width] => 800 [2048x2048-height] => 1281 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [tp-image-grid-width] => 437 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-31x50.jpg [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [full-width] => 800 [full-height] => 1281 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-372x596.jpg [thumb_372-width] => 372 [thumb_372-height] => 596 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-390x625.jpg [single_post_thumbnail-width] => 390 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-20x32.jpg [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-30x48.jpg [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-40x64.jpg [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-80x128.jpg [thumb_128_128-width] => 80 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-42x67.jpg [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-96x153.jpg [thumb_153_153-width] => 96 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-102x163.jpg [thumb_130_163-width] => 102 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-111x177.jpg [thumb_232_177-width] => 111 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-406x650.jpg [thumb_272_325-width] => 406 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-216x346.jpg [thumb_271_346-width] => 216 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-169x271.jpg [thumb_271_271-width] => 169 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-107x172.jpg [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-288x461.jpg [thumb_372_461-width] => 288 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-312x500.jpg [thumb_372_500-width] => 312 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-169x270.jpg [thumb_385_270-width] => 169 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-151x241.jpg [thumb_416_241-width] => 151 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-256x410.jpg [thumb_448_410-width] => 256 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-512x820.jpg [thumb_448_410_retina-width] => 512 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-239x382.jpg [thumb_574_382-width] => 239 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-247x395.jpg [thumb_776_395-width] => 247 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [gform-image-choice-sm-width] => 187 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [gform-image-choice-md-width] => 250 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [gform-image-choice-lg-width] => 375 [gform-image-choice-lg-height] => 600 ) ) [1] => Array ( [ID] => 43258 [id] => 43258 [title] => Reply_To:_kristin@TFAS.org_-_From:_Kristin,_TFAS_Communications.jpg [filename] => Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [filesize] => 187978 [url] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [link] => https://www.nextafter.com/experiments/how-changing-the-sender-of-the-newsletter-impacted-email-engagement-rates/attachment/reply_to_kristintfas-org_-_from_kristin_tfas_communications-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => reply_to_kristintfas-org_-_from_kristin_tfas_communications-jpg-3 [status] => inherit [uploaded_to] => 17241 [date] => 2022-10-28 21:58:21 [modified] => 2022-10-28 21:58:21 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 800 [height] => 1281 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-187x300.jpg [medium-width] => 187 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-768x1230.jpg [medium_large-width] => 640 [medium_large-height] => 1025 [large] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-640x1024.jpg [large-width] => 640 [large-height] => 1024 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [1536x1536-width] => 800 [1536x1536-height] => 1281 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [2048x2048-width] => 800 [2048x2048-height] => 1281 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [tp-image-grid-width] => 437 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-31x50.jpg [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [full-width] => 800 [full-height] => 1281 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-372x596.jpg [thumb_372-width] => 372 [thumb_372-height] => 596 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-390x625.jpg [single_post_thumbnail-width] => 390 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-20x32.jpg [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-30x48.jpg [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-40x64.jpg [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-80x128.jpg [thumb_128_128-width] => 80 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-42x67.jpg [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-96x153.jpg [thumb_153_153-width] => 96 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-102x163.jpg [thumb_130_163-width] => 102 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-111x177.jpg [thumb_232_177-width] => 111 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-406x650.jpg [thumb_272_325-width] => 406 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-216x346.jpg [thumb_271_346-width] => 216 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-169x271.jpg [thumb_271_271-width] => 169 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-107x172.jpg [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-288x461.jpg [thumb_372_461-width] => 288 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-312x500.jpg [thumb_372_500-width] => 312 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-169x270.jpg [thumb_385_270-width] => 169 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-151x241.jpg [thumb_416_241-width] => 151 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-256x410.jpg [thumb_448_410-width] => 256 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-512x820.jpg [thumb_448_410_retina-width] => 512 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-239x382.jpg [thumb_574_382-width] => 239 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-247x395.jpg [thumb_776_395-width] => 247 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [gform-image-choice-sm-width] => 187 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [gform-image-choice-md-width] => 250 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [gform-image-choice-lg-width] => 375 [gform-image-choice-lg-height] => 600 ) ) )
T1: Reply To: kristin@TFAS.org - From: Kristin, TFAS Communications
Array ( [0] => Array ( [ID] => 43255 [id] => 43255 [title] => Reply_To:_rogerream@TFAS.org_-_From:_Roger_Ream.jpg [filename] => Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [filesize] => 187978 [url] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [link] => https://www.nextafter.com/experiments/how-changing-the-sender-of-the-newsletter-impacted-email-engagement-rates/attachment/reply_to_rogerreamtfas-org_-_from_roger_ream-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => reply_to_rogerreamtfas-org_-_from_roger_ream-jpg-3 [status] => inherit [uploaded_to] => 17241 [date] => 2022-10-28 21:57:54 [modified] => 2022-10-28 21:57:54 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 800 [height] => 1281 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-187x300.jpg [medium-width] => 187 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-768x1230.jpg [medium_large-width] => 640 [medium_large-height] => 1025 [large] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-640x1024.jpg [large-width] => 640 [large-height] => 1024 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [1536x1536-width] => 800 [1536x1536-height] => 1281 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [2048x2048-width] => 800 [2048x2048-height] => 1281 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [tp-image-grid-width] => 437 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-31x50.jpg [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [full-width] => 800 [full-height] => 1281 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-372x596.jpg [thumb_372-width] => 372 [thumb_372-height] => 596 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-390x625.jpg [single_post_thumbnail-width] => 390 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-20x32.jpg [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-30x48.jpg [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-40x64.jpg [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-80x128.jpg [thumb_128_128-width] => 80 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-42x67.jpg [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-96x153.jpg [thumb_153_153-width] => 96 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-102x163.jpg [thumb_130_163-width] => 102 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-111x177.jpg [thumb_232_177-width] => 111 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-406x650.jpg [thumb_272_325-width] => 406 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-216x346.jpg [thumb_271_346-width] => 216 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-169x271.jpg [thumb_271_271-width] => 169 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-107x172.jpg [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-288x461.jpg [thumb_372_461-width] => 288 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-312x500.jpg [thumb_372_500-width] => 312 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-169x270.jpg [thumb_385_270-width] => 169 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-151x241.jpg [thumb_416_241-width] => 151 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-256x410.jpg [thumb_448_410-width] => 256 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-512x820.jpg [thumb_448_410_retina-width] => 512 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-239x382.jpg [thumb_574_382-width] => 239 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3-247x395.jpg [thumb_776_395-width] => 247 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [gform-image-choice-sm-width] => 187 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [gform-image-choice-md-width] => 250 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Reply_To_rogerream@TFAS.org_-_From_Roger_Ream-3.jpg [gform-image-choice-lg-width] => 375 [gform-image-choice-lg-height] => 600 ) ) [1] => Array ( [ID] => 43258 [id] => 43258 [title] => Reply_To:_kristin@TFAS.org_-_From:_Kristin,_TFAS_Communications.jpg [filename] => Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [filesize] => 187978 [url] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [link] => https://www.nextafter.com/experiments/how-changing-the-sender-of-the-newsletter-impacted-email-engagement-rates/attachment/reply_to_kristintfas-org_-_from_kristin_tfas_communications-jpg-3/ [alt] => [author] => 0 [description] => [caption] => [name] => reply_to_kristintfas-org_-_from_kristin_tfas_communications-jpg-3 [status] => inherit [uploaded_to] => 17241 [date] => 2022-10-28 21:58:21 [modified] => 2022-10-28 21:58:21 [menu_order] => 0 [mime_type] => image/jpeg [type] => image [subtype] => jpeg [icon] => https://www.nextafter.com/wp-includes/images/media/default.png [width] => 800 [height] => 1281 [sizes] => Array ( [thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-150x150.jpg [thumbnail-width] => 150 [thumbnail-height] => 150 [medium] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-187x300.jpg [medium-width] => 187 [medium-height] => 300 [medium_large] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-768x1230.jpg [medium_large-width] => 640 [medium_large-height] => 1025 [large] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-640x1024.jpg [large-width] => 640 [large-height] => 1024 [1536x1536] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [1536x1536-width] => 800 [1536x1536-height] => 1281 [2048x2048] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [2048x2048-width] => 800 [2048x2048-height] => 1281 [tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [tp-image-grid-width] => 437 [tp-image-grid-height] => 700 [post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-150x150.jpg [post-thumbnail-width] => 150 [post-thumbnail-height] => 150 [admin] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-31x50.jpg [admin-width] => 31 [admin-height] => 50 [full] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [full-width] => 800 [full-height] => 1281 [thumb_372] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-372x596.jpg [thumb_372-width] => 372 [thumb_372-height] => 596 [single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-390x625.jpg [single_post_thumbnail-width] => 390 [single_post_thumbnail-height] => 625 [thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-20x32.jpg [thumb_32_32-width] => 20 [thumb_32_32-height] => 32 [thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-30x48.jpg [thumb_48_48-width] => 30 [thumb_48_48-height] => 48 [thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-40x64.jpg [thumb_64_64-width] => 40 [thumb_64_64-height] => 64 [thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-80x128.jpg [thumb_128_128-width] => 80 [thumb_128_128-height] => 128 [thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-42x67.jpg [thumb_122_67-width] => 42 [thumb_122_67-height] => 67 [thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-96x153.jpg [thumb_153_153-width] => 96 [thumb_153_153-height] => 153 [thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-102x163.jpg [thumb_130_163-width] => 102 [thumb_130_163-height] => 163 [thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-111x177.jpg [thumb_232_177-width] => 111 [thumb_232_177-height] => 177 [thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-406x650.jpg [thumb_272_325-width] => 406 [thumb_272_325-height] => 650 [thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-216x346.jpg [thumb_271_346-width] => 216 [thumb_271_346-height] => 346 [thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-169x271.jpg [thumb_271_271-width] => 169 [thumb_271_271-height] => 271 [thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-107x172.jpg [thumb_272_172-width] => 107 [thumb_272_172-height] => 172 [thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-288x461.jpg [thumb_372_461-width] => 288 [thumb_372_461-height] => 461 [thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-312x500.jpg [thumb_372_500-width] => 312 [thumb_372_500-height] => 500 [thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-169x270.jpg [thumb_385_270-width] => 169 [thumb_385_270-height] => 270 [thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-151x241.jpg [thumb_416_241-width] => 151 [thumb_416_241-height] => 241 [thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-256x410.jpg [thumb_448_410-width] => 256 [thumb_448_410-height] => 410 [thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-512x820.jpg [thumb_448_410_retina-width] => 512 [thumb_448_410_retina-height] => 820 [thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-239x382.jpg [thumb_574_382-width] => 239 [thumb_574_382-height] => 382 [thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3-247x395.jpg [thumb_776_395-width] => 247 [thumb_776_395-height] => 395 [gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [gform-image-choice-sm-width] => 187 [gform-image-choice-sm-height] => 300 [gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [gform-image-choice-md-width] => 250 [gform-image-choice-md-height] => 400 [gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Reply_To_kristin@TFAS.org_-_From_Kristin_TFAS_Communications-3.jpg [gform-image-choice-lg-width] => 375 [gform-image-choice-lg-height] => 600 ) ) )

Results

  Treatment Name Click Rate Relative Difference Confidence
C: Reply To: rogerream@TFAS.org - From: Roger Ream 0.82%
T1: Reply To: kristin@TFAS.org - From: Kristin, TFAS Communications 0.98% 19.1% 96.7%

This experiment has a required sample size of 27,637 in order to be valid. Since the experiment had a total sample size of 65,730, and the level of confidence is above 95% the experiment results are valid.

Flux Metrics Affected

The Flux Metrics analyze the three primary metrics that affect revenue (traffic, conversion rate, and average gift). This experiment produced the following results:

    19.1% increase in traffic
× 0% increase in conversion rate
× 0% increase in average gift

Key Learnings

With a 96.7% level of confidence across a combined three newsletters, we achieved a combined +19.1% increase in newsletter email clickthrough rates when using Kristin as the sender (instead of Roger).

Ironically, this is a directly proportionate increase relative to the percentage of increase we also observed in open rates (which was also +19.1% increase in open rate, with an LoC of 100%, as well).

This will increase the number of senders and immediately increase results. Moving forward, this could improve email engagement rates for key solicitation emails within the program sent by Roger, as well. 


Experiment Documented by Greg Colunga

Question about experiment #33651

If you have any questions about this experiment or would like additional details not discussed above, please feel free to contact them directly.