How the sender did not impact donor conversion rates for prospecting emails
Experiment ID: #11691
The Heritage Foundation
Experiment Summary
Timeframe: 01/28/2019 - 01/31/2019
With the senders in the 2018 Kickoff Campaign messaging no longer with the organization, we wanted to identify who should be the primary sender for consideration on the 2019 Kickoff Campaign messages through the email prospecting channel.
Research Question
Does the sender of the Kickoff Campaign messaging impact donor conversion rates at all?
Design
C: Sender: Andrew
Array
(
[0] => Array
(
[ID] => 15917
[id] => 15917
[title] => Sender_Andrew-5.jpg
[filename] => Sender_Andrew-5.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[link] => https://www.nextafter.com/experiments/how-the-sender-did-not-impact-donor-conversion-rates-for-prospecting-emails/attachment/sender_andrew-5-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => sender_andrew-5-jpg
[status] => inherit
[uploaded_to] => 15916
[date] => 2021-02-25 10:49:07
[modified] => 2021-02-25 10:49:07
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 637
[height] => 865
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-221x300.jpg
[medium-width] => 221
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[medium_large-width] => 637
[medium_large-height] => 865
[large] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[large-width] => 637
[large-height] => 865
[1536x1536] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[1536x1536-width] => 637
[1536x1536-height] => 865
[2048x2048] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[2048x2048-width] => 637
[2048x2048-height] => 865
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[tp-image-grid-width] => 515
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-37x50.jpg
[admin-width] => 37
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[full-width] => 637
[full-height] => 865
[thumb_372] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-372x505.jpg
[thumb_372-width] => 372
[thumb_372-height] => 505
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-460x625.jpg
[single_post_thumbnail-width] => 460
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-24x32.jpg
[thumb_32_32-width] => 24
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-35x48.jpg
[thumb_48_48-width] => 35
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-47x64.jpg
[thumb_64_64-width] => 47
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-94x128.jpg
[thumb_128_128-width] => 94
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-49x67.jpg
[thumb_122_67-width] => 49
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-113x153.jpg
[thumb_153_153-width] => 113
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-120x163.jpg
[thumb_130_163-width] => 120
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-130x177.jpg
[thumb_232_177-width] => 130
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-479x650.jpg
[thumb_272_325-width] => 479
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-255x346.jpg
[thumb_271_346-width] => 255
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-200x271.jpg
[thumb_271_271-width] => 200
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-127x172.jpg
[thumb_272_172-width] => 127
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-339x461.jpg
[thumb_372_461-width] => 339
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-368x500.jpg
[thumb_372_500-width] => 368
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-199x270.jpg
[thumb_385_270-width] => 199
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-177x241.jpg
[thumb_416_241-width] => 177
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-302x410.jpg
[thumb_448_410-width] => 302
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-604x820.jpg
[thumb_448_410_retina-width] => 604
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-281x382.jpg
[thumb_574_382-width] => 281
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-291x395.jpg
[thumb_776_395-width] => 291
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[gform-image-choice-sm-width] => 221
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[gform-image-choice-md-width] => 295
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[gform-image-choice-lg-width] => 442
[gform-image-choice-lg-height] => 600
)
)
[1] => Array
(
[ID] => 15918
[id] => 15918
[title] => Sender_Maggy-5.jpg
[filename] => Sender_Maggy-5.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[link] => https://www.nextafter.com/experiments/how-the-sender-did-not-impact-donor-conversion-rates-for-prospecting-emails/attachment/sender_maggy-5-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => sender_maggy-5-jpg
[status] => inherit
[uploaded_to] => 15916
[date] => 2021-02-25 10:49:13
[modified] => 2021-02-25 10:49:13
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 637
[height] => 914
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-209x300.jpg
[medium-width] => 209
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[medium_large-width] => 637
[medium_large-height] => 914
[large] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[large-width] => 637
[large-height] => 914
[1536x1536] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[1536x1536-width] => 637
[1536x1536-height] => 914
[2048x2048] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[2048x2048-width] => 637
[2048x2048-height] => 914
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[tp-image-grid-width] => 488
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-35x50.jpg
[admin-width] => 35
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[full-width] => 637
[full-height] => 914
[thumb_372] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-372x534.jpg
[thumb_372-width] => 372
[thumb_372-height] => 534
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-436x625.jpg
[single_post_thumbnail-width] => 436
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-22x32.jpg
[thumb_32_32-width] => 22
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-33x48.jpg
[thumb_48_48-width] => 33
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-45x64.jpg
[thumb_64_64-width] => 45
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-89x128.jpg
[thumb_128_128-width] => 89
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-47x67.jpg
[thumb_122_67-width] => 47
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-107x153.jpg
[thumb_153_153-width] => 107
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-114x163.jpg
[thumb_130_163-width] => 114
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-123x177.jpg
[thumb_232_177-width] => 123
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-453x650.jpg
[thumb_272_325-width] => 453
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-241x346.jpg
[thumb_271_346-width] => 241
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-189x271.jpg
[thumb_271_271-width] => 189
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-120x172.jpg
[thumb_272_172-width] => 120
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-321x461.jpg
[thumb_372_461-width] => 321
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-348x500.jpg
[thumb_372_500-width] => 348
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-188x270.jpg
[thumb_385_270-width] => 188
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-168x241.jpg
[thumb_416_241-width] => 168
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-286x410.jpg
[thumb_448_410-width] => 286
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-571x820.jpg
[thumb_448_410_retina-width] => 571
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-266x382.jpg
[thumb_574_382-width] => 266
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-275x395.jpg
[thumb_776_395-width] => 275
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[gform-image-choice-sm-width] => 209
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[gform-image-choice-md-width] => 279
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[gform-image-choice-lg-width] => 418
[gform-image-choice-lg-height] => 600
)
)
)
T1: Sender: Maggy
Array
(
[0] => Array
(
[ID] => 15917
[id] => 15917
[title] => Sender_Andrew-5.jpg
[filename] => Sender_Andrew-5.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[link] => https://www.nextafter.com/experiments/how-the-sender-did-not-impact-donor-conversion-rates-for-prospecting-emails/attachment/sender_andrew-5-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => sender_andrew-5-jpg
[status] => inherit
[uploaded_to] => 15916
[date] => 2021-02-25 10:49:07
[modified] => 2021-02-25 10:49:07
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 637
[height] => 865
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-221x300.jpg
[medium-width] => 221
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[medium_large-width] => 637
[medium_large-height] => 865
[large] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[large-width] => 637
[large-height] => 865
[1536x1536] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[1536x1536-width] => 637
[1536x1536-height] => 865
[2048x2048] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[2048x2048-width] => 637
[2048x2048-height] => 865
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[tp-image-grid-width] => 515
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-37x50.jpg
[admin-width] => 37
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[full-width] => 637
[full-height] => 865
[thumb_372] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-372x505.jpg
[thumb_372-width] => 372
[thumb_372-height] => 505
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-460x625.jpg
[single_post_thumbnail-width] => 460
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-24x32.jpg
[thumb_32_32-width] => 24
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-35x48.jpg
[thumb_48_48-width] => 35
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-47x64.jpg
[thumb_64_64-width] => 47
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-94x128.jpg
[thumb_128_128-width] => 94
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-49x67.jpg
[thumb_122_67-width] => 49
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-113x153.jpg
[thumb_153_153-width] => 113
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-120x163.jpg
[thumb_130_163-width] => 120
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-130x177.jpg
[thumb_232_177-width] => 130
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-479x650.jpg
[thumb_272_325-width] => 479
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-255x346.jpg
[thumb_271_346-width] => 255
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-200x271.jpg
[thumb_271_271-width] => 200
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-127x172.jpg
[thumb_272_172-width] => 127
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-339x461.jpg
[thumb_372_461-width] => 339
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-368x500.jpg
[thumb_372_500-width] => 368
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-199x270.jpg
[thumb_385_270-width] => 199
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-177x241.jpg
[thumb_416_241-width] => 177
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-302x410.jpg
[thumb_448_410-width] => 302
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-604x820.jpg
[thumb_448_410_retina-width] => 604
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-281x382.jpg
[thumb_574_382-width] => 281
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5-291x395.jpg
[thumb_776_395-width] => 291
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[gform-image-choice-sm-width] => 221
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[gform-image-choice-md-width] => 295
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Sender_Andrew-5.jpg
[gform-image-choice-lg-width] => 442
[gform-image-choice-lg-height] => 600
)
)
[1] => Array
(
[ID] => 15918
[id] => 15918
[title] => Sender_Maggy-5.jpg
[filename] => Sender_Maggy-5.jpg
[filesize] => 0
[url] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[link] => https://www.nextafter.com/experiments/how-the-sender-did-not-impact-donor-conversion-rates-for-prospecting-emails/attachment/sender_maggy-5-jpg/
[alt] =>
[author] => 16
[description] =>
[caption] =>
[name] => sender_maggy-5-jpg
[status] => inherit
[uploaded_to] => 15916
[date] => 2021-02-25 10:49:13
[modified] => 2021-02-25 10:49:13
[menu_order] => 0
[mime_type] => image/jpeg
[type] => image
[subtype] => jpeg
[icon] => https://www.nextafter.com/wp-includes/images/media/default.png
[width] => 637
[height] => 914
[sizes] => Array
(
[thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-150x150.jpg
[thumbnail-width] => 150
[thumbnail-height] => 150
[medium] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-209x300.jpg
[medium-width] => 209
[medium-height] => 300
[medium_large] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[medium_large-width] => 637
[medium_large-height] => 914
[large] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[large-width] => 637
[large-height] => 914
[1536x1536] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[1536x1536-width] => 637
[1536x1536-height] => 914
[2048x2048] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[2048x2048-width] => 637
[2048x2048-height] => 914
[tp-image-grid] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[tp-image-grid-width] => 488
[tp-image-grid-height] => 700
[post-thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-150x150.jpg
[post-thumbnail-width] => 150
[post-thumbnail-height] => 150
[admin] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-35x50.jpg
[admin-width] => 35
[admin-height] => 50
[full] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[full-width] => 637
[full-height] => 914
[thumb_372] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-372x534.jpg
[thumb_372-width] => 372
[thumb_372-height] => 534
[single_post_thumbnail] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-436x625.jpg
[single_post_thumbnail-width] => 436
[single_post_thumbnail-height] => 625
[thumb_32_32] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-22x32.jpg
[thumb_32_32-width] => 22
[thumb_32_32-height] => 32
[thumb_48_48] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-33x48.jpg
[thumb_48_48-width] => 33
[thumb_48_48-height] => 48
[thumb_64_64] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-45x64.jpg
[thumb_64_64-width] => 45
[thumb_64_64-height] => 64
[thumb_128_128] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-89x128.jpg
[thumb_128_128-width] => 89
[thumb_128_128-height] => 128
[thumb_122_67] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-47x67.jpg
[thumb_122_67-width] => 47
[thumb_122_67-height] => 67
[thumb_153_153] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-107x153.jpg
[thumb_153_153-width] => 107
[thumb_153_153-height] => 153
[thumb_130_163] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-114x163.jpg
[thumb_130_163-width] => 114
[thumb_130_163-height] => 163
[thumb_232_177] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-123x177.jpg
[thumb_232_177-width] => 123
[thumb_232_177-height] => 177
[thumb_272_325] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-453x650.jpg
[thumb_272_325-width] => 453
[thumb_272_325-height] => 650
[thumb_271_346] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-241x346.jpg
[thumb_271_346-width] => 241
[thumb_271_346-height] => 346
[thumb_271_271] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-189x271.jpg
[thumb_271_271-width] => 189
[thumb_271_271-height] => 271
[thumb_272_172] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-120x172.jpg
[thumb_272_172-width] => 120
[thumb_272_172-height] => 172
[thumb_372_461] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-321x461.jpg
[thumb_372_461-width] => 321
[thumb_372_461-height] => 461
[thumb_372_500] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-348x500.jpg
[thumb_372_500-width] => 348
[thumb_372_500-height] => 500
[thumb_385_270] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-188x270.jpg
[thumb_385_270-width] => 188
[thumb_385_270-height] => 270
[thumb_416_241] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-168x241.jpg
[thumb_416_241-width] => 168
[thumb_416_241-height] => 241
[thumb_448_410] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-286x410.jpg
[thumb_448_410-width] => 286
[thumb_448_410-height] => 410
[thumb_448_410_retina] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-571x820.jpg
[thumb_448_410_retina-width] => 571
[thumb_448_410_retina-height] => 820
[thumb_574_382] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-266x382.jpg
[thumb_574_382-width] => 266
[thumb_574_382-height] => 382
[thumb_776_395] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5-275x395.jpg
[thumb_776_395-width] => 275
[thumb_776_395-height] => 395
[gform-image-choice-sm] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[gform-image-choice-sm-width] => 209
[gform-image-choice-sm-height] => 300
[gform-image-choice-md] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[gform-image-choice-md-width] => 279
[gform-image-choice-md-height] => 400
[gform-image-choice-lg] => https://www.nextafter.com/wp-content/uploads/Sender_Maggy-5.jpg
[gform-image-choice-lg-width] => 418
[gform-image-choice-lg-height] => 600
)
)
)
Results
| Treatment Name | Conv. Rate | Relative Difference | Confidence | |
|---|---|---|---|---|
| C: | Sender: Andrew | 0.03% | ||
| T1: | Sender: Maggy | 0.03% | -1.3% | 7.5% |
This experiment has a required sample size of 143,116,923 in order to be valid. Unfortunately, the required sample size was not met and a level of confidence above 95% was not met so the experiment results are not valid.
Key Learnings
With regards to the Kickoff Campaign in 2019, we found that through the email prospecting channel, that the sender from Heritage played no role in donor conversion rates. As shown, we see a -1.3% difference between the two senders, but the level of confidence is only 7.52% — nowhere near the 95% validation that we’re looking for.
This was the case with the other performance metrics we would subsequently be interested in, as well, which were effected as follows:
- Email Clickthrough Rate: +2.9% for Maggy (over Andrew), with a 41.9% LoC.
- Email Open Rate: +0.5% for Maggy (over Andrew), with a 48.9% LoC.
Any additional experimentation was turned off, and Andrew was used for the remainder of the campaign sends within the timeline.
The key takeaway from this experiment is that the Heritage Foundation’s file is so accustomed to these cyclical campaigns, and that messaging for the campaign is very transactional in nature, which focuses upon the primary motivation of: “Renewing” or “Activating” your membership for 2019, that the sender, at least in the email prospecting channel, is not important.