Email Testing: More specific subject line improves open rate by more than 35%
“She was here on earth to make sense of its wild enchantment and to call each thing by its right name.” – Boris Pasternak (Doctor Zhivago)
Sometimes, as marketers, this is one of our biggest challenges. We must make sense of the “wild enchantment” inherent in our audience so we can call each offering we have by its right name. After all, the way we think about our products can be vastly different from the way our audience thinks about them. This is why specific words matter, and for more than just SEO.
Let’s take a look at a recent test conducted by MarketingSherpa (sister company to MarketingExperiments), to determine which words best tap into the audience’s motivations.
MarketingSherpa conducts several series of workshops across the country. Senior Marketing Manager Justin Bridegan launched a geotargeted microtest in the Denver area for the July 19th stop of the B2B Marketing FUEL Advanced Practices Workshop. The control used the traditional “B2B” wording.
Control Subject Line: Coming to Denver: New Live B2B Marketing Certification Workshop
Control Headline: Accelerate Your B2B Marketing Program Today & Get Certified
Course Title: B2B Marketing FUEL Advanced Practices Workshop
In the treatment email, Justin changed the name of the workshop to focus on lead generation.
Treatment Subject Line: Coming to Denver: New Lead Generation Certification Workshop
Treatment Headline: Power Your Marketing from Lead Generation to Sales Conversion
Treatment Course Title: Lead Generation Certification Workshop
Lead Generation vs. B2B Marketing. Which is the “right name” that resonates with the MarketingSherpa audience?
It appears that the more specific title did increase the open rate in this test.
Now, please note that this was a highly targeted microtest. For that reason, the difference in open rates was significant only at the 80% level of confidence. The difference in unique click-through rate was not significant at that level, which is why I did not include it in this blog post.
For our tests, we usually require a 95% level of confidence, and frankly 80% is the bare minimum to even share with you on this blog.
But, with a small traffic test such as this, we did not launch the test because we sought to get a definitive answer to a question. We were merely sending out a trial balloon to a very small, very targeted segment of our list.
Before we launch future tests, let’s hypothesize as to why the more specific messaging seemed to work better. This test idea actually came directly from our Managing Director, Flint McGlaughlin, so I asked him for his analysis. Here’s what he had to say…
“B2B is expressing a category and Lead Generation is expressing a solution. B2B only tells someone the category of the enterprise. Lead Gen tells someone the nature of the solution. People are more interested in solutions than they are in titles. When we said that it is going to be Lead Generation, we gave them a tangible benefit that is easy to visualize in their minds. It makes them say, ‘this is what I’m going to get, I’m going to learn how to get better at Lead Generation.’”
“When you tell them B2B, it has one particular power, and that is that it suggests that this might be particular to their niche. The word B2B belonged in the sub-header or in the first paragraph, but not as the main thought in the headline. The main thought in the headline is ‘Lead Generation,’ and then you can intensify by saying that this is especially for the B2B business space. Now that the visitor has his thought sequence right, tell him what he’s going to get, and then intensify its value.”
And, as you can see, Flint already has ideas for future experimentation. So, on to more testing. Or, as Justin Bridegan wrote to me when he sent these test results…
“With more testing and validation we could be on to something. More to come…”