MarketingExperiments Blog: Research-driven optimization, testing, and marketing ideas

A test is a great way to settle arguments. The highest-paid person in the room thinks he has a better headline? No problem. Just test it.

But, to truly optimize, sometimes it helps to start a few arguments as well. Get some key people in the room, question your landing pages, question your value proposition, and let everyone (Sales, Customer Service, Product Development, Consulting Services) come up with test ideas to really push the envelope on your marketing.

The way we do that at MECLABS is with a series of meetings called Peer Review Sessions. It gives everybody – from the most senior to the most junior members of the team – a chance to jump in, question the status quo, and come up with test ideas.

Because, as marketers, optimizing by ourselves is hard work … even for the experienced optimizers at MECLABS. No one can truly optimize in a vacuum. We need other minds to broaden the horizons of our creativity and give us ideas for what to test and how to test.

-

Find your peer group

Sometimes it also helps to find optimization peers who work at other (preferably non-competitor) companies to break away from the groupthink in your organization (“Our product is the bestest ever!”) and throw some tests against the wall for a little brainstorming.

This is why we at MarketingExperiments are trying to build a community of marketers around the field of optimization. Because the more people there are sharing ideas, the better we can all get at optimization. And, the better we can get at optimizing, the better we all become at performing our jobs.

You can find that peer group in a few places:

• Among the 4,610 optimizers on the MarketingExperiments Optimization group on LinkedIn
• Local marketing events
• Optimization Summit 2012 in Denver
• The comments section of this blog post

-

Win a $397 MarketingSherpa Benchmark Report

That’s right, I said the comments section of this blog post.

You see, as I said earlier about the MECLABS way of optimizing, we seek to get as many ideas as possible for the tests we run with our Research Partners. For an upcoming test we’d like you to suggest the best PPC ad copy in the comments section of this blog post.

So scroll down. Take a look in the comments. Find some PPC ad copy you like. And reach out to that marketer to see if you can form a peer relationship, helping each other produce better tests.

To make it worth your while, once we have several submissions, we will choose one lucky marketer’s ad treatment to run in our experiment. And, to sweeten the pot, we’ll also give that marketer a free PDF copy of MarketingSherpa’s 2012 Search Marketing Benchmark Report – PPC Edition (a $397 value).

So let’s get to the challenge (if you choose to accept it)…

-

The challenge

As I said, to make us all become better optimizers, we need your ideas for a real PPC experiment we are going to run for one of our Research Partners: North American Spine. We’re going to have you, dear marketer, write PPC ads to help us discover some things about North American Spine’s ideal customer.

At the end of this post, you can submit your ad treatment in the comments.

So, now that you know what you’re in for, sit back, and get your thinking caps on while you read the background of the experiment.

Please read it carefully as there are some very specific things we are looking for to make this test successful. The closer you read and understand, the more likely you are to win.

-

Experiment Background:

North American Spine (NAS) is the inventor and sole provider of a fascinating (in my opinion) minimally invasive spine surgery called the Accurascope procedure. They essentially provide people who are suffering from serious, chronic back pain with an alternative to open back surgery.

Right now, with ROI Revolution managing their paid search advertising campaigns – NAS is doing an impressive job of getting people who are already shopping for back surgery solutions to buy the Accurascope procedure.

However, as probably all of us know, there are likely potential NAS customers out there who aren’t shopping for back surgery. Instead they are shopping for more information so they can make an informed decision about whether they need surgery or not.

We know this because there are several medium-to-high-traffic keyword terms centered around certain back conditions:

• Lumbar Bulging Disc
• Sciatic Nerve
• Degenerative Disc Disease
• Etc.

It also happens that NAS is looking to implement a content strategy to help position them as an authority in the back pain treatment space.

-

Experiment Goal:

The trouble with a content strategy is that it is very difficult to create content, and very difficult to predict what content will resonate with your customers.

You could spend a lot of time creating high-quality content only to find out later that another approach would have been more profitable.

To help provide clarity to NAS’s content strategy, we are going to run some PPC ads to “take the temperature,” in a sense, of the people who are searching for the following conditions:

• Lumbar bulging disc
• Sciatic nerve
• Degenerative disc disease
• Herniated disc
• Pinched nerve in lower back
• Lumbar back pain

So the goal of this experiment is to learn which types of content resonate with the largest audience of condition-based searchers. This way, NAS can tailor a content strategy around those motivations and start building content they know will be effective.

But the ultimate goal is to have prospects come in for a needed Accurascope procedure, as shown in the chart below:

Experiment Hypothesis:

It wouldn’t be an experiment without a hypothesis. Here’s what we think these condition-based searchers are really after:

• May be experiencing back pain symptoms and are simply searching online or asking around
• Have come across this condition and now want more information on it
• May have already seen a doctor and been diagnosed with this condition and now want more information on it and possible treatments
• May be a friend or loved one searching on behalf of someone

Therefore ads that cater to these motivations will likely receive a higher clickthrough rate.

-

The Research Question:

It’s hard to ask a research question without also having your treatments in mind, but I’ll go ahead and pitch one here, assuming your treatments will be flooding in soon after:

Which condition-based ad template will receive a higher clickthrough rate?

-

The Treatments: What we need from YOU

If you didn’t notice above in the research question, the treatments we are looking for will be templates. Each PPC ad will be a different approach for more information that we can simply drop a back condition keyword into. So, to give you an example, I’ll show you my submission:

-

Have [Condition]?
Learn 3 treatments with the highest
success rates in this free report
NorthAmericanSpine.com/[condition]

However, you might take an angle like this:

-

[Condition] Info
5 things you need to know to give
your loved one the care they need.
NorthAmericanSpine.com/[condition]

Whatever you decide, be sure to keep the goal of this experiment in mind: to learn which types of content resonate with the largest audience of condition-based searchers.

Also, keep in mind that PPC ads have character limits, if you don’t know them, you can use this tool to help you stay within those limits and not be disqualified from the contest.

Because you’re writing ad templates and not ads, it’s going to be difficult to fit each of the conditions above in a single template. But we know you’re very smart, and if there is a way that you can think of to get around that problem we’re open to suggestions. Just leave them in the comment below your submission.

The Call-to-Action:

So with that, I’ll let you get writing. When you’ve written an ad, all you need to do is post it below in the comments. Once we have enough submissions, we’ll sort through them and choose one ad that we think will best help us answer the research question.

The writer of that ad will get:

• A free PDF copy of MarketingSherpa’s 2012 Search Marketing Benchmark Report – PPC Edition (a $397 value)
• The opportunity to brag about how they were included in a real MECLABS experiment
• A shot at having their treatment actually win the experiment (more bragging rights)
• A mention (and link) on this blog as a marketing expert (yes, even more bragging rights)

Go ahead and post your ad in the comments and we’ll announce the winner during our next Web clinic: Online Advertising Forensics: We investigate how and why a text-based PPC ad produced 47% more conversions (Educational funding provided by ROI Revolution)

Happy writing!

UPDATE: Winner(s) Announced…

The results are in. Unfortunately our team was torn between two submissions from our generous commenters below. We were SO torn, in fact, that we decided to give away TWO 2012 Search Marketing Benchmark Reports – PPC Edition to two lucky commenters. Unfortunately, due to validity constraints we are only able to use one ad template in the actual experiment.

So congratulations to both Amy Harold and Carrie Hernandez for their insightful submissions. Both of you should be receiving a Benchmark Report in the next few days. With that said, if you saw yesterday’s Web clinic [Subscribe to be notified when the replay is live], you know that only Amy Harold’s submission will be in the actual test. That is because we needed a template that we could use to test different approaches and hers was the most flexible.

With that said, we found Carrie’s submission incredibly insightful for two reasons:

1. It was short. It wasn’t even close to using all of the characters the ad was limited to. Common sense tells us this is a bad thing. Be we love challenging common sense with experimentation. So we would love to eventually test shorter than required ad copy.
2. The idea of offering a comparative clinical study was a particularly interesting content angle

Again, thank you to all of our commenters. If you need help writing a PPC ad, simply take a look at the comments below for some ideas. And try to get in touch with anyone whose ad you particularly liked to brainstorm. Remember, we can’t optimize in a vacuum.

Related Resources:

Blandvertising: How you can overcome writing headlines and copy that don’t say anything

Banner Blindness: Why your marketing messages are hiding in plain sight

The Ultimate Click: How to get what you pay for with pay-per-click advertising

PPC Ads: What is search engine marketing best used for?

This time of year, many marketers are beginning to execute on their new marketing plans. However, sometimes you have to deviate from the plan and just need a sale or lead generation lift… RIGHT NOW!

When your boss or client challenges you to gain a quick conversion increase on your landing pages, what tools do you turn to in your marketing toolbox?

In Wednesday’s Web clinic – Rapidly Maximizing Conversion: How one company quickly achieved a 53.9% lift with a radical redesign – MECLABS Managing Director Flint McGlaughlin will share our top discoveries around how to quickly improve your conversion rate.

But before we share what we learned, we wanted to hear from you. Here are a few of our favorite “quick hit” tips from your peers …

-

Headline optimization

I have found that headline and subhead optimization works well for the B2B SaaS clients I typically work with. Even after I think I have tested my way to the perfect headline, I run more tests and get more lift. I regularly get 10% lifts from this tactic. If I have more time to gather data, I will multivariate test headline, CTA button and benefit/bulleted text.

Finally, if you haven’t already, make sure there is just one key CTA button which is huge and obvious. I’m always surprised at how many sites don’t do this.

– Chris Neumann, General Manager, TextMarks

-

5 Quick Tips

A few quick things come to mind:

1) Drop prices and provide free shipping: This one is pretty obvious, but nothing converts like low prices and free shipping.

2) Add security/trust logos and other “credibility” links (security policy, etc.) to checkout process: These types of additions have proven to immediately bump the conversion rate by providing a visual feel of safety and security, even if the users never do anything besides see the presence of the icons or links.

3) Simplify checkout process, including NOT requiring users to create an account in order to checkout: A simple checkout process reduces the likelihood users will drop-off.

4) Increase frequency of targeted email campaigns: There is so much email going around these days, from so many different sources, for so many different purposes. Research and testing has shown that sending a single email campaign up to 9 times can continue to provide incremental benefit in sales, with very little subsequent downside in customer satisfaction. The truth is, most people don’t see a very high percentage of their email.

5) Implement abandoned cart targeted emails: Enticing users to complete the checkout process can be very effective because you are targeting shoppers that you know are already interested in some of your products.

The above items are all proven to increase conversion – some are more quickly implemented than others.

– Todd Stalter, Senior Visualization Analyst, OneSpring

-

Contests and chatting

For quick results I would implement the following:

1. An online contest where all the visitor needs to do is provide a name and email address, Facebook “like,” and/or Twitter follow, depending on what kind of lead capture you want. Online contests with enticing prizes can go viral and get you many followers quickly.

2. Implement a live chat feature on the site to make it easier to interact with visitors. However, I have found that live chat software with the standard popup window do not convert as well as the newer live chat programs such as Zopim and Olark that have a more social feel to them. Another option is to implement a video live chat program so customers can see the site representative on video, which helps even more with building trust in your company.

– Shai Atanelov, CEO & Founder, BigtimeWireless.com

-

Related Resources:

Rapidly Maximizing Conversion: How one company quickly achieved a 53.9% lift with a radical redesign – Web clinic

Most-Tweeted Posts of 2011: Social media marketing, copywriting, email testing and more …

Landing Page Optimization: How to plan a radical redesign so you get a lift AND a learning

Marketing Campaign: Landing page optimization can help improve the return on your media spend

It’s the holiday time, so let me talk about a holiday. Passover, naturally (hey, if you want to succeed in marketing, don’t follow the crowds).

In the classic seder, there are The Four Sons. For this blog post, I’m going to focus on “the one who does not know how to ask a question” because I think that’s a perfect explanation of where many marketers are right now with their testing practices. For example, according to Jeff Rice’s just released 2012 Email Marketing Benchmark Report, he found that 85% of marketers don’t even know why they’re running every test they run!

-

Click to enlarge

-

Take a look at the second field in this chart. Only 15% of marketers routinely define the question, objective, and key metric when running a test. Why bother taking the time to set up a test if you don’t know what you’re looking for in the first place?

My guess is, that like the fourth son referenced above, they simply do not know how to ask. So in today’s blog post, I want to briefly discuss how to write a research question. And in this Thursday’s MarketingSherpa webinar – Negative Lifts: Turning a 25% loss into a 141% increase in conversion – Junior Editorial Analyst Paul Cheney and I will be discussing in more depth how you can learn about your customers from tests, along with Tina Hou, the director of product marketing for webinar sponsor TRUSTe.

-

How to create a clear research question

While all of the elements in Jeff’s chart are important for running a valuable test (i.e. truly learning what really works with your customers), the research question will play the biggest role in guiding your test design.

That said, the research question is just one part of step #11 (“Test Comps”) in the MarketingExperiments Optimization process. Before our analysts begin to design tests using the MECLABS Test Protocol (in which they define the research question) and begin the iterative testing process, they do everything from determining the page objective to submitting comps for peer review (you can see our full landing page optimization process in session 7 of our paid Landing Page Optimization Online Course.)

While I obviously can’t cover the entire process in this blog post, if I can help you write a true research question, I can set you on the path to learning about your customers from your tests. This is a complex process, but if I had to simplify it into three steps, I would say…

-

1. Start with asking “what” you want to know

Clearly you’re running a test for a reason. Write that question down on a piece of paper. Go ahead, do it, I’ll wait.

Now pass that piece of paper (or email) around. Are all of the key players aligned that this is, in fact, what are you trying to learn from your tests?

For example, you may want to know “What is the best price for product X?” This is the variable you will test.

-

2. Turn this into a question of “which”

Good start. Except the only problem is, to truly answer the above question, you would have to test an infinite number of prices. And I’m guessing your time, resources, traffic, and patience are not infinite.

So to narrow your focus, you want to ask a question of “which.” Not only will this force you to think about exactly how you’re designing your test, it helps you create a testing-optimization cycle to continually learn about your customers from your tests and improve your marketing performance.

A year from now, when you’re been promoted three times for driving such impressive results, and the new hotshot your direct report’s direct report hired sees a test that asks, “Which of these three price points – $1, $2, or $3 – is best for product X?” he will know exactly what you tested. And exactly what you learned about the customer.

-

3. Add in your KPI

So now you know exactly which prices (technically speaking, which values of your variable) you need to design a test around. The next question you need to ask is – how do I pick a winner?

You certainly don’t want to write the rules after the fact. “My favorite analogy for this is throwing a rock in the forest and saying, ‘look, I hit that tree,’” said Phillip Porter, Data Analyst, MECLABS. “If you aren’t aiming for something before you start, how do you know if you hit what you aimed for?”

What KPI (key performance indicator) will help you determine which value is the winner? To reformulate our example question, you would say “Which of these three price points – $1, $2, or $3 – will generate the most revenue for product X?”

Now everyone on your team (and everyone on your team a year from now) knows exactly how you define “best.” If you don’t think through and define the question beforehand, you might just try to come up with an answer based on whatever metrics you had on hand after the test is run. For example, choosing sales instead of revenue, and picking a winner that sells more product but generates less money in your pocket.

You might also not even have the chance to redefine the rules after the test is run since, since depending on the metric, the testing platform, and your transactional data system, you might not have captured the KPI that you later determine would have been most effective to know.

-

“If you don’t know where you are going, any road will get you there.” – Lewis Carroll

-

In the end, the value of the research question is that it helps ensure all the effort and resources you invest in testing and optimization gets you to where you want to go. Or, as Phillip related, you might as well be testing through the looking glass…

Alice: Would you tell me, please, which way I ought to go from here?
The Cheshire Cat: That depends a good deal on where you want to get to
Alice: I don’t much care where.
The Cheshire Cat: Then it doesn’t much matter which way you go.
Alice: …so long as I get somewhere.
The Cheshire Cat: Oh, you’re sure to do that, if only you walk long enough.

-

Related Resources:

Research Update: The state of email marketing testing and optimization

Negative Lifts: Turning a 25% loss into a 141% increase in conversion – Thursday, December 1, 1 p.m. EST

MarketingSherpa 2012 Email Marketing Benchmark Report

Landing Page Optimization: How IBM applied homepage redesign learnings to landing page testing

What marketing errors are easiest to avoid? And how do we avoid making them?

My answer would be…those related to overconfidence. And, as to the second question, I’ll take the rest of this blog post to attempt to answer that.

-

Are you too confident?

In the business world, as in marketing, we usually look at confidence as a good thing. But the “overconfidence bias” can seriously harm your performance.

Here’s how Jonah Lehrer, an American journalist who writes on the topics of psychology and neuroscience, describes this overconfidence bias in The Science of Irrationality: A Nobelist explains our fondness for not thinking…

-

Consider the overconfidence bias, which drives many of our mistakes in decision-making. The best demonstration of the bias comes from the world of investing. Although many fund managers charge high fees to oversee stock portfolios, they routinely fail a basic test of skill: persistent achievement. As Mr. [Nobel Laureate, and professor of psychology at Princeton] Kahneman notes, the year-to-year correlation between the performance of the vast majority of funds is barely above zero, which suggests that most successful managers are banking on luck, not talent.

This shouldn’t be too surprising. The stock market is a case study in randomness, a system so complex that it’s impossible to predict. Nevertheless, professional investors routinely believe that they can see what others can’t. The end result is that they make far too many trades, with costly consequences.

-

Sound familiar? Is marketing a product any less complex than trading on the stock market?

-

How to bank on talent, not luck

I disagree with one aspect of Lehrer’s article. Not to put words into his mouth, but he seems to imply that there is no way to overcome the overconfidence bias. In marketing, I believe there is a way to do so (of course, perhaps that’s just me being …ahem … overconfident).

Let me explain what I mean, and let you be the judge… Read more…

At the West Coast leg of the MarketingSherpa B2B Summit 2011 in San Francisco this week the first case study of the day featured IBM’s homepage redesign and the overall approach IBM uses in its redesign process. Joan Renner, Content Manager, Corporate Marketing Digital Initiatives, IBM, presented on how Big Blue engages in site redesign.

But they don’t stop at the landing page. They go the next step into the funnel and test landing pages, as well.

-

Landing page testing

Joan says, “Having great landing pages is very high value to the company and these tests wouldn’t be difficult to perform.” These two attributes made landing page testing a high priority in their testing backlog, which is their list of tests they’d like to run, ranked on three factors to determine priority:

• Internal visibility
• Difficulty
• Value

And she added, “We’re putting into our organization the ability for any division to come forward and ask for help.”

In this case a test was created to improve the landing page for the IBM X-Force Internet security and threat report landing page and led to a dramatic improvement in the page’s performance.

- Read more…

A few years ago the idea of dedicating a landing page for a certain segment of traffic to a website was a novel idea. Then, with the rise of Google, PPC started becoming more popular.

When that happened, marketers realized that if they made keyword-specific landing pages, they achieved better results from the traffic they were paying for.

Marketers started to realize that they could make custom landing pages for other channels as well, like display ads and email campaigns.

There are other channels that most marketers haven’t capitalized on yet with a targeted landing page. One of those is organic search.

Take a look at the data on SEO landing pages in the following chart from the MarketingSherpa 2012 Search Marketing Benchmark Report – SEO Edition. For advanced marketers, SEO landing pages is an extremely effective tactic, but for the rest, it’s left untouched.  Read more…