Internet Marketing Journal - MarketingExperiments.com

FREE subscription to more than $20 million in marketing research

Enter your email below to receive the latest in marketing research and exclusives offers from MarketingExperiments.

create Lab ID
We value your privacy. View details on how to contact us.

You can also get our latest research delivered to you via our social media feeds below.

 

Follow us on Twitter Join our Optimization Group Visit the MarketingExperiments Blog
Listen to our MP3 Podcast Listen to our podcast on iTunes Watch videos on our YouTube Channel

Research Topics

Site Optimization

Email Optimization

Search Optimization

Marketing Optimization


Training


Search


"Your emails and website provide the common sense that we often leave at the door to the office."

David Jones
Senior Practice Leader
Kaiser Permanente




"I often change small things across many pages as MarketingExperiments gets me thinking about how to increase the straighforwardness of my pages for the visitor."

Amanda Schaner
Marketing Coordinator
Home Science Tools




"The live web clinics are very humbling. I think we're doing a pretty good job. But every time I attend, I realize we could do things much better for our clients. I consider MarketingExperiments my encyclopedia, and parrot the principles I learn every chance I get."

Troy O'Bryan
Co-Founder and Chief Response Officer
Response Capture, Inc

Home arrow Site Optimization arrow Increasing Conversion
Increasing Conversion
Tuesday, 20 November 2007
Synopsis

Topic: Landing Page Optimization: Increasing Conversion by 150% and Lead Gen by 2,379% with an Effective Call-to-Action

Which changes will produce the best Conversion results when optimizing a Call-to-Action? Can distinct approaches be combined to increase both sales and leads?

Previous test results have shown that a single change is typically a trade-off: It may have a negative impact on direct, immediate Conversion but if combined with an effective basket-recovery effort it will increase overall Conversion.

In this brief we’ll look at a case study in which changes to a
Call-to-Action increased direct, step-level Conversion by 150% and Lead Generation by 2,379%.

Editor’s Note: Further analysis conducted after the Nov. 7th clinic on Landing Page Optimization found that the number and percentage of emails captured by the Treatment path during the test with our partner was 18,460 and 2,379% instead of 43,352 and 5,722%. This brief contains those corrected figures though the audio recording of our clinic does not.

Editor’s Note: We recently released the audio recording of our clinic on this topic. You can listen to a recording of this clinic here:

Landing Page Optimization: Increasing Conversion by 150% and Lead Gen by 2,379% with an Effective Call-to-Action

Findings

Case Study 1

Background

We conducted this test for a reference book publisher with whom we have had a long-term, successful partnership.

The company has a solid Value Proposition. Its research articles are written by respected, trusted experts in many different fields. It offers a free trial of its product.

Our previous efforts had twice resulted in quite significant conversion increases, but we had yet to hit a “home run” in terms of an effective basket-recovery campaign.

Previous test results have shown that adding email capture can have a negative impact on direct, immediate Conversion by increasing Friction and Anxiety but ultimately increase overall Conversion when the lead is used in an effective basket-recovery campaign. We used that as the basis for our test design: Capture leads for a basket-recovery campaign that will increase the effective Conversion rate to the free-trial offer.

Test Design

The set-up for the test was relatively simple:

  • Add an email capture field to the current Call-to-Action.
  • Give visitors a reason to enter their email address.
  • Follow up with a friendly email to those visitors who start but do not finish the sign-up process.

The paths for the test protocol were straightforward:

Case Study 1 - Test Protocol Paths

CTR = Click-through Rate
LGR = Lead Generation Rate
CR = Conversion Rate

The primary research question was:

Which article page will produce higher Lead Generation and free trial Conversion rates?

But we’re going to start by answering one of our secondary research questions first:

Will adding email capture on the “teaser” article page decrease its Click-Through Rate?

Case Study 1 - Control Article Page
Control Article Page

Case Study 2 - Treatment Article Page with Email Capture
Treatment Article Page with Email Capture

Finding #1
Article
Page
Unique
Visitors
Free Trial Offer
Page Views
Click-Through Rate
to the Offer
Control 427,740 47,337 11.07%
Treatment 853,833 43,352 5.08%
Nominal Difference 5.99%
Relative Difference 54.12%

Check boxWhat you need to understand: The Control Page outperformed the Treatment Page by 54%.

The green button design had worked very well for us in previous tests and had produced a significant gain, but adding email capture decreased the Click-through Rate to the offer page, as anticipated.

The “login instructions” copy on the Treatment page may have also increased anxiety by making it sound difficult to access the rest of the article. We will consider those factors as we design further tests, but based on previous tests, our analysts were not surprised by these results.

That leads us to the first half of our primary research question:

Which article path, the Control or the Treatment, would produce higher Lead Generation results?

Even though the Control article page did not have an email capture field on it, if visitors clicked through to the next page — the offer page — they were asked for their email address, name, and credit card information.

Control Path:

Case Study 1 - Control Path Step One

Case Study 1 - Control Path Steps 2 and 3

The Treatment article page had an email capture field added to the Call-to-Action. The email address was automatically loaded on the offer page if the visitor had already entered it on the article “teaser” page before clicking through.

Treatment Path:

Case Study 1 - Treatment Path Step One

 

Results

Finding #2
Article
Page
Unique
Visitors
Free Trial Offer
Page Views
Emails
Captured
Email
Capture Rate
Control 427,740 47,337 373 0.09%
Treatment 853,833 43,352 18,460 2.16%
Nominal Difference 2.07%
Relative Difference 2,379%

Check boxWhat you need to understand: The Treatment Path outperformed the Control Path by 2,379% in terms of the number of leads captured.

So once again, adding email capture to the article teaser page significantly increased the number of leads generated, even though the click-through rate to the offer page had declined sharply due to the increased Friction and Anxiety.

Now, while we know that a highly qualified email capture lead has significant inherent marketing value, the additional research question remains:

Will a recovery email campaign using those leads increase the effective free trial Conversion Rate?

Test Design

We sent out two emails. The first was sent 1 hour after the incomplete free-trial sign-up process; the second was sent 24 hours later.

In our recent clinic on Lead Generation we reviewed a case study in which an email campaign increased conversion for a financial newsletter service by 56%.

When sending basket-recovery emails we have consistently achieved the best results by using short paragraphs written in a very customer service-oriented and helpful tone free from sales hype.

The 24-hour version of the email steps up the level of urgency by specifying that “This is our last attempt to contact you” in the first sentence and “if you do not respond to this email, we will remove your information. . . .  and you may miss out. . . .” in the postscript text.

1 hour version of email (truncated):
Case Study 1 - 1 hour version of email (truncated)

24 hour version of email (truncated):
Case Study 1 - 24 hour version of email (truncated)

Results

The Treatment’s recovery emails had almost no impact on the free trial Conversion rate.

In fact, only four free trial orders were recovered using the email campaign. Follow-on analysis is underway to determine why the basket recovery campaign results fell short of the expected range of likely outcomes, and further testing may be conducted. 

That brings us back to the second half of our primary research question:

Which article page will result in more conversions to free trial sign-up?

Did adding email capture to our Call-to-Action hurt direct Conversion?

Results

Finding #3
Path Article Page Unique Visitors Free Trial Offer
Page Views
Free Trial Sign-
ups
Conversion Rate: Article Page to Confirmation Conversion Rate: Offer Page to Confirmation
Control 427,740 47,337 316 0.074% 0.67%
Treatment 853,833 43,352 724 0.085% 1.67%
Nominal Difference 0.008% 1.00%
Relative Difference 15% 150%

Check boxWhat you need to understand: The Treatment path overall Conversion rate from article page to confirmation outperformed the Control Path by 15%. The step-level Conversion rate from offer page to confirmation was 150% higher for the Treatment Path than for the Control path. 

 

Observations

Step-level Conversion rate is essentially the Conversion from one step or stage in the sale process to a specific subsequent step rather than from arrival to confirmation page. We did observe that visitors who clicked through to the Treatment offer page were twice as likely to sign up for the free trial.

Remember: Adding email capture to the Treatment article page increased Friction and Anxiety and decreased the CTR to the Offer page in Finding #1. Why did Conversion to the free trial increase? Did automatically loading the email address on the offer page make a difference? 

Let's look closely at the two Calls-to-Action again, side-by-side:

Case Study 1 - Call-to-Action Side-by-Side

Observations

Using the test data available, MarketingExperiments analysts made the following observations:

  • Direct Conversion increased because of the changes to the Call-to-Action:
  • On the Treatment article “teaser” page, friction from email capture is minimized by ensuring that it feels as though it will be easy to complete the process, receive the free trial, and read the full article. This will have a favorable impact on lead generation and minimize order abandonment. 
  • Clarity was increased. The text is larger and easier to read.
    It re-emphasized the free offer.
  • Changing the button from green to orange drew the customer’s eyes more effectively.

Key Point: Optimizing the Call-to-Action, such as changing the green button to orange in the Treatment path, helped to mitigate the impact of additional Friction from email capture. When we pulled the email capture forward to the article “teaser” page in the Treatment Path we expected to see a Friction-induced reduction in Click-Through rate, but those visitors who did enter email addresses and clicked through were much more likely to complete the remainder of the process and register for the free trial. The net outcome was a 15% increase in overall conversion to free trial, plus more than 18,000 (2,379%) more qualified sales leads for this and potentially other related products. 

Here’s an aggregate view of the three findings:

Case Study Results
Path Unique Visitors to Article Page Unique Visitors to Offer Page Free Trial Sign-Up Article Page to Free Trial Con-
version Rate
Offer Page to Free Trial Con-
version Rate

Emails Captured

Email Capture Rate
Control 427,740 47,337 316 0.074% 0.67% 373 0.09%
Treatment 853,833 43,352 724 0.085% 1.67% 18,460 2.16%
Relative Difference 15% 150%   2,379%
         

Recommendations

  • Determine the information you need to capture for each customer.
  • Determine the minimum information you need to capture “up-front” in order to minimize Friction and Anxiety and optimize Conversion. Ask for additional information no earlier in the sale process than you need it in order to accomplish your primary objective.
  • Test groups or “clusters” of changes, such as email capture location and Call-to-Action design that may be combined to achieve gains that neither might produce alone.
  • Test different designs and experiment with the timing for basket-recovery email campaigns.

Watch the next Web Clinic in real-time

Enter your email below for invites to our Web Clinics featuring:

  • First access* invites to Web clinics
  • Latest discoveries in online testing and optimization research
  • Interactive Q&A with the MECLABS research team
  • Live analysis of audience-submitted landing pages and wireframes

You will also receive updates on the latest in marketing research and exclusives offers from MarketingExperiments.




Subscribe for FREE

* Seating is limited to 1,000 attendees and fills quickly

We value your privacy. View details on how to contact us.

Notes

RELATED MARKETING EXPERIMENTS REPORTS:

Literature Review

As part of our research, we have prepared a review of the best Internet resources on this topic.

Rating System

These sites were rated for usefulness and clarity, but alas, the rating is purely subjective.

* = Decent | ** = Good | *** = Excellent | **** = Indispensable

About This Brief

Credits:

Editor(s) — Frank Green
Bob Kemper

Writer(s) — Gaby Diaz
Jimmy Ellis
Maria Hendricks
Peg Davis

Contributor(s) — Flint McGlaughlin
Bob Kemper

HTML Designer — Cliff Rainer

Email Designer — Holly Hicks

Test Protocol(s):

  • 1043

::Top Of Page::