Daniel Burstein

A/B Split Testing on Facebook Tabs

Here’s a look at a recent test that Zuzia Soldenhoff-Thorpe, Senior Research Manager, MECLABS, ran on the “Newsletter” tab of the MarketingSherpa Facebook Page.

 

PLANNING

Here is a look at Zuzia’s hypothesis before she ran the test …

“The control tab lacks value and is very general, which could cause anxiety to visitors because it’s not clear what they would receive if they enter their email address. The treatment page will provide customers value by having a clear headline and subheadline. It will also provide a list of subscriptions a visitor would receive by putting in their email address.”

Primary Research Question: Which tab test will generate the highest conversion rate?

Variables That Will Be Tested: Headline, subheadline, information layout

What We Will Learn: If the treatment wins over the control, this means that visitors prefer a more informational tab rather than a very general one.

 

CONTROL

 

The control gave visitors the option to subscribe to the MarketingSherpa Inbound Marketing Newsletter.

 

TREATMENT

 

The treatment gave visitors the option to choose which MarketingSherpa newsletters they would like to receive.

The treatment provides a more informational headline and subheadline, emphasizing the collection of case studies and research. The list of the subscriptions immediately tells customers what they can receive.

 

RESULTS

The treatment received 22.3% more conversions. (Note: This was a small sample-size test.)

 

What you need to understand

Visitors prefer a more informational tab emphasizing each subscription.

“It seems that our Facebook fans prefer to have control on what to check for their newsletter rather a more general option,” Zuzia said.

 

Related Resources:

Social Media Marketing: Should Facebook host your landing page?

Facebook Marketing in Six Steps: How to successfully manage your fan page

Social Media Marketing: How I found the Facebook topic that was 371% more effective

Social Media Marketing: Facebook app boosts engagement, adds 23,000 fans and lifts website referrals 238%

Share and Enjoy:
  • LinkedIn
  • StumbleUpon
  • Facebook
  • del.icio.us
  • Digg

Categories: Social Media Tags: , , ,



  1. Judi
    November 30th, 2012 at 09:30 | #1

    I really like allowing subscribers to select the content they prefer to receive. But what happens when a subscriber “opts-out”? Is their email removed from the system entirely? With my current email provider system, if a subscriber wants to stop receiving a particular email, they wind up opting out of the entire system.

    I’m searching for an email service provider that would allow users to customize their preferences beyond a black/white choice. Any suggestions?

  2. September 12th, 2013 at 18:26 | #3

    Hi Daniel,
    I’m curious, what do you use to split test on Fb tabs that are mobile compatible?

    • September 13th, 2013 at 12:25 | #4

      Thanks for the question Samuel.

      The last project I worked on, Facebook tabs weren’t mobile compatible, so not sure how you can split test them. Maybe I’m missing something?

  1. February 13th, 2013 at 08:35 | #1