A/B Split Testing on Facebook Tabs
Here is a look at Zuzia’s hypothesis before she ran the test …
“The control tab lacks value and is very general, which could cause anxiety to visitors because it’s not clear what they would receive if they enter their email address. The treatment page will provide customers value by having a clear headline and subheadline. It will also provide a list of subscriptions a visitor would receive by putting in their email address.”
Primary Research Question: Which tab test will generate the highest conversion rate?
Variables That Will Be Tested: Headline, subheadline, information layout
What We Will Learn: If the treatment wins over the control, this means that visitors prefer a more informational tab rather than a very general one.
The control gave visitors the option to subscribe to the MarketingSherpa Inbound Marketing Newsletter.
The treatment gave visitors the option to choose which MarketingSherpa newsletters they would like to receive.
The treatment provides a more informational headline and subheadline, emphasizing the collection of case studies and research. The list of the subscriptions immediately tells customers what they can receive.
The treatment received 22.3% more conversions. (Note: This was a small sample-size test.)
What you need to understand
Visitors prefer a more informational tab emphasizing each subscription.
“It seems that our Facebook fans prefer to have control on what to check for their newsletter rather a more general option,” Zuzia said.