Posts Tagged ‘a/b testing’

Three Steps to Boosting Conversions by Building Customer Relationships

August 20th, 2015 No comments

MarketingExperiments’ Marketer’s Creed, Article 1, states:

“People don’t buy from companies, from stores or from websites; people buy from people. Marketing is not about programs; it is about relationships.”

NextAfter, an organization dedicated to helping nonprofits discover what truly makes donors give, put this concept to the test during an end-of-year fund-raising push. Tim Kachuriak, the company’s Chief Innovation and Optimization Officer, is so passionate about this cause that he cut his family vacation short and flew cross-country to join us in the studio for the most recent MarketingExperiments Web clinic to share his results and show how what NextAfter learned could benefit any organization.

Watch it here. 

Background: The Heritage Foundation, a think tank, was soliciting end-year donations.

Goal: To increase donations.

Research question: Which email treatment will generate the most revenue?

Test: A/B split test


Version A

This email drips with formality and reads like a direct-mail piece. It begins with “Dear Fellow Conservative” and goes on to exhort the reader to “make a bold statement by standing with the Heritage Foundation.” It is signed by Jim DeMint, the foundation’s president.

  Read more…

How a B2B Company Increased Banner Clickthrough 956% by Capitalizing on Quick Wins

August 10th, 2015 No comments

When it comes to testing, it’s exciting to focus on big tests, but being too focused on large-scale changes can hinder marketers from seeing smaller opportunities to test. Oftentimes, small tweaks to ads, copy or smaller webpage elements can lead to dramatic lifts. Cindy Lu, Senior Marketing Manager of Digital Marketing Strategy, VMware, is more than familiar with the lift potential quick wins can offer.

“For each company that I’ve actually worked at, I’ve had the opportunity to quickly identify some of the low-hanging fruit opportunities,” Cindy said. “It generally blows everyone away in your organization because they didn’t realize such small tweaks could have such meaningful impacts on actual conversions.”

At MarketingSherpa MarketingExperiments Web Optimization Summit 2014, John Tackett, Manager of Editorial Content, MECLABS, sat down with Cindy to discuss the five optimization lessons she learned from testing VMware’s website and conversion funnel. One of the most important lessons Cindy highlighted was identifying and capitalizing on quick wins.


Watch the session excerpt to learn how one of VMware’s quick win tests resulted in a 956% increase in clickthrough.

Read more…

Bet on Horses, Not Customer Assumptions: How the Kentucky Derby tested content for relevance with customers

July 23rd, 2015 1 comment

Assumptions can be a dangerous territory — especially when it comes to being relevant with your customers.

When a brand has a large gap between purchases, keeping customers engaged becomes a consistent concern.

The team at the Kentucky Derby faced that issue when they decided to use the weekly newsletter to identify and validate customer segments.

“When we look to grow a brand like the Kentucky Derby, that breadth of engagement is really core to our growth path,” Jeff Koleba, Vice President of Marketing and Programming, Kentucky Derby, said in this session from MarketingSherpa Email Summit 2015.

To solve this issue, Jeff and Kate Ellis, Marketing Analyst, Kentucky Derby, decided to begin segmenting and directing content directly towards the customers who wanted it most. Within its established customer personas, the Derby focused testing on three segments:

  • Social content interests
  • Equine enthusiasts
  • Betting/wagering information

Once they set up segmentation and supported it with relevant content, the team began optimizing for maximum engagement.

Read more…

Holidays Ahead: Market with caution

July 16th, 2015 No comments

Every holiday presents both opportunity and danger: you can either engage audiences or you can alienate them. It just depends on if you choose to jump on the seasonal bandwagon and how effectively you make the leap.

The most recent Marketing Experiments Web clinic examines holiday marketing lessons learned, and what you need to do to ensure you take full advantage of seasonal campaigns while dodging pitfalls.  Watch it here.

Consider this test, which has been anonymized.

Background: A large financial institution.

Goal: To convince customers to take out a mortgage or refinance an existing one.

Research question: Which email treatment will generate the highest clickthrough?

Test: A/B sequential test


The Straightforward Control

The Control was an email that focuses on low mortgage rates and how to take advantage of them.

  Read more…

Website Optimization: How a B2B publishing company increased free trial sign-ups by 36.4%

July 6th, 2015 No comments

A popular method to acquire new customers for online subscription models is through free trials. The hope is that by using a service or product, prospective customers can fully experience and appreciate the value you have to offer.

However, before the experience begins, you must first get them to see the value of the trial. After all, it can be a friction- and anxiety-filled process since many trials require credit card information at the time of sign-up.

Increasing the completion rate for the trial sign-up process was one of three steps the Euromoney Institutional Investor team took to revamp its strategy and increase conversions. The team accomplished this through online testing after seeing that 60% of traffic in the funnel did not complete the process.

At MarketingSherpa MarketingExperiments Web Optimization Summit 2014, Ben Eva, Global Head of Conversion Management, Euromoney Institutional Investor, shared three online tests his team used to learn about their customers and to increase that completion rate.

What is the best layout/design of the offer page?                            

Euromoney publishes over 200 online information services — which equals a lot of potential for testing. Because each audience varies, sometimes the same type of test is needed to find the best result for each audience.

Ben shared two tests that revolve around page design and how to best communicate the value of the publications and their free trials.

Read more…

The Importance of Customer Centricity in Evolving A/B Testing

June 29th, 2015 2 comments

When we talk about A/B testing, we often think about it on a test-by-test basis. While this singular focus is beneficial, it overlooks testing’s role as an ongoing system for optimization.

At MarketingSherpa Email Summit 2015, Courtney Eckerle, Manager of Editorial Content, MarketingSherpa, sat down with Lauren Wagner, Senior Manager, and Tessa Srebro, Lead Generation and Marketing Associate, both of VolunteerMatch, to discuss how to utilize A/B testing to constantly evolve programs.

Lauren and Tessa’s company, VolunteerMatch, is a nonprofit organization that is the world’s largest volunteering network. It also has an interesting funding model. The company sells a Software as a Service (SaaS) product to companies to help fund its organization and, so far, this model has generated almost $1 billion in social value each year through its work with nonprofits and volunteers. VolunteerMatch is also more than familiar with the benefits of testing, as evidenced by the subject line test it ran with MarketingExperiments.

Watch the excerpt below from the MarketingSherpa Media Center to learn how keeping up with current trends and thinking like a consumer can help evolve your testing and your company.


Keep up with current trends and your customers

Keeping up with current customer trends is one of the most important pieces of advice Lauren Wagner gave when asked how to keep a company’s A/B testing constantly evolving. Be sure that you’re keeping up with current trends in the marketplace, but don’t forget to take the time to learn about your customers.

Read more…