Become A Certified Online Testing Professional ™

Test Methodology

This session builds a strong foundation, giving you the most important principles of effective online testing. It will give you confidence (and authority) as you discuss your testing plans with colleagues.:

• The MEC Single Variable Test Formula – This essential formula is the most important tool for performing a useful experiment.  It organizes each element and helps you plan properly. It will help you achieve the most results with the least risks.
• The (relevant) Academic Vocabulary – You will learn the key concepts for online testing and their proper terminology, along with the differences between a “variable” a “value” and a “treatment”.
• The MEC Test Protocol – This worksheet tool organizes each stage of the test process and automatically calculates all of the key equations.

This session will answer questions such as these:

1. How can I introduce online testing to my group and my manager in a simple, effective and risk-free manner?
2. How can I help my team understand the correct terminology, so we all clearly understand the language of testing?
3. How can I formalize the process within a document that shows the whole team what we are doing...and what we can expect?

Test Validity

This may be the most vital class in the program. Invalid tests lead to incorrect decisions. This session will give you a firm understanding of validity principles, so that you can be confident in the results of your test.

• The Six Most Dangerous Threats to Test Validity – You will learn the meaning and prevention techniques associated with terms like “history effect”, “instrumentation error” “sample distortion”.
• The Key Mathematical Equations For Sample Size Validity – This session will include a concise but fascinating guest lecture from an innovative professor of economics, Dr. David Reiley. You will learn the key mathematical equations for determining test size.
• The MEC Simplified Validity Formula – After the theory, we will present a simple, easy to understand formula that works even for the less mathematically inclined. You will also be given a tool to automatically calculate valid sample size.

This session will answer questions such as these:

1. To make recommendations to my manager, I have to be 100% certain of the validity of the test results. Is this possible?
2. How can I establish a process to ensure that our test results are always valid?

Test Planning

This session focuses on how to determine which variables to test. It is not enough to conduct a valid test. Knowing what to test is as important as knowing how to test. This session will help you plan an entire series of tests with the confidence that you have set the right priorities.

• The MEC Optimization Formula – This formula will help you determine how to prioritize your testing goals (you will generate much more revenue if you test each element in the right order).  
• The MEC Test ROI Calculation Tool– This tool automatically calculates the compounding ROI on a give series of test. This will save you time and money as it helps you determine the impact of each test on your marketing budget.
• Radical Redesign B Pages – Learn a unique method for capturing multi-variable test results with single variable testing techniques. And discover how to make “sudden inferential’ leaps with your initial tests.

This session will answer questions such as these:

1. How can I determine what to test first in order to achieve the greatest benefit?
2. How can I estimate the true impact of a test result on revenues, over a given period of time?

In addition, we will offer classes in:

Test Metrics: which metrics you need to collect and whether or not you should work with your own platform or hire a third party. The seven main traps you should avoid when selecting a vendor (For instance, third party solutions often cause server lag. This can skew your conversion numbers and invalidate your results). We will also teach you two simple ways you can test even if you don’t have sophisticated software.

Test Interpretation: How to understand your data, how to integrate it into ROI projections, and how to assemble it for a presentation to senior management.