Supplier Selection

Multivariate Testing Buyer's Guide

By Econsultancy,


Authors: Monica Savut, Linus Gregoriadis

Pages: 127

Structure: Market trends and issues; SWOT analysis; tips and pitfalls; profiles of 13 vendors; information about 17 specialist conversion optimization agencies, summary matrix and charts (for comparing vendors)

About this guide

Econsultancy's Multivariate Testing (MVT) Buyer's Guide, which is relevant for a global audience, is an invaluable resource for those investing in site testing technology, with profiles of 13 leading suppliers and detailed information about the trends and issues affecting the online testing sector. The 127-page report also contains best practice and tips for identifying the right MVT vendor to meet your needs and useful advice for those just starting to get involved in this area.

The report includes insight from in-house practitioners at a range of companies including Tesco, The Telegraph, The Financial Times, Lovehoney and Belron.


The report starts with a look at recent trends in the online testing market, with a focus on MVT, as well as an assessment of the sector's strengths, weaknesses, opportunities and threats.

Trends covered in this guide include:

  • The testing market is going from strength to strength, as more companies are investing resources and planning to integrate testing into their optimization efforts.
  • Self-service solutions are giving the market impetus, with a significant proportion of organisations demanding tools that remove the complexity from optimization efforts.
  • Self-learning technology is used to differentiate tools, while segmentation and targeting are gradually becoming a natural addition to any MVT solution.
  • A knowledgeable, experienced human interface is needed to complement testing technology.
  • Enlightened marketers are cultivating a culture of on-going testing by setting aside a portion of their budgets for testing and involving more business units.

Table of contents

  • Introduction
    • About Econsultancy
  • Executive Summary
  • The Market
    • What is multivariate testing?
      • Types of multivariate tests
    • Market trends
      • Testing market goes from strength to strength
      • Self-service solutions give market impetus
      • Vendors differentiate tools with self-learning technology
      • Companies need skill sets to complement technology
      • Enlightened marketers cultivate culture of on-going testing
    • Return on investment
  • Strengths, Weaknesses, Opportunities and Threats (SWOT)
    • Strengths
    • Weaknesses
    • Opportunities
    • Threats
  • Costs and Pricing Models
  • Tips and Pitfalls
    • Introduction
    • How to find the right MVT technology
    • How to manage internal expectations and requirements
    • A few tips to avoid frustration and failure
  • Market Positioning Charts
    • Explanation for Chart 1: Business model
    • Explanation for Chart 2: Type of company
    • Market positioning overview: Business model
    • Market positioning overview: Type of company
  • Supplier Matrix
  • Specialist Conversion Optimization Agencies
  • Supplier Marketplace and Profiles
    • Accenture Interactive
    • Adobe Systems
    • Amadesa
    • Autonomy
    • GlobalMaxer
    • Google Website Optimizer
    • HiConversion
    • Maxymiser
    • Monetate
    • SiteSpect
    • Vertster
    • Visual Website Optimizer
    • Webtrends


  • Pdf SAMPLE: Multivariate Testing Buyer's Guide (586 KB PDF)
  • Pdf Disabled Multivariate Testing Buyer's Guide (1.83 MB PDF)

Featured suppliers


Access the full report

Econsultancy subscribers have full access to all our online research as well as a host of other services designed to help save you time, make better decisions and look smart in meetings.

Learn more and buy today