{{ searchResult.published_at | date:'d MMMM yyyy' }}

Loading ...
Loading ...

Enter a search term such as “mobile analytics” or browse our content using the filters above.

No_results

That’s not only a poor Scrabble score but we also couldn’t find any results matching “”.
Check your spelling or try broadening your search.

Logo_distressed

Sorry about this, there is a problem with our search at the moment.
Please try again later.

If you want to know how to make your e-commerce website better, ask the people who use it.

Surveys are one of the quickest ways of finding out what matters to your customers, what's missing or broken and what's getting in the way of conversions. They're also a great source of market intelligence.

Add a survey to your site, treat the comments from your customers as if they contained nuggets of gold, and you'll find learn things about your business and your market which no 'best practice' guide could tell you. 

Why you need voice of customer surveys

If I had to choose just one optimisation tool to use on an e-commerce site I would install a voice of customer survey even before I implemented Google Analytics, commissioned any usability tests, or ran any split tests.

Of course, in real life we don't have to make that choice and can do all of those. But many sites seem to treat surveys as an occasional afterthought and not a top priority. I think that's a mistake.

It pays to start with a survey straight away for two key reasons:

  • With surveys (like usability tests) you start getting useful insights immediately. You don't have to wait for significant results to build up, as you do with web analytics reporting and split tests. 
     
  • With surveys your visitors will often point you precisely at what is wrong and tell you what they were thinking and what they were trying to do when it happened. That's way better than puzzling over funnel abandon rates.

As a bonus you also gain great insights into the needs of your visitors and the language they use to express them in.

The more comments you read, the better your understanding of your market will be. This can drive everything from advertising and SEO, through site navigation, to calls to action, and all the way on to product development and merchandising.

This 'listen to your customer' aspect of surveys is hugely important. I started my working life standing behind a shop counter before moving on to working in the call centre. I'm one of the old-school who believe everyone involved in retail should spend time with customers if they can. In my last in-house job I had my desk in the same room as the contact centre for exactly that reason, even though I was running the whole direct sales part of the company. 

Where to place the survey

Although there are great systems for allowing feedack surveys on every page of your site, I'm not in favour of using any form of pop-up which might distract your visitor from whatever they want to do.

Intstead, my favourite type of e-commerce survey is one embedded in the order confirmation page. I like these because there is zero risk of distracting someone from placing an order since the survey is only offered once the sale is complete.

Example of embedded voice of customer survey

The obvious objection is that this means you don't get any survey entries from people who did not intend to buy or were unable to buy. That's a common-sense point. But in reality it doesn't seem to be a problem.

I base that claim on the fact that I've been working with such comments from clients sites for many years. During peak periods we will be processing thousands of free-text comments each week.

In real life it turns out that people who have problems buying can be remarkably tenacious. Some will eventually find what they want, or make it through a tricky checkout, and then let you know all about the problems when they get to the survey comments form.

The same rule applies as with usability tests. You can learn a great deal from a very small number of comments.

If just one person provides you with a clue which allows you to identify and fix an obscure bug, then it does not matter that hundreds of other ones only made vague reference to difficulties doing something. You do not have to wait for a statistically significant number of people to be equally precise. One comment can be enough to tell you what to fix.

That kind of thing happens regularly, in my experience. After a few years the 'eureka' moments happen less often. But they still turn up often enough for the process to be well worth it.

Having said that, my advice is that it's important to combine survey comment analysis with other sources of information, such as Google Analytics, in order to prioritise the information. 

How to use Google Analytics to prioritise what to fix

Starting from the survey comment about some issue, you should dig down into GA reports and do a bit of forensic work. Using the comment for guidance you can find things which you would never have spotted unless someone had told you where to look. 

  1. Identify the page where the problem occurs in GA.
     
  2. Work out what most people do if they don't experience the problem.
     
  3. See if the clue has given you enough information to be able to spot the page people end up on after the error. There's often a pattern once you know what to look for. But maybe they just exit.
     
  4. Now use GA to work out how many people are affected (Custom Advanced Segments based on stage 1 and 2 above are great for this).
     
  5. Compare any relevant conversion rates or micro-conversion rates for people affected by the problem with people not affected.

Assessing the percentage of people affected is important. If you don't do this, it's easy to get the wrong impression from a steady flow of very hostile comments about a particular issue. You start believe that the problem is more significant than it is. I've been caught out this way.

When you see a lot of negative comments it's easy to over-react and become convinced that the site is worse than it is.

Having said that, this would be a good moment to say that you don't only get complaints. It's common for over 50% of the comments to be positive. People are remarkably nice and generous with their praise if all goes well. And many people are supportive even when things have disappointed them.

Positive customer survey comment wordcloud 

Positive comments are also very valuable

One great use for positive comments is to circulate them within the team so that everyone knows that their work is appreciated. The more self-service shopping becomes, the fewer people working in companies get the benefit of interacting with customers.

A more commercial use is to mine these positive comments to work out what your customers see as your key strengths and to note the language they use to describe them. What you may think of as your Unique Selling Point may not resonate with your market. 

Find out why your customers choose you over your rivals and use that language in your promotional activity. 

A special group of comments are the product requests. It's common for customers to suggest things which they would like you to stock. This will vary according to your market. I've seen a regular flow of around 10% of comments being requests for new products in one fast-moving market. That's enough to justify a specific export for the product development team each week. 

10% is exceptional, I think. But there's a steady trickle of requests for more products in some ranges, or for discontinued items to be restored, across all the sites I've worked on. 

This is the kind of market intelligence you would get routinely in stores and to some extent with telephone orders, but which is hard to get from ecommerce sites. Formal market research projects are very expensive, so it makes sense to tap into this relatively cheap and continuous source.

What to ask in the survey

It's important to keep the survey very short. The more questions you ask, the fewer replies you will get. It's a very clear trade-off.

Avoid using complex options, multiple choices (which take time to read and then think about because none of them are quite right) and dynamic questions. It should be clear at a glance that the survey is very short and is not going to take time.

The highest priority is a free text 'any comments' question. 

  • Do not complicate or skew this by using words like 'suggestions', 'ideas', 'complaints'.
  • Do not offer several different text boxes for different types of comment and expect people to work out what to put where.

Keep it simple. You want the comment. Every bit of complication will reduce the number of comments and restrict what people tell you.

I also think it's good to ask the 'Net Promoter*' question: "How likely are you to recommend this site to a colleague or friend?" with a score from 0 to 10. Full details of how to calculate your Net Promoter Score from the results are explained on the Net Promoter site

There are three benefits of asking this question. 

  1. It provides a simple overall score which you can use to as a guide to how you're doing. Some people argue that it is too simple, but I'm not suggesting you should use it as any more than a guide and I'm not suggesting it should be your only measure.
     
  2. Net Promoter Score provides a benchmark you can use to compare yourself to some other companies which make their scores public.
     
  3. Hidden Bonus: by asking people how likely they are to recommend your site, you are planting the idea of doing so. In this day and age you could go the whole way and put Facebook and Google+ buttons right next to the survey form.

Since we're talking about e-commerce sites and the survey is on the 'thank you page' I would also ask two other rating questions:

  1. "How easy was it to find what you wanted?"
  2. "How easy was it to use the checkout?"

That's it. Maybe one more question, if you must. Please resist the temptation to ask more questions at this point.

Coming next: how to get the best out of your survey

In part two of this series I'll give you an overview of how to get started. I'll cover some of the systems you can use and give you some tips about useful extra information to collect.

Most important of all, I'll explain why you need to set up a routine business procedure to analyse the comments and give an example of how doing so is vital to getting the best return.

[*Net Promoter, NPS, and Net Promoter Score are trademarks of Satmetrix Systems, Inc., Bain & Company, and Fred Reichheld]

Avatar-blank-50x50

Published 29 February, 2012 by Tim Leighton-Boyce

Tim Leighton Boyce is a freelance ecommerce analyst and a contributor to Econsultancy. You can find Tim on LinkedIn or follow him on Twitter

2 more posts from this author

Comments (6)

Comment
No-profile-pic
Save or Cancel
Avatar-blank-50x50

Natalie Welsh, Business Analysis Manager at LateRooms

Great article Tim - looking forward to the next installment.

over 4 years ago

Marc Mezzacca

Marc Mezzacca, Founder at NextGen Shopping LLC

"I'm not in favour of using any form of pop-up which might distract your visitor from whatever they want to do"

I agree with this 100%. I've seen on many retail sites a popup during my shopping experience, specifically from ForeSee, and even occasionally the moment I get on to the site. This is beyond irritating, I can't understand it. It is distracting and feel like leaving the site immediately.

Would love to see a study on how the placement/implementation effects user experience and actual survey results.

over 4 years ago

Avatar-blank-50x50

Kevin Goodings

I enjoyed reading this article. Our experience backs up everything said.

We do also see great value from the insight gained from exit surveys for customers that abandon.

We've got some neat technology that creates a pop-under so that it doesn't distract from the buying process.

The pop-under dynamically changes the question set to reflect the customer's progress on checkout so we ask really targeted questions on exit or completion. This works really well.

We do make use of Google Analytics and we also link our surveys to SessionCam.com so that you can watch a replay of a customer visit. This really helps you see what actually happened so that you can understand the feedback in context.

over 4 years ago

Avatar-blank-50x50

Tim Leighton-Boyce, Analyst at CxFocus

@Natalie: thank you. Part two should be appearing any day now, I believe.

@Marc: I don't have any formal study. But I do know that on one personal site where I ran the 4Q survey with an overlay invitation, about 3% of the comments complained about the overlay or misunderstood and complained that they had not actually had a chance to view the site itself.

@Kevin: that sounds extremely impressive. It's far more sophisticated that the surveys I'm suggesting here. My proposal is that people should do the easiest and simplest thing to implement first. Then when they can see just how valuable these systems they'll be ready to do something more complex. Thank you for making the point about customer replays, too. We use Clicktale on one of the sites in question, but I had not considered integration. That's a very interesting idea.

over 4 years ago

Nigel Atkinson

Nigel Atkinson, Head of Customer Engagement at neoworks

Great article Tim, you have been banging the drum for customer surveys as a critical feedback mechanism for merchants since we first met.

The checkout example that you have used looks very familiar to me, and as the e-commerce software company responsible for maintenance I have to admit that we initially reviewed the feedback form reports with frustration and amusement (the content of some of the comments could have been Perrier award winning). The frustration was rooted in a lack of prioritisation of some of the feedback, and quantitative analysis of the issues using tools such as GA is really important. Superlatives and even expletives in isolated comments should not be considered a factor in the prioritisation of issues.

Over time the feedback became one of our most important and eventually loved sources of information. The feedback that we received through the form helped to identify and resolve a range of technical and usability issues as well as providing a very clear customer satisfaction barometer and a few chuckles!

over 4 years ago

Avatar-blank-50x50

stock market

good website saying about stock market i got informative treat here thank you for sharing this content

almost 4 years ago

Comment
No-profile-pic
Save or Cancel
Daily_pulse_signup_wide

Enjoying this article?

Get more just like this, delivered to your inbox.

Keep up to date with the latest analysis, inspiration and learning from the Econsultancy blog with our free Daily Pulse newsletter. Each weekday, you ll receive a hand-picked digest of the latest and greatest articles, as well as snippets of new market data, best practice guides and trends research.