Net Promoter is to add social media measurement to its existing customer loyalty metrics, launching a new product called SparkScore that takes mentions of a brand on Facebook, Twitter and other channels into consideration.

Parent company Satmetrix confirmed last night that SparkScore will assign a numerical value to a brand using a similar methodology to Net Promoter.

Net Promoter's scoring uses an 11 point scale from 0-10 in answer to the question: ‘how likely are you to recommend?'

The value is then calculated by subtracting the percentage of detractors from the percentage of promoters.

SparkScore’s ratings will interpret comments within social media, on blogs and in customer reviews from Amazon among others.

Satmetrix says that it is working with Metavana to provide a “rigorous and reliable sentiment engine” on which to analyse sentiment.

The validity of sentiment analysis is always up for discussion, and social influence scores like Klout, PeerIndex and Kred are even more so.

eModeration marketing and communications manager Tia Fisher said that automated sentiment analysis is notoriously inaccurate, but it'll take some time to see how Net Promoter's methods differ from others. Plus how it keeps up with changes and trends in language.

The ‘would you recommend’ question is the most popular measure of customer satisfaction for a brand, but is too black and white to give any real meaning. It doesn’t take into account variables (‘the food was amazing but the service was average’). Not much use for brands who want to learn from social conversations and improve their service."

While the credibility of the Net Promoter name will give it an advantage in terms of selling this brand-specific sentiment analysis to its existing clients, with the result be any better? Though for many it's a strong starting benchmark, Net Promoter itself also has flaws.

Online PR consultant Michelle Goodall pointed out that the key here is how good the sentiment analysis actually is and we won’t know that until we can properly review the results.

But it might have been far more logical to mine recommendation data and provide scores based on actual numbers of indisputable brand recommendations that people make to close friends and peers, i.e. those people that really matter to us as individuals and whom we really wouldn’t want to give a wrong steer to.”

This could have been based on an algorithm that includes the length and strength of connection, frequency and recency of contact, use of familiar/friendly verbs, topics discussed, use of emoticons and such.

PeerIndex CEO Azeem Azhar agrees on this point, saying that though tracking social sentiment can give brands a numerical picture of how many people are making positive or negative comments on the social web, it ignores a far more important metric - influence.  

One hugely influential commentator making a negative comment can outweigh 1000 less influential comments, so a simple sentiment metric can give a misleading picture.  If brands were to incorporate an influence metric into a calculation of this sort then you’d get a far more accurate picture of your true sentiment status.”

PeerIndex actually refers to this as 'net promoters with friends', where a net promoter who can refer you to hundreds of people who trust their opinions on a given topic is more valuable than a net promoter with none.

The other point here is that Net Promoter is playing catch-up. There are many other services that do this for brands now, and though Satmetrix's announcement talks about no other services having "proven linkage to growth" - it isn't clear exactly how SparkScore does.

Co-founder of Sociagility Niall Cook is surprised that this move wasn't made sooner.

The Net Promoter methodology has a great legacy, so it makes sense to apply it to social media chatter. It will be interesting to see what value another sentiment analysis tool can add to brands that are realising they need a more multi-dimensional approach to measurement."

What are your thoughts? Does Net Promoter have more of a chance of getting this right because of its history in this area - or this too little too late?

Vikki Chowney

Published 3 February, 2012 by Vikki Chowney

Vikki is head of community at TMW. You can follow her on Twitter or Google+

249 more posts from this author

You might be interested in

Comments (1)


Karen Schofield

It will be interesting to see whether this latest way of understanding brand advocacy takes off. While NPS has been hugely popular and is now very much embedded in many businesses, its claims of being 'the one number you need to grow' were never substantiated by those trying to replicate Reichheld's initial analysis (on which he made his claims), and clearly NPS hasn't proven to be the indicator of growth he claimed during a recession.

I'm therefore pretty sceptical about this new approach. I agree with the concerns raised above that influence is a key factor which is missing from the way it's calculated, and there are so many questions around the accuracy of automated sentiment this will keep up with the modified language, abbreviations and colloquialisms which are in abundance in social media posts will be interesting to see.

Don't get me wrong, understanding advocacy of a brand is important and it's great that companies are looking at different ways of measuring it, but I don't believe there is ever 'one measure' which is a predictor of future growth. Or that even combining two ways of looking at it is the answer (i.e. measuring NPS in a survey and then doing some automated sentiment analysis online). There are just far too many other variables which such a limited approach will never capture.

The best approach is combining several data sources (e.g. market research alongside secondary data - sales, service levels, CRM info etc.), robust analysis and understanding why consumers feel the way they do about your brand. It's not the numbers but understanding what the numbers actually mean which is the best predictor - of growth, propensity to buy again, or of whatever else it is you're trying to understand. A number might have its place on a dashboard of KPIs, but without understanding that number and what it means, it's never going be to be actionable business information. And ultimately, isn't that what doing research - in any form - is all about?

over 6 years ago

Save or Cancel

Enjoying this article?

Get more just like this, delivered to your inbox.

Keep up to date with the latest analysis, inspiration and learning from the Econsultancy blog with our free Digital Pulse newsletter. You will receive a hand-picked digest of the latest and greatest articles, as well as snippets of new market data, best practice guides and trends research.