Customer Experience, Business Events, Behaviour, Revisits: Complete Customer Insight
Discover the complete 360°-panorama in Digital Marketing at Europe's biggest digital marketing fair - 17-18 September Register free today
The web has made market research widely available but the conclusions drawn from different methods of research provide different and sometimes conflicting results.
The savvy manager will not just depend on one source of research about the market but several – and keyword research should be an essential part of any research project.
Survey results make great reading
There’s always a certain degree of scepticism about published market research but there is little doubt that the results make great reading.
Generations of public relations people have long known that one of the best ways to get media coverage is to publish a survey. Particularly if you can grab the space for regular research – a monthly or an annual survey can guarantee a lot of coverage and be effective link bait.
The web has made the collection and publication of survey information so easy.
However, there is a backlash against this flood of research studies. Marina Hyde in her Guardian blog writes:
“In various other recent polls, 72% of people thought the world will end in two to three generations, that half or more Aston Villa games are uninspiring, that global warming is not caused by human activity, that the smoking ban will result in a more pleasant atmosphere in pubs and bars, that George Bush is mishandling the Iraq war, that First Great Western train services are satisfactory, and that the US government is withholding UFO data.”
And comedian Jackie Mason’s takes a swipe at the granularity of research:
“It’s amazing, we are learning more and more about less and less. If we carry on like this, soon we’ll know everything about nothing.”
Some consumers are getting fed up with participating in market research, according to Spinwatch.org:
“Just 0.25% of the population supplies 32% of responses to online surveys, said Simon Chadwick, former head of NOP Research in the U.K. and now principal of Cambiar, a Phoenix consultancy, citing research by ComScore Networks. More broadly, he said, 50% of all survey responses come from less than 5% of the population.”
The big assumption in surveys is that we can extrapolate the answers from people who participate to those who do not. But as Spinwatch.org reports:
“No one really knows whether people who don't answer surveys are similar to those who do, because they don't answer surveys.”
In her Clickz.com column, Is Anything Really Measurable Online?, Rebecca Lieb reports that two of the web’s leading research publishers, comScore and Nielsen//NetRatings, are currently undergoing an audit of their methods because:
“Internet Advertising Bureau (IAB) members are claiming massive
discrepancies between their own web stats and the panel-based numbers
provided by ComScore and Nielsen panels up to two or three fold”.
Conflicting results
And two research studies investigating the same area can provide conflicting results. According to the Market Research Society:
“Two reputable companies asking the same person the same question via
telephone and email may receive two different answers.”
There are several reasons why results amongst pollsters may differ:
1. Know the source of the raw data.
2. Know the methodology by which it is collected and analysed.
3. Know how conclusions are drawn.
And finally, you need to test and measure, and adjust your strategies accordingly.
Ken McGaffin is the chief marketing officer of Wordtracker.com.
responce. Off course when you read the results of surveys in the media rarely do they mention the participation rate.