Providing a sample

You might have missed the news that the polling industry (The British Polling Council) began its autopsy into its general election performance a few weeks ago. The investigation will be long with a final report not due until March 2016, but the initial meeting of the contributors threw up some interesting points.

Prominent amongst these was a question from Martin Boon of ICM who, according to the BBC report of the event ( asked, is it still possible to get a representative sample over the telephone?

With more people using mobiles and more likelihood of call screening or non-participation the number of calls that need to be made to achieve a representative sample is huge. Mr. Boon cited numbers of 30,000 random calls needed to gather a sample of 2,000. That means the chances of achieving a representative sample from such a low response rate are equally low.

Ok so their focus is on polling and the canvassing of political opinion which is never an easy subject to get respondents to engage with and still achieve representation (the chances are that the politically engaged are more likely to respond thereby skewing your sample) but the general principle is something for anyone undertaking research to be concerned about.

Take online sampling, the self-selected nature of the sample means it will always be inherently biased, of course as a research agency we would say that wouldn’t we? Well yes, but only because we care about the credibility of the process and the accuracy of results. If the data collection method skews the results then you have to think about your method.

Should you be worried and thinking about changing your methodology? Probably not. In the end you have to take a pragmatic approach. How you do that depends on your sector, the potential costs involved, the time available to complete your project, your objective and the decisions that will be made as result of your work.

In the end this topic highlights the importance of sampling and the real possibility that an ill-considered sample may deliver results that lead you in entirely the wrong direction.


Posted by Lisa

3 words

What 3 words would you use to describe 2020 so far?  Here’s a few for starters … Unprecedented?  Challenging?  Chaotic?  Scary? Dystopian? Exciting? Uncertain? Tumultuous? Mindful?  Life-changing? Anxious?  The reality… Read more »

When a little insight can be just enough….

Once upon a time, not so very long ago, commissioning an insight project typically meant embarking on a long and often pretty expensive journey.  Projects routinely ran for 8+ weeks… Read more »

Coronavirus: leisure, tourism & events

Along with the rest of the UK (and many populations around the world) we’ve spent many weeks now at home under lockdown. However, with the weather warming up, people are… Read more »

Data isn’t insight alone

The marketing stream at this years’ AEO Forums included a brilliant session from Ben Smithwell from Comotion. Ben’s session titled ‘Demystifying Customer Insight for Marketing Professionals’ highlighted, that data alone… Read more »


Persona definition the aspect of someone’s character that is presented to or perceived by others Today, the more widely used definition of persona is a tool for understanding audience behaviours,… Read more »

Testing times

It’s safe to say everyone is feeling the effects of or worrying about the economic downturn resulting from the spread of Coronavirus. We hope that our friends, family and clients… Read more »

Our Clients

We have extensive experience working across a wide range of industry sectors for many leading brands.

Contact Details

Victory House
Chequers Road
NR15 2YA

t / +44 (0)844 800 9588

e /