May 20, 2013

Survey reporting, yet again

The Herald says “Half of NZ workers eyeing new jobs – survey

The photo caption even says “Of those working in property and construction, 63 per cent said they were likely to look for a new job in the next year” so they survey apparently breaks down its sample into a bunch of subcategories.

So, how reliable is this survey?  The Herald doesn’t say much about methodology, except that

The online survey canvassed 260 “professionals” working in jobs ranging from entry-level to senior management.

That’s not a lot, and you really have to wonder how they were sampled.  The Herald gets points for linking to the full glossy pamplet, but its methodology section say, in full

The Michael Page Employee Intentions Report is based  on the online survey responses of 260 professionals in New Zealand. Participants represent a range of professional occupation groups and hold positions that range from entry level through to senior management. The scope of the report includes key employee insights into preferences for attraction and retention, salary expectations, benefits and work-life balance and their views on the predicted employment outlook.

This might not be a bogus poll, but the lack of information is really not encouraging.  The report doesn’t give any demographic information that might help verify how representative it is, but it does say that 76% of those planning to change jobs intend to use recruitment consultants.

All in all, clearly a win for the flacks, not the hacks.

avatar

Thomas Lumley (@tslumley) is Professor of Biostatistics at the University of Auckland. His research interests include semiparametric models, survey sampling, statistical computing, foundations of statistics, and whatever methodological problems his medical collaborators come up with. He also blogs at Biased and Inefficient See all posts by Thomas Lumley »