Read beyond the noise.

A public consultation response count is not a representative opinion poll

Paper public consultation forms beside a town planning display.
AI-generated photographic illustration; not documentary photography.

“Eighty per cent opposed the proposal” sounds decisive. Before treating it as a statement about a town, ask who supplied the answers. An open consultation and a representative opinion poll can produce percentages with very different meanings.

A consultation gives people and organisations an opportunity to raise concerns, offer evidence, and suggest changes. Participation can be valuable without constituting a statistical miniature of everyone affected.

Count the respondents, then identify the population

The Scottish Government’s methodology for a Job Grant consultation explicitly distinguishes its self-selecting respondents from the wider population. That is a limitation to carry into any headline, rather than a reason to ignore what respondents said.

Consider an invented example: 120 of 150 people who answer a question oppose a change. The resulting 80 per cent describes those 150 answers. It does not establish that 80 per cent of all residents oppose the change, particularly if people with strong views were more likely to participate.

Nor does a larger response count automatically solve that selection problem. More replies can provide more testimony while leaving the underlying participation pattern unequal.

Read the reasons alongside the tally

A careful report asks how participants were invited, whether organisations and individuals were counted separately, and how many respondents answered the particular question. Someone may complete one section and skip another. A percentage without its question base can obscure that difference.

Then examine the substance. A small number of responses may identify an accessibility issue or a practical flaw worth investigating. A large number of identical responses may demonstrate organised concern without adding the same volume of distinct evidence. Neither observation can be resolved by the headline percentage alone.

A clearer sentence is often simply more precise: “Among those who answered this consultation question, 80 per cent opposed the proposal.” Follow it with the response count and relevant limitations. If a representative survey also exists, report its findings separately rather than blending the two methods into one figure. Readers can then assess both the strength of feeling expressed and what remains unknown about wider public opinion.