Skip to content
IGCSE·Tuition
Business · Lesson

Identify a biased survey item

A survey can look careful and still push respondents toward the answer the owner hopes to hear.

On this page
  1. What kinds of flaw should you look for?
  2. How to check an item, step by step
  3. Worked example
  4. The mistake to watch for
  5. Check yourself
  6. Where this leads next

A biased survey item is a question whose wording, options or layout pushes respondents toward a particular answer, or leaves them unable to answer accurately. IGCSE Business questions may show you a draft questionnaire.

You may need to say what is wrong with it or improve it. So the skill is to spot the flaw, name it and rewrite the item neutrally.

It follows choosing between primary and secondary data, because a business that designs its own survey becomes responsible for wording it fairly. It is part of the market research module.

What kinds of flaw should you look for?

  • Leading: hints at the “right” answer (“Don’t you agree…”).
  • Loaded: uses emotional or flattering words (“our delicious, freshly made…”).
  • Double-barrelled: asks two things in one (“price and speed”).
  • Overlapping or missing options: a person fits two boxes, or none.
  • Unbalanced scale: more positive choices than negative ones.
  • Vague: “often”, “recently” or “good” mean different things to different people.

Several flaws can sit in one item, so check each one in turn.

How to check an item, step by step

  1. Read the wording as a sceptical respondent. Does anything hint at the preferred answer?
  2. Count the ideas. If there are two, it is double-barrelled.
  3. Check the options. Do they cover everyone, without overlap, and are they balanced?
  4. Check the key words. Replace vague words with something countable.
  5. Rewrite the item so that every answer feels equally easy to give.

Worked example

Kedai Makan Siti in Alor Setar plans a questionnaire for her nasi lemak stall. Here are two draft items:

Item 1: “Don’t you agree our delicious, freshly made nasi lemak is great value at RM6?”

Item 2: “How old are you? Under 20 / 20 to 30 / 30 to 40 / over 40”

Item 1. It is leading (“Don’t you agree”), loaded (“delicious, freshly made”) and it mixes quality and value in one question. A neutral rewrite separates the ideas:

“How would you rate the value for money of a RM6 portion of nasi lemak?” with the options Very poor / Poor / Fair / Good / Very good.

The five choices are balanced, with two negative, one middle and two positive.

Item 2. The options overlap: a 30-year-old fits both “20 to 30” and “30 to 40”, and a 40-year-old fits “30 to 40” but is missed by “over 40”. A fix with no overlap or gap:

Under 20 / 20 to 29 / 30 to 39 / 40 and over.

Every age belongs to exactly one box.

The mistake to watch for

A common slip is to fix only the most obvious flaw.

Mistaken rewrite: “Is our nasi lemak good value at RM6 and served quickly?”

The student removed “Don’t you agree” and “delicious”, but the question still asks about two things, value and speed.

The correction is to split it into two items, each with its own balanced scale. A neutral tone is not enough if two ideas are still joined.

Check yourself

Try these, then open each answer.

1. Name the flaw: “How friendly and clean was our salon?”

Show answer

It is double-barrelled: it asks about friendliness and cleanliness together. Split it into two questions.

2. Rewrite neutrally: “Wouldn’t you say our new cendol is far better than the competition?”

Show answer

For example: “How would you rate our new cendol compared with other cendol you have bought?” with a balanced scale from Much worse to Much better. The original is leading and compares only in one direction.

3. Spot the problem with these income options: RM1,000 to RM2,000 / RM2,000 to RM3,000 / RM3,000 to RM4,000. Suggest a repair.

Show answer

The ranges overlap at RM2,000 and RM3,000, and nothing covers incomes under RM1,000 or over RM4,000. Repair: Under RM1,000 / RM1,000 to RM1,999 / RM2,000 to RM2,999 / RM3,000 to RM3,999 / RM4,000 and over.

Where this leads next

A well-written question still has to reach the right people. Continue with sample limitations, and bring this checklist to the practice set.

If you find it easy to criticise a draft survey but hard to write a fair one from nothing, our teachers can work through that with you in online one-to-one Business tuition.

Questions people ask

What is a leading question?

A leading question suggests which answer is expected, so respondents are nudged toward it. For example, 'Don't you agree our lemang is excellent value?' invites a yes. A neutral version asks how the respondent rates the value and offers a balanced range of answers, so a negative reply is just as easy to give.

What is a double-barrelled question?

A double-barrelled question asks about two things at once, such as price and speed. A respondent who is happy with one but not the other cannot answer honestly, and the owner cannot tell which part the answer refers to. The fix is to split it into two separate questions.

Why does biased wording matter if the sample is large?

A large sample cannot repair a flawed question. If the wording pushes people toward an answer, every response carries the same push, so a bigger count only makes the wrong result look more convincing. Fair wording matters before the number of respondents does.

Updated:

Your next step

If you can spot a bad question when it is pointed out but miss it in a new case, a one-to-one teacher can build a checking routine with you so the flaw stands out each time.

Paid one-hour trial at your assigned teacher’s confirmed rate, starting from RM80.

Tuition is arranged with a parent or guardian. Send them this page on WhatsApp and they can enquire for you.

Parents: enquire here

  • 9,000+ students helped through our service
  • 9+ years helping IGCSE students