PsychologyOrbit
Sign in Join

#18 ·

Spot the flaw #18: Office noise and attention

A past puzzle, with the answer. Try today's puzzle.

What is the flaw in this study?

Order effects (no counterbalancing). Every participant did the noise condition second, straight after twenty minutes of the same dull task. Fatigue and boredom build up over forty minutes of vigilance, so errors would likely rise in the second block whatever was playing. Condition and order are…

A fictional study written for practice (Spot the flaw #18).

Fictional study Cognitive · Cardiff, UK

The study

A psychology lab in Cardiff tested whether background noise harms sustained attention. Forty-eight students each completed the same 20-minute computer task, pressing a key whenever a rare target appeared, under two conditions. Everyone did the task first while calm instrumental music played, then immediately afterwards a second time while recorded open-plan office noise played. Errors rose from an average of 12 in the music condition to 19 in the noise condition, a significant increase on a paired t-test. The authors conclude that office noise damages attention and recommend that employers create quiet zones for focused work.

What is the flaw in this study?

  • A Survivorship bias
  • B Base-rate neglect
  • C Order effects (no counterbalancing) The flaw
  • D Restriction of range
Order effects (no counterbalancing). Every participant did the noise condition second, straight after twenty minutes of the same dull task. Fatigue and boredom build up over forty minutes of vigilance, so errors would likely rise in the second block whatever was playing. Condition and order are perfectly confounded. The fix is to counterbalance, with half the participants doing noise first and half doing music first, and to add a rest between blocks. The paired t-test suited the repeated-measures design; the trouble lies in how the conditions were ordered.

The concept: Counterbalancing in repeated-measures designs

This study is fictional, written for practice. No real study, institution or researcher is described.