PsychologyOrbit
Sign in Join

#17 ·

Spot the flaw #17: Manager praise and performance

A past puzzle, with the answer. Try today's puzzle.

What is the flaw in this study?

Reverse causation. The data are compatible with the opposite direction: managers naturally praise people who are already performing well. If so, training managers to praise more will not raise anyone's performance. There is also a shared-source problem, because the same…

A fictional study written for practice (Spot the flaw #17).

Fictional study Work & organisational · Birmingham, UK

The study

A logistics firm in Birmingham asked 600 employees how often their line manager praised their work, on a scale from "never" to "several times a week". The answers were matched with each employee's annual performance rating from the same year. Employees who reported more praise had clearly higher ratings (r = .42), and the link held across departments, job levels and both shifts. The board concluded that praise drives performance and has paid for every manager to attend a two-day course on giving praise more often, expecting next year's performance ratings to rise as a result.

What is the flaw in this study?

  • A Reverse causation The flaw
  • B Ceiling effect
  • C Attrition: only completers analysed
  • D Order effects
Reverse causation. The data are compatible with the opposite direction: managers naturally praise people who are already performing well. If so, training managers to praise more will not raise anyone's performance. There is also a shared-source problem, because the same managers who give praise also give the ratings. Survey links measured at one time cannot show which variable comes first. A better test would randomly assign the praise training to some teams and not others, then compare later performance using measures not produced by the trained managers, such as objective productivity records.

The concept: Which way does the arrow point?

This study is fictional, written for practice. No real study, institution or researcher is described.