The study
The HR department of a software firm in Bengaluru wrote a single question to track staff engagement: "How engaged do you feel at work this week?", answered from 1 to 5. In a pilot, 400 employees answered it twice, two weeks apart, and the two sets of answers correlated at r = .31. The firm went ahead anyway. Each quarter it averages the answers within each of its 60 teams, which have about eight members each, and ranks the teams. Managers of the bottom ten teams lose their quarterly bonus. HR says the scheme gives managers a clear, objective incentive to improve engagement.
What is the flaw in this study?
- A Simpson's paradox
- B Survivorship bias
- C Unreliable measure The flaw
- D Order effects
The concept: Reliability limits what a measure can support
This study is fictional, written for practice. No real study, institution or researcher is described.