The study
A community health team in Glasgow ran a four-week sleep-hygiene course for 30 adults who reported poor sleep. Each person completed the Pittsburgh Sleep Quality Index (PSQI) before the course and again a week after it ended; all 30 completed both. The average score improved from 11.4 to 9.6, where lower is better. To test the change, the team treated the before scores and the after scores as two separate groups and ran an independent-samples t-test, t(58) = 1.62, p = .11. Their report concludes that the course made no measurable difference to sleep and that the funding should be redirected.
What is the flaw in this study?
- A Ceiling effect
- B Survivorship bias
- C Base-rate neglect
- D Wrong test: paired data analysed as independent The flaw
The concept: Matching the test to the design
This study is fictional, written for practice. No real study, institution or researcher is described.