1. Empirically supported treatments or type I errors? Problems with the analysis of data from group-administered treatments.
- Author
-
Baldwin SA, Murray DM, and Shadish WR
- Subjects
- Analysis of Variance, Behavior Therapy statistics & numerical data, Bias, Data Interpretation, Statistical, Humans, Psychotherapy, Group statistics & numerical data, Reproducibility of Results, Research Design, Behavior Therapy standards, Empirical Research, Evidence-Based Medicine, Psychotherapy, Group standards, Treatment Outcome
- Abstract
When treatments are administered in groups, clients interact in ways that lead to violations of a key assumption of most statistical analyses-the assumption of independence of observations. The resulting dependencies, when not properly accounted for, can increase Type I errors dramatically. Of the 33 studies of group-administered treatment on the empirically supported treatments list, none appropriately analyzed their data. The current authors provide corrections that can be applied to improper analyses. After the corrections, only 12.4% to 68.2% of tests that were originally reported as significant remained significant, depending on what assumptions were made about how large the dependencies among observations really are. Of the 33 studies, 6-19 studies no longer had any significant results after correction. The authors end by providing recommendations for researchers planning group-administered treatment research., (((c) 2005 APA, all rights reserved).)
- Published
- 2005
- Full Text
- View/download PDF