1. Audio-digital recordings used for independent confirmation of site-based MADRS interview scores.
- Author
-
Targum SD, Pendergrass JC, Toner C, Asgharnejad M, and Burch DJ
- Subjects
- Antidepressive Agents therapeutic use, Double-Blind Method, Heterocyclic Compounds therapeutic use, Humans, Monoamine Oxidase Inhibitors therapeutic use, Psychometrics, Reproducibility of Results, Copying Processes methods, Depressive Disorder, Treatment-Resistant drug therapy, Interviews as Topic methods, Psychiatric Status Rating Scales, Randomized Controlled Trials as Topic methods
- Abstract
Signal detection requires ratings reliability throughout a clinical trial. The confirmation of site-based rater scores by a second, independent and blinded rater is a reasonable metric of ratings reliability. We used audio-digital pens to record site-based interviews of the Montgomery-Asberg Depression Rating Scale (MADRS) in a double-blind, placebo controlled trial of a novel antidepressant in treatment resistant depressed patients. Blinded, site-independent raters generated "dual" scores that revealed high correlations between site-based and site-independent raters (r=0.940 for all ratings) and high sensitivity, specificity, predictive values, and kappa coefficients for treatment response and non-response outcomes using the site-based rater scores as the standard. The blinded raters achieved an 89.4% overall accuracy and 0.786 kappa for matching the treatment response or non-response outcomes of the site-based raters. A limitation of this method is that independent ratings depend on the quality of site-based interviews and patient responses to the site-based interviewers. Nonetheless, this quality assurance strategy may have broad applicability for studies that use subjective measures and wherever ratings reliability is a concern. "Dual" scoring of recorded site-based ratings can be a relatively unobtrusive surveillance strategy to confirm scores and to identify and remediate rater "outliers" during a study., (Copyright © 2014 Elsevier B.V. and ECNP. All rights reserved.)
- Published
- 2014
- Full Text
- View/download PDF