Auditory Skills as a Predictor of Rater Reliability in the Evaluation of Vocal Quality

Summary Objective To determine whether an association exists between auditory skills and the reliability of judgments of the vocal deviation grade and the degrees of roughness and breathiness and to evaluate whether these skills are predictive of interrater reliability in auditory-perceptual evaluations. Methods The sample consisted of 20 speech-language pathology students without previous training in auditory-perceptual evaluation. The students underwent a basic audiological evaluation and a central auditory processing evaluation. They then participated in two auditory-perceptual evaluation sessions assessing the general grade (GG) and the degrees of roughness and breathiness of 44 samples of sustained vowel production with the presence or absence of dysphonia. For statistical analysis, the intraclass correlation coefficient (ICC) and a beta regression model were used. Results A difference was found in the average ICCs of the GG parameter between listeners with high and low temporal resolution and binaural interaction skills. Temporal resolution skills and binaural interaction affected the ICC of listeners in the GG evaluation, reducing the likelihood of reliability by 2.8 and 3.6 times, respectively. Conclusion An association exists between temporal resolution skills and binaural interaction and the reliability of listeners in evaluations of vocal deviation severity. Listeners with low levels of these skills show less reliability in evaluations of the severity of vocal deviation. In addition, temporal resolution and binaural interaction are predictors and explain 42.7% of the variability in the reliability of evaluations of vocal deviation severity.