1. Classification accuracy of claims-based methods for identifying providers failing to meet performance targets.
- Author
-
Hubbard RA, Benjamin-Johnson R, Onega T, Smith-Bindman R, Zhu W, and Fenton JJ
- Subjects
- Bayes Theorem, Breast Neoplasms classification, Breast Neoplasms epidemiology, Computer Simulation, Evaluation Studies as Topic, Female, Guideline Adherence standards, Guideline Adherence statistics & numerical data, Health Personnel statistics & numerical data, Humans, Mammography classification, Mammography statistics & numerical data, Markov Chains, Medicare economics, Monte Carlo Method, Patient Protection and Affordable Care Act, Population Surveillance, Quality Assurance, Health Care legislation & jurisprudence, Quality Assurance, Health Care statistics & numerical data, Quality Improvement legislation & jurisprudence, United States epidemiology, Breast Neoplasms diagnosis, Health Personnel standards, Insurance Claim Review, Mammography standards, Medicare standards, Quality Assurance, Health Care methods
- Abstract
Quality assessment is critical for healthcare reform, but data sources are lacking for measurement of many important healthcare outcomes. With over 49 million people covered by Medicare as of 2010, Medicare claims data offer a potentially valuable source that could be used in targeted health care quality improvement efforts. However, little is known about the operating characteristics of provider profiling methods using claims-based outcome measures that may estimate provider performance with error. Motivated by the example of screening mammography performance, we compared approaches to identifying providers failing to meet guideline targets using Medicare claims data. We used data from the Breast Cancer Surveillance Consortium and linked Medicare claims to compare claims-based and clinical estimates of cancer detection rate. We then demonstrated the performance of claim-based estimates across a broad range of operating characteristics using simulation studies. We found that identification of poor performing providers was extremely sensitive to algorithm specificity, with no approach identifying more than 65% of poor performing providers when claims-based measures had specificity of 0.995 or less. We conclude that claims have the potential to contribute important information on healthcare outcomes to quality improvement efforts. However, to achieve this potential, development of highly accurate claims-based outcome measures should remain a priority., (Copyright © 2014 John Wiley & Sons, Ltd.)
- Published
- 2015
- Full Text
- View/download PDF