Search

Background Given that patient safety measures are increasingly used for public reporting and pay-for performance, it is important for stakeholders to understand how to use these measures for improvement. The Agency for Healthcare Research and Quality (AHRQ) Patient Safety Indicators (PSIs) are one particularly visible set of measures that are now used primarily for public reporting and pay-for-performance among both private sector and Veterans Health Administration (VA) hospitals. This trend generates a strong need for stakeholders to understand how to interpret and use the PSIs for quality improvement (QI). The goal of this study was to develop an educational program and tailor it to stakeholders’ needs. In this paper, we share what we learned from this program development process. Methods Our study population included key VA stakeholders involved in reviewing performance reports and prioritizing and initiating quality/safety initiatives. A pre-program formative evaluation through telephone interviews and web-based surveys assessed stakeholders’ educational needs/interests. Findings from the formative evaluation led to development and implementation of a cyberseminar-based program, which we tailored to stakeholders’ needs/interests. A post-program survey evaluated program participants’ perceptions about the PSI educational program. Results Interview data confirmed that the concepts we had developed for the interviews could be used for the survey. Survey results informed us on what program delivery mode and content topics were of high interest. Six cyberseminars were developed—three of which focused on two content areas that were noted of greatest interest: learning how to use PSIs for monitoring trends and understanding how to interpret PSIs. We also used snapshots of VA PSI reports so that participants could directly apply learnings. Although initial interest in the program was high, actual attendance was low. However, post-program survey results indicated that perceptions about the program were positive. Conclusions Conducting a formative evaluation was a highly important process in program development. The useful information that we collected through the interviews and surveys allowed us to tailor the program to stakeholders’ needs and interests. Our experiences, particularly with the formative evaluation process, yielded valuable lessons that can guide others when developing and implementing similar educational programs. Electronic supplementary material The online version of this article (10.1186/s12913-018-2904-5) contains supplementary material, which is available to authorized users.

Background To overcome the limitations of administrative data in adequately adjusting for differences in patients’ risk of readmissions, recent studies have added supplemental data from patient surveys and other sources (e.g., electronic health records). However, judging the adequacy of enhanced risk adjustment for use in assessment of 30-day readmission as a hospital quality indicator is not straightforward. In this paper, we evaluate the adequacy of risk adjustment by comparing the one-year costs of those readmitted within 30 days to those not after excluding the costs of the readmission. Methods In this two-step study, we first used comprehensive administrative and survey data on a nationally representative Medicare cohort of hospitalized patients to compare patients with a medical admission who experienced a 30-day readmission to patients without a readmission in terms of their overall Medicare payments during 12 months following the index discharge. We then examined the extent to which a series of enhanced risk adjustment models incorporating code-based comorbidities, self-reported health status and prior healthcare utilization, reduced the payment differences between the admitted and not readmitted groups. Results Our analytic cohort consisted 4684 index medical hospitalization of which 842 met the 30-day readmission criteria. Those readmitted were more likely to be older, White, sicker and with higher healthcare utilization in the previous year. The unadjusted subsequent one-year Medicare spending among those readmitted ($56,856) was 60% higher than that among the non-readmitted ($35,465). Even with enhanced risk adjustment, and across a variety of sensitivity analyses, one-year Medicare spending remained substantially higher (46.6%, p