Search

BackgroundClinical decision support (CDS) is a valuable feature of electronic health records (EHRs) designed to improve quality and safety. However, due to the complexities of system design and inconsistent results, CDS tools may inadvertently increase alert fatigue and contribute to physician burnout. A/B testing, or rapid-cycle randomized tests, is a useful method that can be applied to the EHR in order to rapidly understand and iteratively improve design choices embedded within CDS tools. ObjectiveThis paper describes how rapid randomized controlled trials (RCTs) embedded within EHRs can be used to quickly ascertain the superiority of potential CDS design changes to improve their usability, reduce alert fatigue, and promote quality of care. MethodsA multistep process combining tools from user-centered design, A/B testing, and implementation science was used to understand, ideate, prototype, test, analyze, and improve each candidate CDS. CDS engagement metrics (alert views, acceptance rates) were used to evaluate which CDS version is superior. ResultsTo demonstrate the impact of the process, 2 experiments are highlighted. First, after multiple rounds of usability testing, a revised CDS influenza alert was tested against usual care CDS in a rapid (~6 weeks) RCT. The new alert text resulted in minimal impact on reducing firings per patients per day, but this failure triggered another round of review that identified key technical improvements (ie, removal of dismissal button and firings in procedural areas) that led to a dramatic decrease in firings per patient per day (23.1 to 7.3). In the second experiment, the process was used to test 3 versions (financial, quality, regulatory) of text supporting tobacco cessation alerts as well as 3 supporting images. Based on 3 rounds of RCTs, there was no significant difference in acceptance rates based on the framing of the messages or addition of images. ConclusionsThese experiments support the potential for this new process to rapidly develop, deploy, and rigorously evaluate CDS within an EHR. We also identified important considerations in applying these methods. This approach may be an important tool for improving the impact of and experience with CDS. Trial RegistrationFlu alert trial: ClinicalTrials.gov NCT03415425; https://clinicaltrials.gov/ct2/show/NCT03415425. Tobacco alert trial: ClinicalTrials.gov NCT03714191; https://clinicaltrials.gov/ct2/show/NCT03714191

BackgroundDigital diabetes prevention programs (dDPPs) are effective behavior change tools to prevent disease progression in patients at risk for diabetes. At present, these programs are poorly integrated into existing health information technology infrastructure and clinical workflows, resulting in barriers to provider-level knowledge of, interaction with, and support of patients who use dDPPs. Tools that can facilitate patient-provider interaction around dDPPs may contribute to improved patient engagement and adherence to these programs and improved health outcomes. ObjectiveThis study aims to use a rigorous, user-centered design (UCD) methodology to develop a theory-driven system that supports patient engagement with dDPPs and their primary care providers with their care. MethodsThis study will be conducted in 3 phases. In phase 1, we will use systematic UCD, Agile software development, and qualitative research methods to identify key user (patients, providers, clinical staff, digital health technologists, and content experts) requirements, constraints, and prioritization of high-impact features to design, develop, and refine a viable intervention prototype for the engagement system. In phase 2, we will conduct a single-arm feasibility pilot of the engagement system among patients with prediabetes and their primary care providers. In phase 3, we will conduct a 2-arm randomized controlled trial using the engagement system. Primary outcomes will be weight, BMI, and A1c at 6 and 12 months. Secondary outcomes will be patient engagement (use and activity) in the dDPP. The mediator variables (self-efficacy, digital health literacy, and patient-provider relationship) will be measured. ResultsThe project was initiated in 2018 and funded in September 2019. Enrollment and data collection for phase 1 began in September 2019 under an Institutional Review Board quality improvement waiver granted in July 2019. As of December 2020, 27 patients have been enrolled and first results are expected to be submitted for publication in early 2021. The study received Institutional Review Board approval for phases 2 and 3 in December 2020, and phase 2 enrollment is expected to begin in early 2021. ConclusionsOur findings will provide guidance for the design and development of technology to integrate dDPP platforms into existing clinical workflows. This will facilitate patient engagement in digital behavior change interventions and provider engagement in patients’ use of dDPPs. Integrated clinical tools that can facilitate patient-provider interaction around dDPPs may contribute to improved patient adherence to these programs and improved health outcomes by addressing barriers faced by both patients and providers. Further evaluation with pilot testing and a clinical trial will assess the effectiveness and implementation of these tools. Trial RegistrationClinicalTrials.gov NCT04049500; https://clinicaltrials.gov/ct2/show/NCT04049500 International Registered Report Identifier (IRRID)DERR1-10.2196/26750

BackgroundThe transformation of health care during COVID-19, with the rapid expansion of telemedicine visits, presents new challenges to chronic care and preventive health providers. Clinical decision support (CDS) is critically important to chronic care providers, and CDS malfunction is common during times of change. It is essential to regularly reassess an organization's ambulatory CDS program to maintain care quality. This is especially true after an immense change, like the COVID-19 telemedicine expansion. ObjectiveOur objective is to reassess the ambulatory CDS program at a large academic medical center in light of telemedicine's expansion in response to the COVID-19 pandemic. MethodsOur clinical informatics team devised a practical framework for an intrapandemic ambulatory CDS assessment focused on the impact of the telemedicine expansion. This assessment began with a quantitative analysis comparing CDS alert performance in the context of in-person and telemedicine visits. Board-certified physician informaticists then completed a formal workflow review of alerts with inferior performance in telemedicine visits. Informaticists then reported on themes and optimization opportunities through the existing CDS governance structure. ResultsOur assessment revealed that 10 of our top 40 alerts by volume were not firing as expected in telemedicine visits. In 3 of the top 5 alerts, providers were significantly less likely to take action in telemedicine when compared to office visits. Cumulatively, alerts in telemedicine encounters had an action taken rate of 5.3% (3257/64,938) compared to 8.3% (19,427/233,636) for office visits. Observations from a clinical informaticist workflow review included the following: (1) Telemedicine visits have different workflows than office visits. Some alerts developed for the office were not appearing at the optimal time in the telemedicine workflow. (2) Missing clinical data is a common reason for the decreased alert firing seen in telemedicine visits. (3) Remote patient monitoring and patient-reported clinical data entered through the portal could replace data collection usually completed in the office by a medical assistant or registered nurse. ConclusionsIn a large academic medical center at the pandemic epicenter, an intrapandemic ambulatory CDS assessment revealed clinically significant CDS malfunctions that highlight the importance of reassessing ambulatory CDS performance after the telemedicine expansion.

BackgroundPatient-reported outcomes (PROs) are increasingly being used in the management of type 2 diabetes (T2D) to integrate data from patients’ perspective into clinical care. To date, the majority of PRO tools have lacked patient and provider involvement in their development, thus failing to meet the unique needs of end users, and lack the technical infrastructure to be integrated into the clinic workflow. ObjectiveThis study aims to apply a systematic, user-centered design approach to develop i-Matter (investigating a mobile health [mHealth] texting tool for embedding patient-reported data into diabetes management), a theory-driven, mobile PRO system for patients with T2D and their primary care providers. Methodsi-Matter combines text messaging with dynamic data visualizations that can be integrated into electronic health records (EHRs) and personalized patient reports. To build i-Matter, we conducted semistructured group and individual interviews with patients with T2D and providers, a design thinking workshop to refine initial ideas and design the prototype, and user testing sessions of prototypes using a rapid-cycle design (ie, design-test-modify-retest). ResultsUsing an iterative user-centered process resulted in the identification of 6 PRO messages that were relevant to patients and providers: medication adherence, dietary behaviors, physical activity, sleep quality, quality of life, and healthy living goals. In user testing, patients recommended improvements to the wording and timing of the PRO text messages to increase clarity and response rates. Patients also recommended including motivational text messages to help sustain engagement with the program. The personalized report was regarded as a key tool for diabetes self-management by patients and providers because it aided in the identification of longitudinal patterns in the PRO data, which increased patient awareness of their need to adopt healthier behaviors. Patients recommended adding individualized tips to the journal on how they can improve their behaviors. Providers preferred having a separate tab built into the EHR that included the personalized report and highlighted key trends in patients’ PRO data over the past 3 months. ConclusionsPRO tools that capture patients’ well-being and the behavioral aspects of T2D management are important to patients and providers. A clinical trial will test the efficacy of i-Matter in 282 patients with uncontrolled T2D. Trial RegistrationClinicalTrials.gov NCT03652389; https://clinicaltrials.gov/ct2/show/NCT03652389

BackgroundAlthough clinical decision support (CDS) alerts are effective reminders of best practices, their effectiveness is blunted by clinicians who fail to respond to an overabundance of inappropriate alerts. An electronic health record (EHR)–integrated machine learning (ML) algorithm is a potentially powerful tool to increase the signal-to-noise ratio of CDS alerts and positively impact the clinician’s interaction with these alerts in general. ObjectiveThis study aimed to describe the development and implementation of an ML-based signal-to-noise optimization system (SmartCDS) to increase the signal of alerts by decreasing the volume of low-value herpes zoster (shingles) vaccination alerts. MethodsWe built and deployed SmartCDS, which builds personalized user activity profiles to suppress shingles vaccination alerts unlikely to yield a clinician’s interaction. We extracted all records of shingles alerts from January 2017 to March 2019 from our EHR system, including 327,737 encounters, 780 providers, and 144,438 patients. ResultsDuring the 6 weeks of pilot deployment, the SmartCDS system suppressed an average of 43.67% (15,425/35,315) potential shingles alerts (appointments) and maintained stable counts of weekly shingles vaccination orders (326.3 with system active vs 331.3 in the control group; P=.38) and weekly user-alert interactions (1118.3 with system active vs 1166.3 in the control group; P=.20). ConclusionsAll key statistics remained stable while the system was turned on. Although the results are promising, the characteristics of the system can be subject to future data shifts, which require automated logging and monitoring. We demonstrated that an automated, ML-based method and data architecture to suppress alerts are feasible without detriment to overall order rates. This work is the first alert suppression ML-based model deployed in practice and serves as foundational work in encounter-level customization of alert display to maximize effectiveness.

BackgroundDue to the adoption of electronic health records (EHRs) and legislation on meaningful use in recent decades, health systems are increasingly interdependent on EHR capabilities, offerings, and innovations to better capture patient data. A novel capability offered by health systems encompasses the integration between EHRs and wearable health technology. Although wearables have the potential to transform patient care, issues such as concerns with patient privacy, system interoperability, and patient data overload pose a challenge to the adoption of wearables by providers. ObjectiveThis study aimed to review the landscape of wearable health technology and data integration to provider EHRs, specifically Epic, because of its prevalence among health systems. The objectives of the study were to (1) identify the current innovations and new directions in the field across start-ups, health systems, and insurance companies and (2) understand the associated challenges to inform future wearable health technology projects at other health organizations. MethodsWe used a scoping process to survey existing efforts through Epic’s Web-based hub and discussion forum, UserWeb, and on the general Web, PubMed, and Google Scholar. We contacted Epic, because of their position as the largest commercial EHR system, for information on published client work in the integration of patient-collected data. Results from our searches had to meet criteria such as publication date and matching relevant search terms. ResultsNumerous health institutions have started to integrate device data into patient portals. We identified the following 10 start-up organizations that have developed, or are in the process of developing, technology to enhance wearable health technology and enable EHR integration for health systems: Overlap, Royal Philips, Vivify Health, Validic, Doximity Dialer, Xealth, Redox, Conversa, Human API, and Glooko. We reported sample start-up partnerships with a total of 16 health systems in addressing challenges of the meaningful use of device data and streamlining provider workflows. We also found 4 insurance companies that encourage the growth and uptake of wearables through health tracking and incentive programs: Oscar Health, United Healthcare, Humana, and John Hancock. ConclusionsThe future design and development of digital technology in this space will rely on continued analysis of best practices, pain points, and potential solutions to mitigate existing challenges. Although this study does not provide a full comprehensive catalog of all wearable health technology initiatives, it is representative of trends and implications for the integration of patient data into the EHR. Our work serves as an initial foundation to provide resources on implementation and workflows around wearable health technology for organizations across the health care industry.

BackgroundEvidence-based solutions for changing health behaviors exist but problems with feasibility, sustainability, and dissemination limit their impact on population-based behavior change and maintenance. ObjectiveOur goal was to overcome the limitations of an established behavior change program by using the inherent capabilities of smartphones and wireless sensors to develop a next generation mobile health (mHealth) intervention that has the potential to be more feasible. MethodsIn response to the clinical need and the growing capabilities of smartphones, our study team decided to develop a behavioral hypertension reduction mHealth system inspired by Dietary Approaches to Stop Hypertension (DASH), a lifestyle modification program. We outline the key design and development decisions that molded the project including decisions about behavior change best practices, coaching features, platform, multimedia content, wireless devices, data security, integration of systems, rapid prototyping, usability, funding mechanisms, and how all of these issues intersect with clinical research and behavioral trials. ResultsOver the 12 months, our study team faced many challenges to developing our prototype intervention. We describe 10 lessons learned that will ultimately stimulate more effective and sustainable approaches. ConclusionsThe experiences presented in this case study can be used as a reference for others developing mHealth behavioral intervention development projects by highlighting the benefits and challenges facing mHealth research.

INTRODUCTION: Emergency departments (ED) care for societys most vulnerable older adults who present with exacerbations of chronic disease at the end of life, yet the clinical paradigm focuses on treatment of acute pathologies. Palliative care interventions in the ED capture high-risk patients at a time of crisis and can dramatically improve patient-centred outcomes. This study aims to implement and evaluate Primary Palliative Care for Emergency Medicine (PRIM-ER) on ED disposition, healthcare utilisation and survival in older adults with serious illness. METHODS AND ANALYSIS: This is the protocol for a pragmatic, cluster-randomised stepped wedge trial to test the effectiveness of PRIM-ER in 35 EDs across the USA. The intervention includes four core components: (1) evidence-based, multidisciplinary primary palliative care education; (2) simulation-based workshops; (3) clinical decision support; and (4) audit and feedback. The study is divided into two phases: a pilot phase, to ensure feasibility in two sites, and an implementation and evaluation phase, where we implement the intervention and test the effectiveness in 33 EDs over 2 years. Using Centers for Medicare and Medicaid Services (CMS) data, we will assess the primary outcomes in approximately 300 000 patients: ED disposition to an acute care setting, healthcare utilisation in the 6 months following the ED visit and survival following the index ED visit. Analysis will also determine the site, provider and patient-level characteristics that are associated with variation in impact of PRIM-ER. ETHICS AND DISSEMINATION: Institutional Review Board approval was obtained at New York University School of Medicine to evaluate the CMS data. Oversight will also be provided by the National Institutes of Health, an Independent Monitoring Committee and a Clinical Informatics Advisory Board. Trial results will be submitted for publication in a peer-reviewed journal. TRIAL REGISTRATION NUMBER: NCT03424109; Pre-results.

Background: Regular physical activity (PA) is a component of cardiovascular health and is associated with a lower risk of cardiovascular disease (CVD). However, only about half of US adults achieved the current PA recommendations. Objective: The study purpose was to implement PA counseling using a clinical decision support tool in a preventive cardiology clinic and to assess changes in CVD risk factors in a sample of patients enrolled over 12 weeks of PA monitoring. Methods: This intervention, piloted for 1 year, had 3 components embedded in the electronic health record: assessment of patients' PA, an electronic prompt for providers to counsel patients reporting low PA, and patient monitoring using a Fitbit. Cardiovascular disease risk factors included PA (self-report and Fitbit), body mass index, blood pressure, lipids, and cardiorespiratory fitness assessed with the 6-minute walk test. Depression and quality of life were also assessed. Paired t tests assessed changes in CVD risk. Results: The sample who enrolled in the remote patient monitoring (n = 59) were primarily female (51%), White adults (76%) with a mean age of 61.13 ± 11.6 years. Self-reported PA significantly improved over 12 weeks ( P = .005), but not Fitbit steps ( P = .07). There was a significant improvement in cardiorespiratory fitness (469 ± 108 vs 494 ± 132 m, P = .0034), and 23 participants (42%) improved at least 25 m, signifying a clinically meaningful improvement. Only 4 participants were lost to follow-up over 12 weeks of monitoring. Conclusions: Patients may need more frequent reminders to be active after an initial counseling session, perhaps getting automated messages based on their step counts syncing to their electronic health record. [ABSTRACT FROM AUTHOR]

The article discusses the concept of "virtual-first care" (V1C) and its impact on diagnostic reasoning in healthcare. V1C refers to the use of technology-enabled healthcare services, such as telehealth and remote patient monitoring, to provide care at a distance. While these technologies have been embraced, concerns have been raised about their potential negative effects on patient-clinician relationships, clinician burnout, and the digital divide. The article suggests that V1C tools should be designed to support clinicians' diagnostic reasoning processes and that medical training should incorporate exposure to these technologies. Additionally, further research is needed to understand the impact of V1C technologies on diagnostic reasoning and to develop strategies for mitigating cognitive errors and biases. [Extracted from the article]

Background: During the COVID-19 pandemic, acute respiratory infection (ARI) antibiotic prescribing in ambulatory care markedly decreased. It is unclear if antibiotic prescription rates will remain lowered. Methods: We used trend analyses of antibiotics prescribed during and after the first wave of COVID-19 to determine whether ARI antibiotic prescribing rates in ambulatory care have remained suppressed compared to pre-COVID-19 levels. Retrospective data was used from patients with ARI or UTI diagnosis code(s) for their encounter from 298 primary care and 66 urgent care practices within four academic health systems in New York, Wisconsin, and Utah between January 2017 and June 2022. The primary measures included antibiotic prescriptions per 100 non-COVID ARI encounters, encounter volume, prescribing trends, and change from expected trend. Results: At baseline, during and after the first wave, the overall ARI antibiotic prescribing rates were 54.7, 38.5, and 54.7 prescriptions per 100 encounters, respectively. ARI antibiotic prescription rates saw a statistically significant decline after COVID-19 onset (step change -15.2, 95% CI: -19.6 to -4.8). During the first wave, encounter volume decreased 29.4% and, after the first wave, remained decreased by 188%. After the first wave, ARI antibiotic prescription rates were no longer significantly suppressed from baseline (step change 0.01, 95% CI: -6.3 to 6.2). There was no significant difference between UTI antibiotic prescription rates at baseline versus the end of the observation period. Conclusions: The decline in ARI antibiotic prescribing observed after the onset of COVID-19 was temporary, not mirrored in UTI antibiotic prescribing, and does not represent a long-term change in clinician prescribing behaviors. During a period of heightened awareness of a viral cause of ARI, a substantial and clinically meaningful decrease in clinician antibiotic prescribing was observed. Future efforts in antibiotic stewardship may benefit from continued study of factors leading to this reduction and rebound in prescribing rates. [ABSTRACT FROM AUTHOR]

This study introduces a Generative Artificial Intelligence (GenAI) assistant designed to address key challenges in Remote Patient Monitoring (RPM) for hypertension. After a comprehensive needs assessment from clinicians and patients, we identified pivotal issues in RPM data management and patient engagement. The GenAI RPM assistant integrates a patient-facing chatbot, clinician-facing smart summaries, and automated draft portal messages to enhance communication and streamline data review. Validated through six rounds of testing and evaluations by ten participants, the initial prototype was positively received, highlighting the importance of personalized interactions. Our findings demonstrate GenAI's potential to improve RPM by optimizing data management and enhancing patient-provider communication. [ABSTRACT FROM AUTHOR]

Abstract Background Clinical prediction rules (CPRs) represent well-validated but underutilized evidence-based medicine tools at the point-of-care. To date, an inability to integrate these rules into an electronic health record (EHR) has been a major limitation and we are not aware of a study demonstrating the use of CPR's in an ambulatory EHR setting. The integrated clinical prediction rule (iCPR) trial integrates two CPR's in an EHR and assesses both the usability and the effect on evidence-based practice in the primary care setting. Methods A multi-disciplinary design team was assembled to develop a prototype iCPR for validated streptococcal pharyngitis and bacterial pneumonia CPRs. The iCPR tool was built as an active Clinical Decision Support (CDS) tool that can be triggered by user action during typical workflow. Using the EHR CDS toolkit, the iCPR risk score calculator was linked to tailored ordered sets, documentation, and patient instructions. The team subsequently conducted two levels of 'real world' usability testing with eight providers per group. Usability data were used to refine and create a production tool. Participating primary care providers (n = 149) were randomized and intervention providers were trained in the use of the new iCPR tool. Rates of iCPR tool triggering in the intervention and control (simulated) groups are monitored and subsequent use of the various components of the iCPR tool among intervention encounters is also tracked. The primary outcome is the difference in antibiotic prescribing rates (strep and pneumonia iCPR's encounters) and chest x-rays (pneumonia iCPR only) between intervention and control providers. Discussion Using iterative usability testing and development paired with provider training, the iCPR CDS tool leverages user-centered design principles to overcome pervasive underutilization of EBM and support evidence-based practice at the point-of-care. The ongoing trial will determine if this collaborative process will lead to higher rates of utilization and EBM guided use of antibiotics and chest x-ray's in primary care. Trial Registration ClinicalTrials.gov Identifier NCT01386047