Search

Background Audit and feedback (A&F) has been used as a strategy to modify clinician behavior with moderate success. Although A&F is theorized to work by improving the accuracy of clinicians’ estimates of their own behavior, few interventions have included assessment of clinicians’ estimates at baseline to examine whether they account for intervention success or failure. We tested an A&F intervention to reduce computed tomography (CT) ordering by emergency physicians, while also examining the physicians’ baseline estimates of their own behavior compared to peers. Methods Our study was a prospective, multi-site, 20-month, randomized trial to examine the effect of an A&F intervention on CT ordering rates, overall and by test subtype. From the electronic health record, we obtained 12 months of baseline CT ordering per 100 patients treated for every physician from four emergency departments. Those who were randomized to receive A&F were shown a de-identified graph of the group’s baseline CT utilization, asked to estimate wherein the distribution of their own CT order practices fell, and then shown their actual performance. All participants also received a brief educational intervention. CT ordering rates were collected for all physicians for 6 months after the intervention. Pre-post ordering rates were compared using independent and repeated measures t tests. Results Fifty-one of 52 eligible physicians participated. The mean CT ordering rate increased significantly in both experimental conditions after the intervention (intervention pre = 35.7, post = 40.3, t = 4.13, p < 0.001; control pre = 33.9, post = 38.9, t = 3.94, p = 0.001), with no significant between-group difference observed at follow-up (t = 0.43, p = 0.67). Within the intervention group, physicians had poor accuracy in estimating their own ordering behavior at baseline: most overestimated and all guessed that they were in the upper half of the distribution of their peers. CT ordering increased regardless of self-estimate accuracy. Conclusions Our A&F intervention failed to reduce physician CT ordering: our feedback to the physicians showed most of them that they had overestimated their CT ordering behavior, and they were therefore unlikely to reduce it as a result. After “audit,” it may be prudent to assess baseline clinician awareness of behavior before moving toward a feedback intervention.

Key Points Question Are drug-funding reimbursement decisions associated with uptake of new therapies and survival outcomes for patients with advanced pancreatic cancer? Findings In this population-based cohort study of 5465 patients with advanced pancreatic cancer receiving first-line chemotherapy within a universal health care system, reimbursement decisions were associated with uptake of new treatment options over time. Uptake of both FOLFIRINOX and gemcitabine combined with nab-paclitaxel were associated with improvements in survival for patients with pancreatic cancer. Meaning These findings suggest that drug-funding reimbursement decisions are associated with uptake of new cancer therapies and improvements in survival for patients with advanced pancreatic cancer., This cohort study investigates whether there is an association of sequential drug-funding approvals and overall survival of patients with advanced pancreatic cancer., Importance Gemcitabine-nab-paclitaxel (GEMNAB) and fluorouracil, leucovorin, irinotecan, and oxaliplatin (FOLFIRINOX) both improve survival of patients with advanced pancreatic cancer when compared with single-agent gemcitabine in clinical trials. Objective To describe changes in the survival of patients with advanced pancreatic cancer associated with sequential drug-funding approvals and to determine if there exist distinct patient populations for whom GEMNAB and FOLFIRINOX are associated with survival benefit. Design, Setting, and Participants This population-based, retrospective cohort study examined all incident cases of advanced pancreatic cancer treated with first-line chemotherapy in Ontario, Canada (2008-2018) that were identified from the Cancer Care Ontario (Ontario Health) New Drug Funding Program database. Statistical analysis was performed from October 2020 to January 2021. Exposures First-line chemotherapy for advanced pancreatic cancer. Main Outcomes and Measures The main outcomes were the proportion of patients treated with each chemotherapy regimen over time and overall survival for each regimen. Cox proportional hazards regression models were used to compare overall survival between treatment regimens after adjustment for confounding variables, inverse probability of treatment weighting, and matching. Results From 2008 to 2018, 5465 patients with advanced pancreatic cancer were treated with first-line chemotherapy in Ontario, Canada. The median (range) age of patients was 66.9 (27.8-93.4) years; 2447 (45%) were female; 878 (16%) had prior pancreatic resection, and 328 (6%) had prior adjuvant gemcitabine. During the time period when only gemcitabine and FOLFIRINOX were funded (2011-2015), 49% (929 of 1887) received FOLFIRINOX. When GEMNAB was subsequently funded (2015-2018), 9% (206 of 2347) received gemcitabine, 44% (1034 of 2347) received FOLFIRINOX, and 47% (1107 of 2347) received GEMNAB. The median overall survival increased from 5.6 months (95% CI, 5.1-6.0 months) in 2008 to 2011 to 6.9 months (95% CI, 6.5-7.4 months) in 2011 to 2015 to 7.6 months (95% CI, 7.1-8.0 months) in 2015 to 2018. Patients receiving FOLFIRINOX were younger and healthier than patients receiving GEMNAB. After adjustment and weighting, FOLFIRINOX was associated with better overall survival than GEMNAB (hazard ratio [HR], 0.75 [95% CI, 0.69-0.81]). In analyses comparing patients treated with GEMNAB and gemcitabine, GEMNAB was associated with better overall survival (HR, 0.86 [95% CI, 0.78-0.94]). Conclusions and Relevance This cohort study of patients with advanced pancreatic cancer receiving first-line palliative chemotherapy within a universal health care system found that drug funding decisions were associated with increased uptake of new treatment options over time and improved survival. Both FOLFIRINOX and GEMNAB were associated with survival benefits in distinct patient populations.