Search

Introduction Digitalizing workplace-based assessments (WBA) holds the potential for facilitating feedback and performance review, wherein we can easily record, store, and analyze data in real time. When digitizing assessment systems, however, it is unclear what is gained and lost in the message as a result of the change in medium. This study evaluates the quality of comments generated in paper vs. electronic media and the influence of an assessor's seniority. Methods Using a realist evaluation framework, a retrospective database review was conducted with paper-based and electronic medium comments. A sample of assessments was examined to determine any influence of the medium on the word count and the Quality of Assessment for Learning (QuAL) score. A correlation analysis evaluated the relationship between word count and QuAL score. Separate univariate analyses of variance (ANOVAs) were used to examine the influence of the assessor's seniority and medium on word count, QuAL score, and WBA scores. Results The analysis included a total of 1,825 records. The average word count for the electronic comments (M=16) was significantly higher than the paper version (M=12; p=0.01). Longer comments positively correlated with QuAL score (r=0.2). Paper-based comments received lower QuAL scores (0.41) compared to electronic (0.51; p<0.01). Years in practice was negatively correlated with QuAL score (r=-0.08; p<0.001) as was word count (r=-0.2; p<0.001). Conclusion Digitization of WBAs increased the length of comments and did not appear to jeopardize the quality of WBAs; these results indicate higher-quality assessment data. True digital transformation may be possible by harnessing trainee data repositories and repurposing them to analyze for faculty-relevant metrics., Competing Interests: The authors have declared financial relationships, which are detailed in the next section., (Copyright © 2022, Chan et al.)

Introduction One purpose of the hands-only cardiopulmonary resuscitation (HOCPR) program is to simplify CPR instruction to encourage more bystanders to take action during cardiac arrest. Although the program has been successfully implemented in traditional classroom settings, the utility of large-scale training events has not been well-explored. We hypothesized that CPR knowledge and comfort levels would increase through a large-scale, multi-community HOCPR training event. We also explored what effect this training event had on perceived barriers to bystander-performed CPR. Methods A convenience sample participated in HOCPR training on a single day across 10 Texas cities. A sub-sample completed training questionnaires, including a five-item CPR pre- and post-test. A follow-up questionnaire was conducted two years after the event. The primary outcome of interest was the difference in cardiopulmonary resuscitation (CPR) knowledge and comfort level between pre- and post-event questionnaires. Demographic contributions were also assessed. Results A total of 4,253 participants were trained, 1,416 were enrolled upon submitting matching pre- and post-event questionnaires, and 101 (14%) submitted follow-up questionnaires. Mean knowledge scores increased from pre-training (2.7 ± 1.6 standard deviation (SD)) to post-training (4.7 ± 0.76 SD) (p < 0.001). Follow-up test scores (3.8 ± 1.1 SD) remained higher than pre-test scores (p < 0.001). Comfort with HOCPR increased from 59% (95% confidence interval (CI) 56 - 61) to 96% (95% CI 95 - 97). Pre- and post-knowledge scores differed significantly by education level (p < 0.001), ethnicity (p < 0.001), and income (p < 0.001). Education contributed significantly to comfort at both pre- (p = 0.015) and post-training (p = 0.026), but ethnicity and income did not. Before training, the most common barrier to performing CPR was lack of knowledge 59% (95% CI 55 - 62); after training, the most common barrier was fear of causing harm 34% (95% CI 29 - 40). Conclusions This study demonstrated that medical students were successfully able to conduct large-scale HOCPR training that improved CPR knowledge and comfort levels among participants across multiple metropolitan areas. Knowledge retention remained higher at two-years for participants of a follow-up questionnaire. Medical students can use the experiences from this training event as a template to organize similar large-scale training events in the future., Competing Interests: The authors have declared that no competing interests exist., (Copyright © 2020, Anderson et al.)