Search

Background The Alberta Health Services' Provincial Simulation Program (eSIM) is Canada's largest simulation program. The eSIM mobile simulation program specializes in delivering simulation-based education (SBE) to rural and remote communities (RRC). During the COVID-19 pandemic, a quality improvement project involving rapid cycle in situ virtually facilitated simulation (VFS) for COVID-19 airway management and health systems preparedness in RRC was successfully implemented. Methods Between April 24 and July 31, 2020, a team of six rural simulationists (four nurses and two physicians) provided 24 VFS sessions with virtual debriefing to 200 health care providers distributed across 11 RRC in Alberta and the Northwest Territories, covering a geographic area of approximately 169,028 km2. Results Video analysis of sequential VFS rapid cycle sessions using a standardized observational tool indicated decreased personal protective equipment (PPE) breaches by 36.6% between the first and third cycles. Teams demonstrated increased competency with airway management such as correct use of bag-valve-mask ventilation, and implementation of health system process improvements, such as incorporation of an intubation checklist. Improvements occurred on average over 2.2 rapid cycles completed within 1.3 weeks per RRC. Postsession self-reported participant electronic surveys indicated self-reported improvement in clinical management, teamwork behavior, and health systems issues outcome measures which were categorized based on the Crisis Resource Management and Systems Engineering Initiative for Patient Safety (SEIPS) frameworks. Of the 48 survey respondents, 86.1% reported that VFS was equivalent or superior to in-person simulation. The cost of VFS was 62.9% lower than comparable in-person SBE. Conclusion VFS provides a rapidly mobilizable and cost-effective way of delivering high-quality SBE to geographically isolated communities.

The COVID-19 pandemic motivated simulation educators to attempt various forms of distance simulation in order to maintain physical distancing and to rapidly deliver training and ensure systems preparedness. However, the perceived psychological safety in distance simulation remains largely unknown. A psychologically unsafe environment can negatively impact team dynamics and learning outcomes; therefore, it merits careful consideration with the adoption of any new learning modality. Between October 2020 and April 2021, 11 rural and remote hospitals in Alberta, Canada, were enrolled by convenience sampling in in-person-facilitated simulation (IPFS) (n = 82 participants) or remotely facilitated simulation (RFS) (n = 66 participants). Each interprofessional team was invited to attend two COVID-19-protected intubation simulation sessions. An There was no statistically significant difference between RFS and IPFS total scores on the Psychological safety can be established and maintained with RFS. Furthermore, in this study, RFS was shown to be comparable to IPFS in improving psychological safety among rural and remote interdisciplinary teams, providing simulation educators another modality for reaching any site or team.

Many simulation programs have recently shifted towards providing remote simulations with virtual debriefings. Virtual debriefings involve educators facilitating conversations through web-based videoconferencing platforms. Facilitating debriefings through a computer interface introduces a unique set of challenges. Educators require practical guidance to support meaningful virtual learning in the transition from in-person to virtual debriefings. The communities of inquiry conceptual framework offer a useful structure to organize practical guidance for conducting virtual debriefings. The communities of inquiry framework describe the three key elements—social presence, teaching presence, and cognitive presence—all of which contribute to the overall learning experience. In this paper, we (1) define the CoI framework and describe its three core elements, (2) highlight how virtual debriefings align with CoI, (3) anticipate barriers to effective virtual debriefings, and (4) share practical strategies to overcome these hurdles.

Introduction Use of frameworks for simulation debriefing represents best practice, although available frameworks provide only general guidance. Debriefers may experience difficulties implementing broad recommendations, especially in challenging debriefing situations that require more specific strategies. This study describes how debriefers approach challenges in postsimulation debriefing. Methods Ten experienced simulation educators participated in 3 simulated debriefings. Think-aloud interviews before and after the simulations were used to explore roles that debriefers adopted and the associated strategies they used to achieve specific goals. All data were audio recorded and transcribed, and a constructivist grounded theory approach was used for analysis. Results 4 roles in debriefing were identified: guiding, (inter)mediating, facilitating integration, and teaching. Each role was associated with specific goals and strategies that were adopted to achieve these goals. The goal of creating and maintaining a psychologically safe learning environment was common across all roles. These findings were conceptualized as the GIFT debriefing framework. Conclusions Our findings highlight the multiple roles debriefers play and how these roles are enacted in postsimulation debriefing. These results may inform future professional development and mentorship programs for debriefing in both simulation-based education and healthcare settings.

Objectives A large proportion of all emergency visits for paediatric patients across Canada are to general emergency departments (EDs). These centres may not be adequately equipped to provide optimal care for high acuity paediatric emergencies. The objective of this study was to determine paediatric readiness for general EDs and urgent care centres (UCCs) across Alberta and provide each centre with an overall weighted Paediatric Readiness Score (WPRS). Methods A paediatric readiness assessment consisting of 55-questions normalized on a 100-point scale was used to survey 107 general EDs, UCCs, and tertiary paediatric EDs in Alberta, Canada. It addresses six primary categories, including Coordination of Patient Care, Physician/Nurse Staffing and Training, Quality Improvement Activities, Patient Safety Initiatives, Policies and Procedures, and Equipment and Supplies. Descriptive statistics were used to present the WPRS score among different groups. Linear regression models were used to explore factors associated with the score. Results The overall response rate was 59.8%. The median overall WPRS (/100) for all general EDs and UCCs was 48.4 ([interquartile range {IQR}] 17.6). Factors that were correlated with overall score included high paediatric patient volume (24.28, 95% confidence interval [CI]: 10.52 to 38.04) and involvement in a simulation education outreach program (9.38, 95% CI: 1.11 to 17.66). Conclusion Based on this survey, the WPRS of EDs and UCCs across Alberta suggest a need to improve readiness to respond to high acuity paediatric emergencies in these settings.

Debriefings should promote reflection and help learners make sense of events. Threats to psychological safety can undermine reflective learning conversations and may inhibit transfer of key lessons from simulated cases to the general patient care context. Therefore, effective debriefings require high degrees of psychological safety—the perception that it is safe to take interpersonal risks and that one will not be embarrassed, rejected or otherwise punished for speaking their mind, not knowing or asking questions. The role of introductions, learning contracts and prebriefing in establishing psychological safety is well described in the literature. How to maintain psychological safety, while also being able to identify and restore psychological safety during debriefings, is less well understood. This review has several aims. First, we provide a detailed definition of psychological safety and justify its importance for debriefings. Second, we recommend specific strategies debriefers can use throughout the debriefing to build and maintain psychological safety. We base these recommendations on a literature review and on our own experiences as simulation educators. Third, we examine how debriefers might actively address perceived breaches to restore psychological safety. Re-establishing psychological safety after temporary threats or breaches can seem particularly daunting. To demystify this process, we invoke the metaphor of a ‘safe container’ for learning; a space where learners can feel secure enough to work at the edge of expertise without threat of humiliation. We conclude with a discussion of limitations and implications, particularly with respect to faculty development.

CONTEXT Conflict during simulation debriefing can interfere with learning when psychological safety is threatened. Debriefers often feel unprepared to address conflict between learners and the literature does not provide evidence-based guidance within the simulation setting. The purpose of this study was to describe debriefers' approach to mediating interpersonal conflict and explore when, why and how they adopt mediation strategies. METHODS We performed a secondary analysis of qualitative data collected as part of a larger study examining simulation debriefers' approaches to debriefing scenarios with different learner characteristics. For this study, we applied thematic analysis to transcripts from simulated debriefings (n = 10) and the associated pre-simulation (n = 11) and post-simulation (n = 10) interviews that focused on interpersonal conflict between learners. RESULTS Debriefers described struggling with mediating conflict and the importance of self-awareness. Specific mediation strategies included intervening, addressing power relations, reconciling unproductive differences, leveraging different perspectives, circumventing the conflict, and shifting beyond the conflict; each of these strategies encompassed a number of particular skills. Situations that triggered a mediation approach were related to psychological safety, emotional intensity, and opportunities for shared understanding and productive learning. Debriefers applied mediation strategies and skills in a flexible and creative way. CONCLUSIONS The strategies we have described for mediating interpersonal conflict between learners in simulation debriefing align with notions of psychological safety and may be useful in guiding future professional development for simulation educators.

The healthcare simulation field has no shortage of debriefing options. Some demand considerable skill which serves as a barrier to more widespread implementation. The plus-delta approach to debriefing offers the advantages of conceptual simplicity and ease of implementation. Importantly, plus-delta promotes learners’ capacity for a self-assessment, a skill vital for safe clinical practice and yet a notorious deficiency in professional practice. The plus-delta approach confers the benefits of promoting uptake of debriefing in time-limited settings by educators with both fundamental but also advanced skills, and enhancing essential capacity for critical self-assessment informed by objective performance feedback. In this paper, we describe the role of plus-delta in debriefing, provide guidance for incorporating informed learner self-assessment into debriefings, and highlight four opportunities for improving the art of the plus delta: (a) exploring the big picture vs. specific performance issues, (b) choosing between single vs. double-barreled questions, (c) unpacking positive performance, and (d) managing perception mismatches.

Healthcare organizations strive to deliver safe, high-quality, efficient care. These complex systems frequently harbor gaps, which if unmitigated, could result in harm. Systems-focused simulation (SFS) projects, which include systems-focused debriefing (SFD), if well designed and executed, can proactively and comprehensively identify gaps and test and improve systems, enabling institutions to improve safety and quality before patients and staff are placed at risk.The previously published systems-focused debriefing framework, Promoting Excellence and Reflective Learning in Simulation (PEARLS) for Systems Integration (PSI), describes a systematic approach to SFD. It includes an essential “pre-work” phase, encompassing evidence-informed steps that lead up to a SFD. Despite inclusion in the PSI framework, a detailed description of the pre-work phase, and how each component facilitates change management, was limited.The goal of this paper is to elucidate the PSI “Pre-work” phase, everything leading up to the systems-focused simulation and debriefing. It describes how the integration of project and change management principles ensures that a comprehensive collection of safety and quality issues are reliably identified and captured.

Healthcare resources have been strained to previously unforeseeable limits as a result of the COVID-19 pandemic of 2020. This has prompted the emergence of critical just-in-time COVID-19 education, including rapid simulation preparedness, evaluation and training across all healthcare sectors. Simulation has been proven to be pivotal for both healthcare provider learning and systems integration in the context of testing and integrating new processes, workflows, and rapid changes to practice (e.g., new cognitive aids, checklists, protocols) and changes to the delivery of clinical care. The individual, team, and systems learnings generated from proactive simulation training is occurring at unprecedented volume and speed in our healthcare system. Establishing a clear process to collect and report simulation outcomes has never been more important for staff and patient safety to reduce preventable harm. Our provincial simulation program in the province of Alberta, Canada (population = 4.37 million; geographic area = 661,848 km2), has rapidly responded to this need by leading the intake, design, development, planning, and co-facilitation of over 400 acute care simulations across our province in both urban and rural Emergency Departments, Intensive Care Units, Operating Rooms, Labor and Delivery Units, Urgent Care Centers, Diagnostic Imaging and In-patient Units over a 5-week period to an estimated 30,000 learners of real frontline team members. Unfortunately, the speed at which the COVID-19 pandemic has emerged in Canada may prevent healthcare sectors in both urban and rural settings to have an opportunity for healthcare teams to participate in just-in-time in situ simulation-based learning prior to a potential surge of COVID-19 patients. Our coordinated approach and infrastructure have enabled organizational learnings and the ability to theme and categorize a mass volume of simulation outcome data, primarily from acute care settings to help all sectors further anticipate and plan. The goal of this paper is to share the unique features and advantages of using a centralized provincial simulation response team, preparedness using learning and systems integration methods, and to share the highest risk and highest frequency outcomes from analyzing a mass volume of COVID-19 simulation data across the largest health authority in Canada.

Guideline compliant CPR is associated with improved survival for patients with cardiac arrest. Conventional Basic Life Support (BLS) training results in suboptimal CPR competency and skill retention. We aimed to compare the effectiveness of distributed CPR training with real-time feedback to conventional BLS training for CPR skills in pediatric healthcare providers.Healthcare providers were randomized into receiving annual BLS training (control) or distributed training with real-time feedback (intervention). The intervention group was asked to practice CPR for 2 min on mannequins while receiving real-time CPR feedback, at least once per month. Control group participants were not asked to practice CPR during the study period. Excellent CPR was defined as 90% guideline-compliance for depth, rate and recoil of chest compressions. CPR performance of participants was assessed (on infant and adult-sized mannequins) every 3 months for a duration of 12 months. CPR performance was compared between the 2 groups.A total of 87 healthcare providers were included in the analyses (control n = 41, intervention n = 46). Baseline assessment showed no significant difference in CPR performance across the 2 groups. The intervention group has a significantly greater proportion of participants with excellent CPR compared with the control group on an adult sized mannequin (14.6% vs. 54.3%, p 0.001) and infant-sized mannequin (19.5% vs. 71.7%, p 0.001) at the end of the study. In the intervention group, all CPR metrics except infant depth were improved and retained over the course of the study.Distributed CPR training with real-time feedback improves the compliance of AHA guidelines of quality of CPR.

Professional development opportunities are not readily accessible for most simulation educators, who may only connect with simulation experts at periodic and costly conferences. Virtual communities of practice consist of individuals with a shared passion who communicate via virtual media to advance their own learning and that of others. A nascent virtual community of practice is developing online for healthcare simulation on social media platforms. Simulation educators should consider engaging on these platforms for their own benefit and to help develop healthcare simulation educators around the world. Herein, we describe this developing virtual community of practice and offer guidance to assist educators to engage, learn, and contribute to the growth of the community.

Pediatric patients with trauma pose unique challenges, both practical and cognitive, to front-line care providers. The combination of anatomic, physiologic, and metabolic factors leads to unique injury patterns with different approaches and responses to treatment compared with adults. A similar traumatic mechanism can lead to slightly different internal injuries with unique management and treatment strategies between the two groups. This article is intended for community, nonpediatric trauma centers, and emergency physicians who are frequently required to assess, resuscitate, and stabilize injured children before they can be safely transferred to a pediatric trauma center for ongoing definitive care and rehabilitation.

Formal faculty development programs for simulation educators are costly and time-consuming. Peer coaching integrated into the teaching flow can enhance an educator's debriefing skills. We provide a practical guide for the who, what, when, where, why, and how of peer coaching for debriefing in simulation-based education. Peer coaching offers advantages such as psychological safety and team building, and it can benefit both the educator who is receiving feedback and the coach who is providing it. A feedback form for effective peer coaching includes the following: (1) psychological safety, (2) framework, (3) method/strategy, (4) content, (5) learner centeredness, (6) co-facilitation, (7) time management, (8) difficult situations, (9) debriefing adjuncts, and (10) individual style and experience. Institutional backing of peer coaching programs can facilitate implementation and sustainability. Program leaders should communicate the need and benefits, establish program goals, and provide assessment tools, training, structure, and evaluation to optimize chances of success.

Although not generally seen to be as exciting as the acquisition of simulation space, mannequins and task trainers, the provision of dedicated funding, the excitement of a new course launch, or acceptance of a research publication, the mindful and informed development of a day-to-day operational plan for a simulation center/program is the most important key to a successful, well-functioning, and sustainable entity. It is essential that any or all of the operational details discussed in this chapter are planned in concert with the occurrence of any of the events identified above. Short-term success is established by achieving one of those important milestones. Long-term and enduring success is incumbent upon the successful functioning of these interconnected events over time, and in the careful development of the rules of engagement by which the space, equipment, resources, courses and curricula, etc. will be operationalized. New programs and centers are strongly encouraged to think about these issues, and seek guidance from established programs and the published literature. Simulation center/program accreditation guidelines are also an excellent way to map the operational requirements and expectations for a simulation program, and will ensure that all essential areas are covered. Experienced simulation leaders would strongly advise that these various issues are considered early on in the development of a simulation program.

Modern healthcare organizations strive for continuous improvement in systems and processes to ensure safe, effective, and cost-conscious patient care. However, systems failures and inefficiencies lurk in every organization, often emerging only after patients have experienced harm or delays. Simulation and debriefing, focused on identifying systems gaps, can proactively lead to improvements in safety and quality. Systems-focused debriefing requires a different approach than traditional, learner-focused debriefing. We describe PEARLS for Systems Integration, a conceptual framework, debriefing structure and script that facilitators can use for systems-focused debriefing. The framework builds on Promoting Excellence And Reflective Learning in Simulation, using common debriefing strategies (plus/delta, focused facilitation, and directive feedback) in a modified format, with new debriefing scripts. Promoting Excellence And Reflective Learning in Simulation for System Integration offers a structured framework, adaptable for debriefing systems-focused simulations, to identify systems issues and maximize improvements in patient safety and quality.

Simulation-based education often relies on confederates, who provide information or perform clinical tasks during simulation scenarios, to play roles. Although there is experience with confederates in their more routine performance within educational programs, there is little literature on the training of confederates in the context of simulation-based research. The CPR CARES multicenter research study design included 2 confederate roles, in which confederates' behavior was tightly scripted to avoid confounding primary outcome measures. In this report, we describe our training process, our method of adherence assessment, and suggest next steps regarding confederate training scholarship.

The Promoting Excellence and Reflective Learning in Simulation (PEARLS) blended approach to debriefing encourages educators to purposefully merge various debriefing strategies to tailor discussion to learner needs and learning context. While debriefing is a key component to simulation-based education, few resources exist to promote implementation of specific debriefing approaches. In response to growing demands from simulation programs and facilitators wishing to teach the PEARLS approach to debriefing, we offer a collection of resources to serve as a faculty development guide for implementation of PEARLS. In this article, we discuss common pitfalls and associated solutions when using PEARLS to facilitate debriefings and offer a PEARLS debriefing checklist that can serve as a tool for providing peer feedback on debriefing performance.

The pediatric emergency medicine (PEM) environment is well suited for simulation-based activities, be they educational interventions for PEM learners, evaluations of the interface between health providers and the environment that they work in, or research investigations using simulation as a tool to answer specific clinical questions. As such, PEM has been among the leaders in the integration of this modality for clinical training. Traditionally, simulation has been used extensively for the dissemination of clinical training in the areas of clinical knowledge and its application, and the clinical, technical, and teamwork skills involved in PEM care. Increasingly, simulation is being used in novel applications, including breaking bad news, disclosure of error, family-centered care, quality and patient safety education, and system-level integration. The future will look to further identify, measure, and inform the integration of simulation with new and innovative adjuncts in the clinical environment, as well as to determine the optimal timing and use of simulation-based education to enhance the quality of care delivered to patients by the interprofessional and multidisciplinary team.

Simulation-based education (SBE) has emerged as an essential modality for health professions education. One of the central tenants of effective SBE is reflective practice, typically guided by a facilitated debriefing. The debriefing conversation has the possibility of becoming a difficult conversation based on learner and situation-related factors. Difficult debriefing situations may threaten the learning environment, thus requiring an appreciation and understanding of the various ways that learners may react adversely to simulation and debriefing.This article provides a review of the various phenotypes of difficult debriefing situations and a toolbox of proactive and reactive strategies to help guide the simulation educator to manage these situations, with the ultimate goal of achieving learning objectives.

The variability in quality of CPR provided during cardiac arrest across pediatric institutions is unknown. We aimed to describe the degree of variability in the quality of CPR across 9 pediatric institutions, and determine if variability across sites would be affected by Just-in-Time CPR training and/or visual feedback during simulated cardiac arrest.We conducted secondary analyses of data collected from a prospective, multi-center trial. Participants were equally randomized to either: (1) No intervention; (2) Real-time CPR visual feedback during cardiac arrest or (3) Just-in-Time CPR training. We report the variability in median chest compression depth and rate across institutions, and the variability in the proportion of 30-s epochs of CPR meeting 2010 American Heart Association guidelines for depth and rate.We analyzed data from 528 epochs in the no intervention group, 552 epochs in the visual feedback group, and 525 epochs in the JIT training group. In the no intervention group, compression depth (median range 22.2-39.2mm) and rate (median range 116.0-147.6 min(-1)) demonstrated significant variability between study sites (p0.001). The proportion of compressions with adequate depth (0-11.5%) and rate (0-60.5%) also varied significantly across sites (p0.001). The variability in compression depth and rate persisted despite use of real-time visual feedback or JIT training (p0.001).The quality of CPR across multiple pediatric institutions is variable. Variability in CPR quality across institutions persists even with the implementation of a Just-in-Time training session and visual feedback for CPR quality during simulated cardiac arrest.

The debriefing is an essential component of simulation-based training for healthcare professionals, but learning this complex skill can be challenging for simulation faculty. There are multiple competing priorities for a debriefer’s attention that can contribute to a high mental workload, which may adversely affect debriefer performance and consequently learner outcomes. In this paper, we conceptualize the debriefer as a learner of debriefing skills and we discuss Cognitive Load Theory to categorize the many potential mental loads that can affect the faculty debriefer as learner. We then discuss mitigation strategies that can be considered by faculty development programmes to enhance professional development of debriefing staff.

Pediatric patients with trauma pose unique challenges, both practical and cognitive, to front-line care providers. The combination of anatomic, physiologic, and metabolic factors leads to unique injury patterns with different approaches and responses to treatment compared with adults. A similar traumatic mechanism can lead to slightly different internal injuries with unique management and treatment strategies between the two groups. This article is intended for community, nonpediatric trauma centers, and emergency physicians who are frequently required to assess, resuscitate, and stabilize injured children before they can be safely transferred to a pediatric trauma center for ongoing definitive care and rehabilitation.

Crisis resource management principles dictate appropriate distribution of mental and/or physical workload so as not to overwhelm any one team member. Workload during pediatric emergencies is not well studied. The National Aeronautics and Space Administration-Task Load Index is a multidimensional tool designed to assess workload validated in multiple settings. Low workload is defined as less than 40, moderate 40-60, and greater than 60 signify high workloads. Our hypothesis is that workload among both team leaders and team members is moderate to high during a simulated pediatric sepsis scenario and that team leaders would have a higher workload than team members.Multicenter observational study.Nine pediatric simulation centers (five United States, three Canada, and one United Kingdom).Team leaders and team members during a 12-minute pediatric sepsis scenario.National Aeronautics and Space Administration-Task Load Index.One hundred twenty-seven teams were recruited from nine sites. One hundred twenty-seven team leaders and 253 team members completed the National Aeronautics and Space Administration-Task Load Index. Team leader had significantly higher overall workload than team member (51 ± 11 vs 44 ± 13; p0.01). Team leader had higher workloads in all subcategories except in performance where the values were equal and in physical demand where team members were higher than team leaders (29 ± 22 vs 18 ± 16; p0.01). The highest category for each group was mental 73 ± 13 for team leader and 60 ± 20 for team member. For team leader, two categories, mental (73 ± 17) and effort (66 ± 16), were high workload, most domains for team member were moderate workload levels.Team leader and team member are under moderate workloads during a pediatric sepsis scenario with team leader under high workloads (60) in the mental demand and effort subscales. Team leader average significantly higher workloads. Consideration of decreasing team leader responsibilities may improve team workload distribution.

Simulation-based educational activities are happening in the clinical environment but are not all uniform in terms of their objectives, delivery, or outputs. While these activities all provide an opportunity for individual and team training, nuances in the location, timing, notification, and participants impact the potential outcomes of these sessions and objectives achieved. In light of this, there are actually many different types of simulation-based activity that occur in the clinical environment, which has previously all been grouped together as “in situ” simulation. However, what truly defines in situ simulation is how the clinical environment responds in its’ natural state, including the personnel, equipment, and systems responsible for care in that environment. Beyond individual and team skill sets, there are threats to patient safety or quality patient care that result from challenges with equipment, processes, or system breakdowns. These have been labeled “latent safety threats.” We submit that the opportunity for discovery of latent safety threats is what defines in situ simulation and truly differentiates it from what would be more rightfully called “on-site” simulation. The distinction between the two is highlighted in this article, as well as some of the various sub-types of in situ simulation.

Context Simulation-based medical education (SBME) is now ubiquitous at all levels of medical training. Given the substantial resources needed for SBME, economic evaluation of simulation-based programmes or curricula is required to demonstrate whether improvement in trainee performance (knowledge, skills and attitudes) and health outcomes justifies the cost of investment. Current literature evaluating SBME fails to provide consistent and interpretable information on the relative costs and benefits of alternatives. Content Economic evaluation is widely applied in health care, but is relatively scarce in medical education. Therefore, in this paper, using a focus on SBME, we define economic evaluation, describe the key components, and discuss the challenges associated with conducting an economic evaluation of medical education interventions. As a way forward to the rigorous and state of the art application of economic evaluation in medical education, we outline the steps to gather the necessary information to conduct an economic evaluation of simulation-based education programmes and curricula, and describe the main approaches to conducting an economic evaluation. Conclusion A properly conducted economic evaluation can help stakeholders (i.e., programme directors, policy makers and curriculum designers) to determine the optimal use of resources in selecting the modality or method of assessment in simulation. It also helps inform broader decision making about allocation of scarce resources within an educational programme, as well as between education and clinical care. Economic evaluation in medical education research is still in its infancy, and there is significant potential for state-of-the-art application of these methods in this area.

To examine the effect of simulation-based seizure management teaching on improving caregiver competence and reported confidence with managing seizures. The authors hypothesized that simulation-based education would lead to a higher level of demonstrated competence and reported confidence in family members and caregivers. Simulation has not been previously studied in this context.A two-group pre- and post-test experimental research design involving a total of 61 caregivers was used. The intervention was a simulation-based seizure curriculum delivered as a supplement to traditional seizure discharge teaching. Caregiver performance was analyzed using a seizure management checklist. Caregivers' perception of self-efficacy was captured using a self-efficacy questionnaire.Caregivers in the experimental group achieved significantly higher postintervention performance scores than caregivers in the control group in both premedication and postmedication seizure management (P0.01). Additionally, they achieved significantly higher scores on the self-efficacy questionnaire including items reflecting confidence managing the seizure at home (P0.05).Caregivers receiving the supplemental simulation-based curriculum achieved significantly higher levels of competence and reported confidence, supporting a positive relationship between simulation-based seizure discharge education, and caregiver competence and confidence in managing seizures. Simulation sessions provided insight into caregiver knowledge but, more importantly, insight into the caregiver's ability to apply knowledge under stressful conditions, allowing tailoring of curriculum to meet individual needs. These findings may have applications and relevance for management of other acute or chronic medical conditions.Examiner l’effet de l’enseignement de la prise en charge des convulsions par simulation pour améliorer les compétences des soignants et leur confiance déclarée à traiter les convulsions. Les auteurs postulent que l’enseignement par simulation accroîtrait les compétences démontrées et la confiance déclarée des membres de la famille et des soignants. La simulation n’a jamais été étudiée dans ce contexte.Une méthodologie de recherche expérimentale en deux groupes avant et après le test a été privilégiée auprès de 61 soignants. L’intervention consistait en un cours par simulation sur les convulsions donné en plus de l’enseignement habituel sur les convulsions présenté au congé. Le rendement des soignants a été analysé au moyen d’une liste de vérification de la prise en charge des convulsions. La perception d’auto-efficacité du soignant a été saisie au moyen d’un questionnaire d’auto-efficacité.Les soignants du groupe expérimental ont obtenu des indices de rendement considérablement plus élevés après l’intervention que ceux du groupe témoin, tant avant qu’après la prise en charge des convulsions par médication (P0,01). De plus, ils ont obtenu des indices considérablement plus élevés au questionnaire d’auto-efficacité, y compris les questions reflétant la confiance à soigner les convulsions à domicile (P0,05).Les soignants qui avaient eu un cours par simulation ont obtenu des taux de compétence et de confiance déclarée beaucoup plus élevés. Ces résultats corroborent la relation positive entre l’enseignement sur les convulsions par simulation au congé et la compétence et la confiance des soignants envers la prise en charge des convulsions. Les séances de simulation donnaient un aperçu des compétences des soignants, mais, surtout, de leur capacité à appliquer leurs connaissances dans des conditions stressantes, ce qui permet d’adapter le cours à leurs besoins. Ces observations peuvent être utiles et pertinentes pour la prise en charge d’autres maladies aiguës ou chroniques.

This study provides information for educators about levels of competence in teams comprised of medical, nursing and respiratory therapy students after receiving a simulation-based team-training (SBT) curriculum with and without an additional formalized 30-min team-training (TT) module. A two-group pre- and post-test research design was used to evaluate team competence with respect to leadership, roles and responsibilities, communication, situation awareness and resource utilization. All scenarios were digitally recorded and evaluated using the KidSIM Team Performance Scale by six experts from medicine, nursing and respiratory therapy. The lowest scores occurred for items that reflected situation awareness. All teams improved their aggregate scores from Time 1 to Time 2 (p 0.05). Student teams in the intervention group achieved significantly higher performance scores at Time 1 (Cohen's d = 0.92, p 0.001) and Time 2 (d = 0.61, p 0.01). All student teams demonstrated significant improvement in their ability to work more effectively by Time 2. The results suggest that situational awareness is an advanced expectation for the undergraduate student team. The provision of a formalized TT module prior to engaging student teams in a simulation-based TT curriculum led to significantly higher performances at Time 1 and 2.

Objectives: Debriefing is a common feature of technology-enhanced simulation (TES) education. However, evidence for its effectiveness remains unclear. We sought to characterise how debriefing is reported in the TES literature, identify debriefing features that are associated with improved outcomes, and evaluate the effectiveness of debriefing when combined with TES. Methods: We systematically searched databases, including MEDLINE, EMBASE and Scopus, and reviewed previous bibliographies for original comparative studies investigating the use of TES with debriefing in training health care providers. Reviewers, in duplicate, evaluated study quality and abstracted information on instructional design, debriefing and outcomes. Effect sizes (ES) were pooled using random-effects meta-analysis. Results: From 10 903 potentially eligible studies, we identified 177 studies (11 511 learners) that employed debriefing as part of TES. Key characteristics of debriefing (e.g. duration, educator presence and characteristics, content, structure/method, timing, use of video) were usually incompletely reported. A meta-analysis of four studies demonstrated that video-assisted debriefing has negligible and non-significant effects for time skills (ES = 0.10) compared with non-video-assisted debriefing. Meta-analysis demonstrated non-significant effects in favour of expert modelling with short debriefing in comparison with long debriefing (ES range = 0.21-0.74). Among studies comparing terminal with concurrent debriefing, results were variable depending on outcome measures and the context of training (e.g. medical resuscitation versus technical skills). Eight additional studies revealed insight into the roles of other debriefing-related factors (e.g. multimedia debriefing, learner-led debriefing, debriefing duration, content of debriefing). Among studies that compared simulation plus debriefing with no intervention, pooled ESs were favourable for all outcomes (ES range = 0.28-2.16). Conclusions: Limited evidence suggests that video-assisted debriefing yields outcomes similar to those of non-video-assisted debriefing. Other debriefing design features show mixed or non-significant results. As debriefing characteristics are usually incompletely reported, future debriefing research should describe all the key debriefing characteristics along with their associated descriptors.

Introduction: The purpose of this study is to determine if the introduction of a pre-arrival and pre-departure Trauma Checklist as a cognitive aid, coupled with an educational session, will improve clinical performance in a simulated environment. The Trauma Checklist was developed in response to a quality assurance review of high-acuity trauma activations. It focuses on pre-arrival preparation and a pre-departure review prior to patient transfer to diagnostic imaging or the operating room. We conducted a pilot, randomized control trial assessing the impact of the Trauma Checklist on time to critical interventions on a simulated pediatric patient by multidisciplinary teams. Methods: Emergency department teams composed of 2 physicians, 2 nurses and 2 confederate actors were enrolled in our study. In the intervention arm, participants watched a 10-minute educational video modelling the use of the trauma checklist prior to their simulation scenario and were provided a copy of the checklist. Teams participated in a standardized simulation scenario caring for a severely injured adolescent patient with hemorrhagic shock, respiratory failure and increased intracranial pressure. Our primary outcome of interest was time measurement to initiation of key clinical interventions, including intubation, first blood product administration, massive transfusion protocol activation, initiation of hyperosmolar therapy and others. Secondary outcome measures included a Trauma Task Performance score and checklist completion scores. Results: We enrolled 14 multidisciplinary teams (n=56 participants) into our study. There was a statistically significant decrease in median time to initiation of hyperosmolar therapy by teams in the intervention arm compared to the control arm (581 seconds, [509-680] vs. 884 seconds, [588-1144], p=0.03). Time to initiation of other clinical interventions was not statistically significant. There was a trend to higher Trauma Task Performance scores in the intervention group however this did not reach statistical significant (p=0.09). Pre-arrival and pre-departure checklist scores were higher in the intervention group (9.0 [9.0-10.0] vs. 7.0 [6.0-8.0], p=0.17 and 12.0 [11.5-12.0] vs. 7.5 [6.0-8.5], p=0.01). Conclusion: Teams using the Trauma Checklist did not have decreased time to initiation of key clinical interventions except in initiating hyperosmolar therapy. Teams in the intervention arm had statistically significantly higher pre-arrival and pre-departure scores, with a trend to higher Trauma Task Performance scores. Our study was a pilot and recruitment did not achieve the anticipated sample size, thus underpowered. The impact of this checklist should be studied outside tertiary trauma centres, particularly in trainees and community emergency providers, to assess for benefit and further generalizability.

Debriefing is a critical component in the process of learning through healthcare simulation. This critical review examines the timing, facilitation, conversational structures, and process elements used in healthcare simulation debriefing. Debriefing occurs either after (postevent) or during (within-event) the simulation. The debriefing conversation can be guided by either a facilitator (facilitator-guided) or the simulation participants themselves (self-guided). Postevent facilitator-guided debriefing may incorporate several conversational structures. These conversational structures break the debriefing discussion into a series of 3 or more phases to help organize the debriefing and ensure the conversation proceeds in an orderly manner. Debriefing process elements are an array of techniques to optimize reflective experience and maximize the impact of debriefing. These are divided here into the following 3 categories: essential elements, conversational techniques/educational strategies, and debriefing adjuncts. This review provides both novice and advanced simulation educators with an overview of various methods of conducting healthcare simulation debriefing. Future research will investigate which debriefing methods are best for which contexts and for whom, and also explore how lessons from simulation debriefing translate to debriefing in clinical practice.

Introduction It is critical that competency in pediatric resuscitation is achieved and assessed during residency or post graduate medical training. The purpose of this study was to create and evaluate a tool to measure all elements of pediatric resuscitation team leadership competence. Methods An initial set of items, derived from a literature review and a brainstorming session, were refined to a 26 item assessment tool through the use of Delphi methodology. The tool was tested using videos of standardized resuscitations. A psychometric assessment of the evidence for instrument validity and reliability was undertaken. Results The performance of 30 residents on two videotaped scenarios was assessed by 4 pediatricians using the tool, with 12 items assessing ‘leadership and communication skills' (LCS) and 14 items assessing ‘knowledge and clinical skills' (KCS). The instrument showed evidence of reliability; the Cronbach's alpha and generalizability co-efficients for the overall instrument were α =0.818 and Ep 2 =0.76, for LCS were α =0.827 and Ep 2 =0.844, and for KCS were α =0.673 and Ep 2 =0.482. While validity was initially established through literature review and brainstorming by the panel of experts, it was further built through the high strength of correlation between global scores and scores for overall performance ( r =0.733), LCS ( r =0.718) and KCS ( r =0.662) as well as the factor analysis which accounted for 40.2% of the variance. Conclusion The results of the study demonstrate that the instrument is a valid and reliable tool to evaluate pediatric resuscitation team leader competence.

Previous studies have reached a variety of conclusions regarding the effect of gender on performance in objective structured clinical examinations (OSCEs). Most measured the effect on students' overall OSCE score. The authors of this study evaluated the effect of gender on the scores of specific physical examination OSCE stations, both "gender-sensitive" and "gender-neutral."In 2008, the authors collected scores for 138 second-year medical students at the University of Calgary who underwent a seven-station OSCE. Two stations--precordial and respiratory exams--were considered gender-sensitive. Multiple linear regression was used to explore the effect of students', standardized patients' (SPs'), and raters' genders on the students' scores.All 138 students (69 female) completed the OSCE and were included in the analyses. The mean scores (SD) for the two stations involving examination of the chest were higher for female than for male students (83.2% [15.5] versus 78.3% [15.8], respectively, d = 0.3, P = .009). There was a significant interaction between student and SP gender (P = .02). In the stratified analysis, female students were rated significantly higher than male students at stations with female SPs (85.4% [15.5] versus 76.6% [16.5], d = 0.6, P = .004) but not at stations with male SPs (80.2% [15.0] versus 80.0% [15.0], P = 1.0).These results suggest student and SP genders interact to affect OSCE scores at stations that require examination of the chest. Further investigations are warranted to ensure that the OSCE is an equal experience for all students.

Introduction Although trauma is associated with major acute morbidity and mortality, its long-term outcome is less well defined. We sought to define the rate of readmission to hospital and long-term mortality of victims of major trauma. Patients and Methods All Calgary Health Region residents presenting to the regional trauma program with an injury severity score (ISS) ≥12 between April 1, 2002 and March 31, 2006 were included. Readmission to hospital within one-year and deaths occurring on or before September 30, 2008 were identified using regional and provincial databases. Results A total of 2652 incident major trauma episodes occurred among 2630 residents; the median age was 41.3 [interquartile range (IQR); 23.1–59.2] years, 1,915 (72%) were male, the median ISS was 19 (IQR; 16–25), and 717 (27%) required intensive care unit admission. Among 2350 survivors to hospital discharge, 537 readmissions occurred (median length of stay 4.0; IQR; 1.6–7.5 days) among 386 patients within one-year of the incident trauma episode, and 323 (60%) required surgery. Re-admitted patients were older, had higher ISS, had longer initial admission length of stay, and were less likely to have sports related injuries. Two hundred and fifteen (8%) of 2350 survivors to hospital discharge died during the median study follow-up duration of 1543 (IQR; 1181–1934) days. Case-fatality rates for 28 days, 90 days, and 365 days were 304 (11%), 327 (12%), and 370 (14%), respectively. Among survivors to 28 days (n = 2348), 66 (3%) suffered delayed one-year mortality (i.e. death occurred between 28 days and 365 days post-trauma). Age ≥65 years of age, initial hospitalisation for ≥28 days, and unintentional falls were independently associated with delayed one-year mortality. Conclusions Patients with major trauma are at risk for both acute and delayed adverse outcomes.

This study uses population-based estimates to assess the sensitivity and representativeness of an injury surveillance system using a 1-year population-based approach. Data from the Ottawa Canadian Hospitals Injury Reporting and Prevention Program (CHIRPP) site (Children’s Hospital of Eastern Ontario) were compared with those from six expansion sites. The overall sensitivity of CHIRPP was 43% of all treated injuries and 57% of injuries treated at emergency departments. CHIRPP was less likely to be representative for older children and more likely to capture children with more severe injuries. The limitations related to using CHIRPP for representing population-based injury remain fairly stable over time. A one-time population-based sample can provide useful information to add to routinely collected injury surveillance.

Effectively designed and implemented simulation-based education (SBE) programs have the power to change the behavior of people and the systems they work in. This chapter outlines critical elements of a well-designed SBE program, and some of the theoretical considerations that underpin the recommendations given. Careful consideration is given to the place of simulation in the learning hierarchy and how simulation may be used to influence the design and delivery of all other elements of the healthcare system from the boardroom to the bedside.

The role of simulation-based education in training trauma teams is growing, and debriefing is a critical component of this educational modality. With increasing evidence to support the role of debriefing, more trauma programs are integrating structured debriefings into their trauma training programs. This chapter will: (1) discuss the body of literature supporting the role of debriefing in simulation-based education; (2) describe the typical structure of a post-event debriefing; (3) highlight various methods of debriefing; and (4) discuss the benefits and challenges of debriefing trauma teams after real events.

This chapter discusses how pediatric simulation should evolve in the future to best address the needs of pediatric patients and their families. The chapter specifically highlights several key areas that offer opportunity for the future: (1) optimizing simulation resources within and between programs to enhance productivity, (2) integration of simulation into clinical governance, family-centered care, and assessment of healthcare professionals, (3) innovation in the forms of asynchronous learning, improved education management systems, distance learning, and improving the safety of clinical environments, (4) investigating pertinent clinical questions using simulation as a research tool, and (5) inspiring the future generation of simulation leaders by establishing a vision of how simulation can be used as a tool to enhance education, research, and patient safety.

Introduction: Human errors occur during resuscitation despite individual knowledge of resuscitation guidelines. Poor teamwork has been implicated as a major source of such error; therefore interprofessional resuscitation teamwork training is essential. Hypothesis: A one-day team training course for pediatric interprofessional resuscitation team members improves adherence to PALS guidelines, team efficiency and teamwork in a simulated clinical environment. Methods: A prospective interventional study was conducted at 4 children’s hospitals in Canada with pediatric resuscitation team members (n=300, 51 teams). Educational intervention was a one-day simulation-based team training course involving interactive lecture, group discussions and 4 simulated resuscitation scenarios followed by debriefing. First scenario of the day was conducted prior to any training. Final scenario of the day was the same scenario, with modified patient history. Scenarios included standardized distractors designed to elicit and challenge specific teamwork behaviors. Primary outcome measure was change (before and after training) in adherence to PALS guidelines, as measured by the Clinical Performance Tool (CPT). Secondary outcome measures: change in times to initiation of chest compressions and defibrillation; and teamwork performance, as measured by the Clinical Teamwork Scale (CTS). Correlation between CPT and CTS scores was analyzed. Results: Teams significantly improved CPT scores (67.3% to 79.6%, P< 0.0001), time to initiation of chest compressions (60.8 sec to 27.1 sec, P Conclusions: Participation in a simulation-based team training educational intervention significantly improved surrogate measures of clinical performance, time to initiation of key clinical tasks, and teamwork during simulated pediatric resuscitation. A strong correlation between clinical and teamwork performance suggests that effective teamwork optimizes clinical performance of resuscitation teams.

Debriefing is widely recognized as a critically important element of simulation-based education. Simulation educators obtain and/or seek debriefing training from various sources, including workshops at conferences, simulation educator courses, formal fellowships in debriefings, or through advanced degrees. Although there are many options available for debriefing training, little is known about how faculty development opportunities should be structured to maintain and enhance the quality of debriefing within simulation programs. In this article, we discuss 5 key issues to help shape the future of debriefing training for simulation educators, specifically the following: (1) Are we teaching the appropriate debriefing methods? (2) Are we using the appropriate methods to teach debriefing skills? (3) How can we best assess debriefing effectiveness? (4) How can peer feedback of debriefing be used to improve debriefing quality within programs? (5) How can we individualize debriefing training opportunities to the learning needs of our educators?