Search

Background: To compare validity evidence for dichotomous and trichotomous versions of a neonatal intubation (NI) procedural skills checklist., Methods: NI skills checklists were developed utilizing an existing framework. Experts were trained on scoring using dichotomous and trichotomous checklists, and rated recordings of 23 providers performing simulated NI. Videolaryngoscope recordings of glottic exposure were evaluated using Cormack-Lehane (CL) and Percent of Glottic Opening scales. Internal consistency and reliability of both checklists were analyzed, and correlations between checklist scores, airway visualization, entrustable professional activities (EPA), and global skills assessment (GSA) were calculated., Results: During rater training, raters gave significantly higher scores on better provider performance in standardized videos (both p < 0.001). When utilized to evaluate study participants' simulated NI attempts, both dichotomous and trichotomous checklist scores demonstrated very good internal consistency (Cronbach's alpha 0.868 and 0.840, respectively). Inter-rater reliability was higher for dichotomous than trichotomous checklists [Fleiss kappa of 0.642 and 0.576, respectively (p < 0.001)]. Sum checklist scores were significantly different among providers in different disciplines (p < 0.001, dichotomous and trichotomous). Sum dichotomous checklist scores correlated more strongly than trichotomous scores with GSA and CL grades. Sum dichotomous and trichotomous checklist scores correlated similarly well with EPA., Conclusions: Neither dichotomous or trichotomous checklist was superior in discriminating provider NI skill when compared to GSA, EPA, or airway visualization assessment. Sum scores from dichotomous checklists may provide sufficient information to assess procedural competence, but trichotomous checklists may permit more granular feedback to learners and educators. The checklist selected may vary with assessment needs., (© 2022. The Author(s).)

Background: Airway management procedures are critical for emergency medicine (EM) physicians, but rarely performed skills in pediatric patients. Worldwide experience with respect to frequency and confidence in performing airway management skills has not been previously described., Objectives: Our aims were 1) to determine the frequency with which emergency medicine physicians perform airway procedures including: bag-mask ventilation (BMV), endotracheal intubation (ETI), laryngeal mask airway (LMA) insertion, tracheostomy tube change (TTC), and surgical airways, and 2) to investigate predictors of procedural confidence regarding advanced airway management in children., Methods: A web-based survey of senior emergency physicians was distributed through the six research networks associated with Pediatric Emergency Research Network (PERN). Senior physician was defined as anyone working without direct supervision at any point in a 24-h cycle. Physicians were queried regarding their most recent clinical experience performing or supervising airway procedures, as well as with hands on practice time or procedural teaching. Reponses were dichotomized to within the last year, or ≥ 1 year. Confidence was assessed using a Likert scale for each procedure, with results for ETI and LMA stratified by age. Response levels were dichotomized to "not confident" or "confident." Multivariate regression models were used to assess relevant associations., Results: 1602 of 2446 (65%) eligible clinicians at 96 PERN sites responded. In the previous year, 1297 (85%) physicians reported having performed bag-mask ventilation, 900 (59%) had performed intubation, 248 (17%) had placed a laryngeal mask airway, 348 (23%) had changed a tracheostomy tube, and 18 (1%) had performed a surgical airway. Of respondents, 13% of physicians reported the opportunity to supervise but not provide ETI, 5% for LMA and 5% for BMV. The percentage of physicians reporting "confidence" in performing each procedure was: BMV (95%) TTC (43%), and surgical airway (16%). Clinician confidence in ETT and LMA varied by patient age. Supervision of an airway procedure was the strongest predictor of procedural confidence across airway procedures., Conclusion: BMV and ETI were the most commonly performed pediatric airway procedures by emergency medicine physicians, and surgical airways are very infrequent. Supervising airway procedures may serve to maintain procedural confidence for physicians despite infrequent opportunities as the primary proceduralist., Competing Interests: Declaration of Competing Interest The authors have no conflicts of interest relevant to this article to disclose., (Copyright © 2020 Elsevier Inc. All rights reserved.)

Background: Cognitive appraisal of stress can influence performance. Increased awareness could facilitate titration to optimal stress levels. This study's primary aim was to investigate whether physiologic variables change with increasingly stressful simulations. Secondary aims include effect of stress on procedural competency and whether individuals recognize their experienced stress., Methods: This was a single-center, mixed-method, simulation-based study. Participants completed three scenarios requiring resuscitation under increasingly stressful conditions. Wearable biometric devices recorded physiologic parameters. Subjects completed surveys assessing knowledge and perceived stress. Intubation success or failure was noted. Heart rate variability (HRV) analysis was used as a proxy for stress., Results: Twelve participants completed the study. Survey analysis revealed progressive amplification of endorsement of affective states associated with stress. Median low frequency (LF)/high frequency (HF) ratio from scenario 1 (median = 2.29, IQR = 1.97, 3.91) was significantly lower than scenario 2 (median = 4.7, IQR = 2.32, 8.35, p = 0.04) and scenario 3 (median = 4.63, IQR = 2.2, 7.43, p = 0.04). Changes in HRV were noted during all scenarios irrespective of subjective self-assessment of stress. Procedural proficiency suffered during more stressful scenarios., Conclusions: This study demonstrates alterations in subjective assessment and objective physiologic data in simulations with increasing stress. HRV is useful as a proxy for stress response and does not always correlate with perception.

Background: Best practices for benchmarking the efficacy of simulation-based training programs are not well defined. This study sought to assess feasibility of standardized data collection with multicenter implementation of simulation-based training, and to characterize variability in pediatric trauma resuscitation task completion associated with program characteristics., Methods: A prospective multicenter observational cohort of resuscitation teams (N = 30) was used to measure task completion and teamwork during simulated resuscitation of a child with traumatic brain injury. A survey was used to measure center-specific trauma volume and simulation-based training program characteristics among participating centers., Results: No task was consistently performed across all centers. Teamwork skills were associated with faster time to computed tomography notification (r = -0.51, p < 0.01). Notification of the operating room by the resuscitation team occurred more frequently in in situ simulation than in laboratory-based simulation (13/22 versus 0/8, p < 0.01)., Conclusions: Multicenter implementation of a standardized pediatric trauma resuscitation simulation scenario is feasible. Standardized data collection showed wide variability in simulated resuscitation task completion., (Copyright © 2019 Elsevier Inc. All rights reserved.)

Background: Neonatal tracheal intubation (NTI) is an important clinical skill. Suboptimal performance is associated with patient harm. Simulation training can improve NTI performance. Improving performance requires an objective assessment of competency. Competency assessment tools need strong evidence of validity. We hypothesized that an NTI competency assessment tool with multisource validity evidence could be developed and be used for formative and summative assessment during simulation-based training., Methods: An NTI assessment tool was developed based on a literature review. The tool was refined through 2 rounds of a modified Delphi process involving 12 subject-matter experts. The final tool included a 22-item checklist, a global skills assessment, and an entrustable professional activity (EPA) level. The validity of the checklist was assessed by having 4 blinded reviewers score 23 videos of health care providers intubating a neonatal simulator., Results: The checklist items had good internal consistency (overall α = 0.79). Checklist scores were greater for providers at greater training levels and with more NTI experience. Checklist scores correlated with global skills assessment (ρ = 0.85; P < .05), EPA levels (ρ = 0.87; P < .05), percent glottic exposure (r = 0.59; P < .05), and Cormack-Lehane scores (ρ = 0.95; P < .05). Checklist scores reliably predicted EPA levels., Conclusions: We developed an NTI competency assessment tool with multisource validity evidence. The tool was able to discriminate NTI performance based on experience. The tool can be used during simulation-based NTI training to provide formative and summative assessment and can aid with entrustment decisions., (Copyright © 2018 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.)

Background: Telemedicine provides access to specialty care to critically ill patients from a geographic distance. The effects of using telemedicine on (1) teamwork and communication (TC), (2) task workload during resuscitation, and (3) the processes of critical care have not been well described., Objectives: To evaluate the impact of telemedicine on (1) TC, (2) task workload during a resuscitation, and (3) the processes of critical care during a simulated pediatric resuscitation., Methods: Prospective single-center randomized trial. Teams of two physicians (senior and junior resident) and two standardized confederate nurses were randomized to either telemedicine (telepresent senior physician team leader) or usual care (both physicians in the room) during a simulated infant resuscitation. Simulations were video recorded and assessed for teamwork, workload, and processes of care using the Simulated Team Assessment Tool (STAT), the NASA Task Load Index (NASA-TLX) tool, and time between onset of ventricular fibrillation and defibrillation, respectively., Results: Twenty teams participated. There was no difference in teamwork between the groups (mean STAT score 72% vs. 69%; p = 0.383); however, there was a significantly greater workload in the telemedicine group (mean TLX score 56% vs. 48%, p = 0.020). Using linear regression, no difference was found in time-to-defibrillation between groups (p = 0.671), but higher teamwork scores predicted faster time to defibrillation (p = 0.020)., Conclusions: In this simulation-based study, a telepresent team leader was associated with increased team workload compared to usual care. However, no differences were noted in teamwork and processes of care metrics.

Introduction: We developed a first-person serious game, PediatricSim, to teach and assess performances on seven critical pediatric scenarios (anaphylaxis, bronchiolitis, diabetic ketoacidosis, respiratory failure, seizure, septic shock, and supraventricular tachycardia). In the game, players are placed in the role of a code leader and direct patient management by selecting from various assessment and treatment options. The objective of this study was to obtain supportive validity evidence for the PediatricSim game scores., Methods: Game content was developed by 11 subject matter experts and followed the American Heart Association's 2011 Pediatric Advanced Life Support Provider Manual and other authoritative references. Sixty subjects with three different levels of experience were enrolled to play the game. Before game play, subjects completed a 40-item written pretest of knowledge. Game scores were compared between subject groups using scoring rubrics developed for the scenarios. Validity evidence was established and interpreted according to Messick's framework., Results: Content validity was supported by a game development process that involved expert experience, focused literature review, and pilot testing. Subjects rated the game favorably for engagement, realism, and educational value. Interrater agreement on game scoring was excellent (intraclass correlation coefficient = 0.91, 95% confidence interval = 0.89-0.9). Game scores were higher for attendings followed by residents then medical students (Pc < 0.01) with large effect sizes (1.6-4.4) for each comparison. There was a very strong, positive correlation between game and written test scores (r = 0.84, P < 0.01)., Conclusions: These findings contribute validity evidence for PediatricSim game scores to assess knowledge of pediatric emergency medicine resuscitation.

Objectives: Script concordance testing (SCT) is used to assess clinical decision-making. We explore the use of SCT to (1) quantify practice variations in infant lumbar puncture (LP) and (2) analyze physician's characteristics affecting LP decision making., Methods: Using standard SCT processes, a panel of pediatric subspecialty physicians constructed 15 infant LP case vignettes, each with 2 to 4 SCT questions (a total of 47). The vignettes were distributed to pediatric attending physicians and fellows at 10 hospitals within the INSPIRE Network. We determined both raw scores (tendency to perform LP) and SCT scores (agreement with the reference panel) as well as the variation with participant factors., Results: Two hundred twenty-six respondents completed all 47 SCT questions. Pediatric emergency medicine physicians tended to select LP more frequently than did general pediatricians, with pediatric emergency medicine physicians showing significantly higher raw scores (20.2 ± 10.2) than general pediatricians (13 ± 15; 95% confidence interval for difference, 1, 13). Concordance with the reference panel varied among subspecialties and by the frequency with which practitioners perform LPs in their practices., Conclusion: Script concordance testing questions can be used as a tool to detect subspecialty practice variation. We are able to detect significant practice variation in the self-report of use of LP for infants among different pediatric subspecialties.

The acquisition and maintenance of individual competency is a critical component of effective emergency care systems. This article summarizes consensus working group deliberations and recommendations focusing on the topic "Simulation-based education to ensure provider competency within the healthcare system." The authors presented this work for discussion and feedback at the 2017 Academic Emergency Medicine Consensus Conference on "Catalyzing System Change Through Healthcare Simulation: Systems, Competency, and Outcomes," held on May 16, 2017, in Orlando, Florida. Although simulation-based training is a quality and safety imperative in other high-reliability professions such as aviation, nuclear power, and the military, health care professions still lag behind in applying simulation more broadly. This is likely a result of a number of factors, including cost, assessment challenges, and resistance to change. This consensus subgroup focused on identifying current gaps in knowledge and process related to the use of simulation for developing, enhancing, and maintaining individual provider competency. The resulting product is a research agenda informed by expert consensus and literature review., (© 2017 by the Society for Academic Emergency Medicine.)

Objectives: To develop and provide validity evidence for a performance checklist to evaluate the child abuse screening behaviors of prehospital providers., Methods: Checklist Development: We developed the first iteration of the checklist after review of the relevant literature and on the basis of the authors' clinical experience. Next, a panel of six content experts participated in three rounds of Delphi review to reach consensus on the final checklist items. Checklist Validation: Twenty-eight emergency medical services (EMS) providers (16 EMT-Basics, 12 EMT-Paramedics) participated in a standardized simulated case of physical child abuse to an infant followed by one-on-one semi-structured qualitative interviews. Three reviewers scored the videotaped performance using the final checklist. Light's kappa and Cronbach's alpha were calculated to assess inter-rater reliability (IRR) and internal consistency, respectively. The correlation of successful child abuse screening with checklist task completion and with participant characteristics were compared using Pearson's chi squared test to gather evidence for construct validity., Results: The Delphi review process resulted in a final checklist that included 24 items classified with trichotomous scoring (done, not done, or not applicable). The overall IRR of the three raters was 0.70 using Light's kappa, indicating substantial agreement. Internal consistency of the checklist was low, with an overall Cronbach's alpha of 0.61. Of 28 participants, only 14 (50%) successfully screened for child abuse in simulation. Participants who successfully screened for child abuse did not differ significantly from those who failed to screen in terms of training level, past experience with child abuse reporting, or self-reported confidence in detecting child abuse (all p > 0.30). Of all 24 tasks, only the task of exposing the infant significantly correlated with successful detection of child abuse (p < 0.05)., Conclusions: We developed a child abuse checklist that demonstrated strong content validity and substantial inter-rater reliability, but successful item completion did not correlate with other markers of provider experience. The validated instrument has important potential for training, continuing education, and research for prehospital providers at all levels of training.

Objectives: The aims of this study were to provide validity evidence for infant lumbar puncture (ILP) checklist and global rating scale (GRS) instruments when used by residents to assess simulated ILP performances and to compare these metrics to previously obtained attending rater data., Methods: In 2009, the International Network for Simulation-based Pediatric Innovation, Research, and Education (INSPIRE) developed checklist and GRS scoring instruments, which were previously validated among attending raters when used to assess simulated ILP performances. Video recordings of 60 subjects performing an LP on an infant simulator were collected; 20 performed by subjects in 3 categories (beginner, intermediate, and expert). Six blinded pediatric residents independently scored each performance (3 via the GRS, 3 via the checklist). Four of the 5 domains of validity evidence were collected: content, response process, internal structure (reliability and discriminant validity), and relations to other variables., Results: Evidence for content and response process validity is presented. When used by residents, the checklist performed similarly to what was found for attending raters demonstrating good internal consistency (Cronbach α = 0.77) and moderate interrater agreement (intraclass correlation coefficient = 0.47). Residents successfully discerned beginners (P < 0.01, effect size = 2.1) but failed to discriminate between expert and intermediate subjects (P = 0.68, effect size = 0.34). Residents, however, gave significantly higher GRS scores than attending raters across all subject groups (P < 0.001). Moderate correlation was found between GRS and total checklist scores (P = 0.49, P < 0.01)., Conclusions: This study provides validity evidence for the checklist instrument when used by pediatric residents to assess ILP performances. Compared with attending raters, residents appeared to over-score subjects on the GRS instrument.

Objective: To explore the factors that facilitated or hindered successful implementation of a multi-centered infant lumbar puncture (LP) competency-based education program that required interns to demonstrate skills readiness on a task trainer before performing their first clinical LP., Methods: In 2013, investigators conducted a qualitative study utilizing semistructured interviews and focus groups of site directors (SDs) from the International Network for Simulation-Based Pediatric Innovation, Research, and Education (INSPIRE) who were responsible for implementing the LP competency-based education program. Transcripts were analyzed using grounded theory to identify and verify emergent themes and subthemes., Results: Thematic saturation was attained after interviewing 19 SDs in 12 interviews and 3 focus groups. The most significant strategies and barriers were organized into 4 main themes: 1) alignment of different visions to obtain buy-in, 2) balance between providing education versus patient care, 3) acceptance of novel teaching paradigms, and 4) communication logistics. The ability to overcome barriers was influenced by institutional culture on trainee education, patient safety and research; the level of relational coordination between different groups of stakeholders; and the ability of SDs to identify and diversify entrepreneurial strategies., Conclusions: INSPIRE SDs reveal the challenges of implementing a network-wide competency-based educational initiative that determines interns' readiness to perform LPs in clinical settings. Strategizing to align the common goals of graduate medical training, patient care and research instructs clinician educators and leaders on how to successfully change educational culture in academic medicine., (Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.)

Introduction: Little data are available to guide supervisors' decisions regarding when trainees are prepared to safely perform their first procedure on a patient. We aimed to describe the correlation of simulation-based assessments, in the workplace, with interns' first clinical infant lumbar puncture (ILP) success., Methods: This is a prospective, observational subcomponent of a larger study of incoming interns at 33 academic medical centers (July 2010 to June 2012) assessing the impact of just-in-time training. When an intern's patient required an ILP, a just-in-time simulation-based skills refresher was conducted with his or her supervisor. At the end of the refresher, supervisors assessed interns' ILP skills on a simulator in the workplace before clinical performance using a four point anchored scale. The primary outcome was the correlation of supervisors' assessment and interns' procedural success. The number needed to assess for this instrument (1 / absolute risk reduction) was calculated., Results: A total of 1600 interns were eligible to participate, and 1215 were enrolled. A total of 297 completed an assessment and a subsequent clinical ILP. Success rates for each scale rating were 29% (18/63) for novice, 39% (51/130) for beginner, 55% (46/83) for competent, and 43% (9/21) for proficient. The correlation coefficient was 0.161 (95% confidence interval, 0.057-0.265), indicating a weak correlation between supervisor rating and success. Success rate was 53% for the ratings of competent or proficient compared with 35% for the ratings of novice or beginner. Using the global rating scale for the summative assessment to determine procedural readiness could lead to 1 fewer patient experiencing a failed ILP for every 6 interns tested (6.2; 95% confidence interval, 4.0-8.5)., Conclusions: A simulation-based assessment of interns conducted in the workplace before their first ILP has some value in predicting clinical ILP success.

Objective: To determine which of the 21 general pediatrics milestone subcompetencies are most difficult to assess using traditional methodologies and which are best suited to simulation-based assessment., Methods: We surveyed 2 samples: pediatric simulation experts and pediatric program directors. Respondents were asked about current use of simulation for assessment and to select 5 of the 21 pediatric subcompetencies most difficult to assess using traditional methods and the 5 best suited to simulation-based assessment. Spearman rank correlation was used to determine a correlation between how the 2 samples ranked the subcompetencies., Results: Forty-eight percent (29 of 60) simulation experts and 20% (115 of 571) program directors completed the survey. Few respondents reported using simulation for summative assessment. There are clear differences across the pediatric subcompetencies in perceived difficulty of assessment and suitability to simulation-based assessment. The 3 most difficult to assess subcompetencies were "recognize ambiguity," "demonstrate emotional insight," and "identify one's own strengths and deficiencies." The subcompetencies most suitable to assessment using simulation were "interprofessional teamwork," "clinical decision making," and "effective communication." Program directors and simulation experts had high agreement for both questions: difficult to assess (rho = 0.76, P < .001) and suitable to simulation-based assessment (rho = 0.94, P < .001)., Conclusions: Several general pediatrics milestone subcompetencies were identified by pediatric simulation experts and pediatric program directors as difficult to assess using current methodologies and as amenable to simulation-based assessment. The pediatric simulation community should target development of simulation-based assessment tools to these areas., (Copyright © 2016 Academic Pediatric Association. All rights reserved.)

Acquisition of competency in procedural skills is a fundamental goal of medical training. In this Perspective, the authors propose an evidence-based pedagogical framework for procedural skill training. The framework was developed based on a review of the literature using a critical synthesis approach and builds on earlier models of procedural skill training in medicine. The authors begin by describing the fundamentals of procedural skill development. Then, a six-step pedagogical framework for procedural skills training is presented: Learn, See, Practice, Prove, Do, and Maintain. In this framework, procedural skill training begins with the learner acquiring requisite cognitive knowledge through didactic education (Learn) and observation of the procedure (See). The learner then progresses to the stage of psychomotor skill acquisition and is allowed to deliberately practice the procedure on a simulator (Practice). Simulation-based mastery learning is employed to allow the trainee to prove competency prior to performing the procedure on a patient (Prove). Once competency is demonstrated on a simulator, the trainee is allowed to perform the procedure on patients with direct supervision, until he or she can be entrusted to perform the procedure independently (Do). Maintenance of the skill is ensured through continued clinical practice, supplemented by simulation-based training as needed (Maintain). Evidence in support of each component of the framework is presented. Implementation of the proposed framework presents a paradigm shift in procedural skill training. However, the authors believe that adoption of the framework will improve procedural skill training and patient safety.

Background: Graduate medical education is transitioning to the use of entrustable professional activities to contextualize educational competencies. Factors influencing entrustment decisions have been reported in adult medicine. Knowing how such decisions are made in pediatrics is critical to this transition., Purpose: To understand how supervisors determine the level of procedural supervision to provide a resident, taking into consideration simulation performance; to understand factors that affect supervisors' transparency to parents about residents' procedural experience., Methods: We conducted 18 one-on-one interviews with supervisors in a tertiary care pediatric emergency department, iteratively revising interview questions as patterns in the data were elucidated. Two researchers independently coded transcripts and then met with the investigative team to refine codes and create themes., Results: Five factors influenced supervisors' entrustment decisions: 1) resident characteristics that include self-reported confidence, seniority, and prior interactions with the resident; 2) supervisor style; 3) nature of the procedure/characteristics of the patient; 4) environmental factors; and 5) parental preferences. Supervisors thought that task-based simulators provided practice opportunities but that simulated performance did not provide evidence for entrustment. Supervisors reported selectively omitting details about a resident's experience level to families to optimize experiential learning for residents they entrusted to perform a procedure., Conclusions: In pediatrics, supervisors consider various factors when making decisions regarding resident procedural readiness, including parental preferences. An educational system using entrustable professional activities may facilitate holistic assessment and foster expertise-informed decisions about residents' progression toward entrustment; such a system may also lessen supervisors' need to omit information to parents about residents' procedural readiness., (Copyright © 2014 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.)

Purpose: Residents must learn which infants require a lumbar puncture (LP), a clinical decision-making skill (CDMS) difficult to evaluate because of considerable practice variation. The authors created an assessment model of the CDMS to determine when an LP is indicated, taking practice variation into account. The objective was to detect whether script concordance testing (SCT) could measure CDMS competency among residents for performing infant LPs., Method: In 2011, using a modified Delphi technique, an expert panel of 14 attending physicians constructed 15 case vignettes (each with 2 to 4 SCT questions) that represented various infant LP scenarios. The authors distributed the vignettes to residents at 10 academic pediatric centers within the International Simulation in Pediatric Innovation, Research, and Education Network. They compared SCT scores among residents of different postgraduate years (PGYs), specialties, training in adult medicine, LP experience, and practice within an endemic Lyme disease area., Results: Of 730 eligible residents, 102 completed 47 SCT questions. They could earn a maximum score of 47. Median SCT scores were significantly higher in PGY-3s compared with PGY-1s (difference: 3.0; 95% confidence interval [CI] 1.0-4.9; effect size d = 0.87). Scores also increased with increasing LP experience (difference: 3.3; 95% CI 1.1-5.5) and with adult medicine training (difference: 2.9; 95% CI 0.6-5.0). Residents in Lyme-endemic areas tended to perform more LPs than those in nonendemic areas., Conclusions: SCT questions may be useful as an assessment tool to determine CDMS competency among residents for performing infant LPs.

Background: There are few data describing pediatric interns' experiences, knowledge, attitudes, and skills related to common procedures. This information would help guide supervisors' decisions about interns' preparedness and training needs., Objectives: This study aimed to describe pediatric interns' medical school experiences, knowledge, attitudes, and skills with regard to infant lumbar punctures (LPs) and to describe the impact of these factors on interns' infant LP skills., Methods: This prospective cross-sectional descriptive study was conducted at 21 academic medical centers participating during 2010. Participants answered 8 knowledge questions, 3 attitude questions, and 6 experience questions online. Skills were assessed on an infant LP simulator using a 15-item subcomponent checklist and a 4-point global assessment., Results: Eligible interns numbered 493, with 422 (86%) completing surveys and 362 (73%) completing skills assessments. The majority 287/422 (68%) had never performed an infant LP; however, 306 (73%) had observed an infant LP during school. The mean (SD) knowledge score was 63% (±21%). The mean (SD) subcomponent skills checklist score was 73% (±21%). On the global skills assessment, 225 (62%) interns were rated as beginner, and 137 (38%) were rated as competent, proficient, or expert. Independent predictors of an above-beginner simulator performance included infant LP experience on a patient (odds ratio [OR], 2.2; 95% confidence interval [CI], 1.4-3.5), a knowledge score greater than 65% (OR, 2.4; 95% CI, 1.5-3.7), or self-reported confidence (OR, 3.5; 95% CI, 1.9-6.4)., Conclusions: At the start of residency, the majority of pediatric interns have little experience, poor knowledge, and low confidence and are not prepared to perform infant LPs.

Background and Objective: Simulation-based medical education (SBME) is used to teach residents. However, few studies have evaluated its clinical impact. The goal of this study was to evaluate the impact of an SBME session on pediatric interns' clinical procedural success., Methods: This randomized trial was conducted at 10 academic medical centers. Interns were surveyed on infant lumbar puncture (ILP) and child intravenous line placement (CIV) knowledge and watched audiovisual expert modeling of both procedures. Participants were randomized to SBME mastery learning for ILP or CIV and for 6 succeeding months reported clinical performance for both procedures. ILP success was defined as obtaining a sample on the first attempt with <1000 red blood cells per high-power field or fluid described as clear. CIV success was defined as placement of a functioning catheter on the first try. Each group served as the control group for the procedure for which they did not receive the intervention., Results: Two-hundred interns participated (104 in the ILP group and 96 in the CIV group). Together, they reported 409 procedures. ILP success rates were 34% (31 of 91) for interns who received ILP mastery learning and 34% (25 of 73) for controls (difference: 0.2% [95% confidence interval: -0.1 to 0.1]). The CIV success rate was 54% (62 of 115) for interns who received CIV mastery learning compared with 50% (58 of 115) for controls (difference: 3% [95% confidence interval: -10 to 17])., Conclusions: Participation in a single SBME mastery learning session was insufficient to affect pediatric interns' subsequent procedural success.

Objective: To design an instrument for scoring residents learning pediatric disaster triage (PDT), and to test the validity and reliability of the instrument., Methods: We designed a checklist-based scoring instrument including PDT knowledge and skills and performance, as well as a global assessment. Learners' performance in a 10-patient school bus crash simulation was video recorded and scored with the instrument. Learners triaged the patients with a color-coded algorithm (JumpSTART, Simple Triage and Rapid Treatment). Three evaluators observed the recordings and scored triage performance for each learner. Internal and construct validity of the instrument were established via comparison of resident performance by postgraduate year (PGY) and correlating instrument items with overall score. Validity was assessed with analysis of variance and the D statistic. We calculated evaluators' intraclass correlation coefficient (ICC) for each patient, skill, triage decision, and global assessment., Results: There were 37 learners and 111 observations. There was no difference in total scores by PGY (P = .77), establishing internal validity. Regarding construct validity, most instrument items had a D statistic of >0.5. The overall ICC among scores was 0.83 (95% confidence interval [CI] 0.74-0.89). Individual patient score reliability was high and was greatest among patients with head injury (ICC 0.86; 95% CI 0.79-0.91). Reliability was low for an ambulatory patient (ICC 0.29; 95% CI 0.07-0.48). Triage skills evaluation showed excellent reliability, including airway management (ICC 0.91; 95% CI 0.86-0.94) and triage speed (ICC 0.81; 95% CI 0.72-0.88). The global assessment had moderate reliability for skills (ICC 0.63; 95% CI 0.47-0.75) and knowledge (ICC 0.64; 95% CI 0.49-0.76)., Conclusions: We report the validity and reliability testing of a PDT-scoring instrument. Validity was confirmed with no performance differential by PGY. Reliability of the scoring instrument for most patient-level triage, knowledge, and specific skills was high., (Copyright © 2013 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.)

Objective: The authors sought to determine if capnography could improve time to correction of a simulated endotracheal tube (ETT) dislodgement by pediatric residents., Study Design: Pediatric residents attended a didactic session that included interpretation of capnography. A randomized controlled study was then performed using patient simulators. Residents were randomized to standard monitoring (control group) or standard monitoring plus capnography (intervention group). The primary outcome was time to correction of ETT dislodgement. Correction of dislodgement prior to decline in pulse oximetry was our secondary outcome., Results: Twenty-seven subjects completed the simulation. Subjects in the intervention group corrected the ETT dislodgement faster than those in the control group (2.38 minutes vs 3.92 minutes, P = .02). There were no differences in time to correction based on postgraduate year, clinical experiences, or comfort with capnography. Two subjects corrected the dislodgement prior to changes in pulse oximetry, both from the intervention group. Fifty-nine percent of subjects had seen capnography used in the past and 82% felt very or somewhat comfortable with capnography., Conclusion: Capnography decreased time to correction of ETT dislodgement by pediatric residents. Capnography should be considered as an essential monitoring device for intubated patients to enhance patient safety., (Copyright © 2012 Mosby, Inc. All rights reserved.)