Search

Background: The aim of this study was to design and validate a new checklist and standardized scenario for assessing providers’ performance during Newborn Life Support (NLS). Methods: We invited twelve experts in Neonatology to take part in a three-step Delphi process. They rated the importance of each item of a newly designed assessment tool to evaluate participants’ performance during Newborn Life Support independently on a numeric rating scale from 1 to 5 (1 = lowest; 5 = highest) and were able to give additional comments. All items achieving a mean rating below four after the third round were deleted. For the reliability of the checklist, we calculated interrater reliability. Results: Using a standardized Delphi process, we revised the initial checklist according to the experts’ ratings and comments. The final assessment tool includes 38 items covering all relevant steps during NLS. The mean expert rating of all items was 4.40. Interrater reliability showed substantial agreement between the two raters in the first draft (κ = 0.80) as well as in the final draft of the checklist (κ = 0.73). Conclusion: We designed a feasible assessment tool for evaluating performance during NLS. We proved the checklist to be valid and reasonable using a Delphi validation process and calculating interrater reliability.

BackgroundEye-tracking devices are an innovative tool to understand providers’ attention during stressful medical tasks. The knowledge about what gaze behaviors improve (or harm) the quality of clinical care can substantially improve medical training. The aim of this study is to identify gaze behaviors that are related to the quality of pediatric resuscitation.MethodsForty students and healthcare providers performed a simulated pediatric life support scenario, consisting of a chest compression task and a ventilation task, while wearing eye-tracking glasses. Skill Reporter software measured chest compression (CC) quality and Neo Training software measured ventilation quality. Main eye-tracking parameters were ratio [the number of participants who attended a certain area of interest (AOI)], dwell time (total amount of time a participant attended an AOI), the number of revisits (how often a participant returned his gaze to an AOI), and the number of transitions between AOIs.ResultsThe most salient AOIs were infant chest and ventilation mask (ratio = 100%). During CC task, 41% of participants also focused on ventilation bag and 59% on study nurse. During ventilation task, the ratio was 61% for ventilation bag and 36% for study nurse. Percentage of correct CC rate was positively correlated with dwell time on infant chest (p = 0.044), while the overall CC quality was negatively correlated with dwelling outside of pre-defined task-relevant AOIs (p = 0.018). Furthermore, more dwell time on infant chest predicted lower leakage (p = 0.042). The number of transitions between AOIs was unrelated to CC parameters, but correlated negatively with mask leak during ventilations (p = 0.014). Participants with high leakage shifted their gaze more often between ventilation bag, ventilation mask, and task-irrelevant environment.ConclusionInfant chest and ventilation mask are the most salient AOIs in pediatric basic life support. Especially the infant chest AOI gives beneficial information for the resuscitation provider. In contrast, attention to task-irrelevant environment and frequent gaze shifts seem to harm the quality of care.