Search

The evaluation of teaching can be an essential driver for curriculum development. Instruments for teaching evaluation are not only used for the purpose of quality assurance but also in the context of medical education research. Therefore, they must meet the common requirements for reliability and validity. This position paper from the GMA Teaching Evaluation Committee discusses strategic and methodological aspects of evaluation in the context of undergraduate medical education and related courses; and formulates recommendations for the further development of evaluation. First, a four-step approach to the design and implementation of evaluations is presented, then methodological and practical aspects are discussed in more detail. The focus here is on target and confounding variables, survey instruments as well as aspects of implementation and data protection. Finally, possible consequences from evaluation data for the four dimensions of teaching quality (structural and procedural aspects, teachers and outcomes) are discussed. [ABSTRACT FROM AUTHOR]

Objective: Clinical reasoning is an essential skill, the foundations of which should be acquired during medical school. Within the format of test-based learning, such examinations can also be used to support the long-term retention of procedural knowledge necessary for clinical reasoning. The aim was to investigate whether repeated exposure to clinical cases in obstetrics and gynecology (OBGYN) with built-in questions leads to higher learning outcome than pure reading cases and what influence the delay between the intervention and the final test has on the retention of the respective content.Methods: In this non-randomised crossover study, 5th-year medical students (duration of the study is 6 years) taking a 1-week clinical attachment in OBGYN participated in computer-based case seminars in winter term 2020/2021, in which different case histories on gynecological-obstetric diseases were presented. Case content was identical for all groups, but the presentation format (cases with key feature questions vs read-only cases) of individual case vignettes changed weekly. The also intervention was repeated after 2 weeks for each group. Knowledge was assessed in an entry and an exit exam consisting of 40 short-answer questions.Results: A total of 94 out of 118 eligible students participated in the study (response rate: 79.7%). Learning outcome was significantly higher for items presented in the key feature format compared to items presented as read-only cases (74.2 ± 8.6% vs. 71.0 ± 9.2%; p = 0.017). Furthermore, the analysis showed that the temporal distance of the intervention package from the final examination had no influence on retention.Conclusion: This is the first study to demonstrate an effect of test-enhanced learning on clinical reasoning in the subject of OGBYN. In this cross-over study, repeated testing was more effective than repeated case-based learning alone. Curricular implementation of longitudinal key feature testing can thus improve learning outcomes for OBGYN. [ABSTRACT FROM AUTHOR]

Background: We used two 3D ultrasound volumes of fetal heads at 13 weeks to create live-size 3D-printed phantoms with a view to training or assessment of diagnostic abilities for normal and abnormal nuchal translucency measurements. The phantoms are suitable for use in a water bath, imitating a real-life exam. They were then used to study measurement accuracy and reproducibility in examiners of different skill levels.Ultrasound scans of a 13 + 0-week fetus were processed using 3D Slicer software, producing a stereolithography file for 3D printing. The model, crafted in Autodesk Fusion360™, adhered to FMF guidelines for NT dimensions (NT 2.3 mm). Additionally, a model with pathologic NT was designed (NT 4.2 mm). Printing was performed via Formlabs Form 3® printer using High Temp Resin V2. The externally identical looking 3D models were embedded in water-filled condoms for ultrasound examination. Eight specialists of varying expertise levels conducted five NT measurements for each model, classifying them in physiological and abnormal models.Classification of the models in physiological or abnormal NT resulted in a detection rate of 100%. Average measurements for the normal NT model and the increased NT model were 2.27 mm (SD ± 0.38) and 4.165 mm (SD ± 0.51), respectively. The interrater reliability was calculated via the intraclass correlation coefficient (ICC) which yielded a result of 0.883, indicating robust agreement between the raters. Cost-effectiveness analysis demonstrated the economical nature of the 3D printing process.This study underscores the potential of 3D printed fetal models for enhancing ultrasound training through high inter-rater reliability, consistency across different expert levels, and cost-effectiveness. Limitations, including population variability and direct translation to clinical outcomes, warrant further exploration. The study contributes to ongoing discussions on integrating innovative technologies into medical education, offering a practical and economical method to acquire, refine and revise diagnostic skills in prenatal ultrasound. Future research should explore broader applications and long-term economic implications, paving the way for transformative advancements in medical training and practice.Methods: We used two 3D ultrasound volumes of fetal heads at 13 weeks to create live-size 3D-printed phantoms with a view to training or assessment of diagnostic abilities for normal and abnormal nuchal translucency measurements. The phantoms are suitable for use in a water bath, imitating a real-life exam. They were then used to study measurement accuracy and reproducibility in examiners of different skill levels.Ultrasound scans of a 13 + 0-week fetus were processed using 3D Slicer software, producing a stereolithography file for 3D printing. The model, crafted in Autodesk Fusion360™, adhered to FMF guidelines for NT dimensions (NT 2.3 mm). Additionally, a model with pathologic NT was designed (NT 4.2 mm). Printing was performed via Formlabs Form 3® printer using High Temp Resin V2. The externally identical looking 3D models were embedded in water-filled condoms for ultrasound examination. Eight specialists of varying expertise levels conducted five NT measurements for each model, classifying them in physiological and abnormal models.Classification of the models in physiological or abnormal NT resulted in a detection rate of 100%. Average measurements for the normal NT model and the increased NT model were 2.27 mm (SD ± 0.38) and 4.165 mm (SD ± 0.51), respectively. The interrater reliability was calculated via the intraclass correlation coefficient (ICC) which yielded a result of 0.883, indicating robust agreement between the raters. Cost-effectiveness analysis demonstrated the economical nature of the 3D printing process.This study underscores the potential of 3D printed fetal models for enhancing ultrasound training through high inter-rater reliability, consistency across different expert levels, and cost-effectiveness. Limitations, including population variability and direct translation to clinical outcomes, warrant further exploration. The study contributes to ongoing discussions on integrating innovative technologies into medical education, offering a practical and economical method to acquire, refine and revise diagnostic skills in prenatal ultrasound. Future research should explore broader applications and long-term economic implications, paving the way for transformative advancements in medical training and practice.Results: We used two 3D ultrasound volumes of fetal heads at 13 weeks to create live-size 3D-printed phantoms with a view to training or assessment of diagnostic abilities for normal and abnormal nuchal translucency measurements. The phantoms are suitable for use in a water bath, imitating a real-life exam. They were then used to study measurement accuracy and reproducibility in examiners of different skill levels.Ultrasound scans of a 13 + 0-week fetus were processed using 3D Slicer software, producing a stereolithography file for 3D printing. The model, crafted in Autodesk Fusion360™, adhered to FMF guidelines for NT dimensions (NT 2.3 mm). Additionally, a model with pathologic NT was designed (NT 4.2 mm). Printing was performed via Formlabs Form 3® printer using High Temp Resin V2. The externally identical looking 3D models were embedded in water-filled condoms for ultrasound examination. Eight specialists of varying expertise levels conducted five NT measurements for each model, classifying them in physiological and abnormal models.Classification of the models in physiological or abnormal NT resulted in a detection rate of 100%. Average measurements for the normal NT model and the increased NT model were 2.27 mm (SD ± 0.38) and 4.165 mm (SD ± 0.51), respectively. The interrater reliability was calculated via the intraclass correlation coefficient (ICC) which yielded a result of 0.883, indicating robust agreement between the raters. Cost-effectiveness analysis demonstrated the economical nature of the 3D printing process.This study underscores the potential of 3D printed fetal models for enhancing ultrasound training through high inter-rater reliability, consistency across different expert levels, and cost-effectiveness. Limitations, including population variability and direct translation to clinical outcomes, warrant further exploration. The study contributes to ongoing discussions on integrating innovative technologies into medical education, offering a practical and economical method to acquire, refine and revise diagnostic skills in prenatal ultrasound. Future research should explore broader applications and long-term economic implications, paving the way for transformative advancements in medical training and practice.Discussion: We used two 3D ultrasound volumes of fetal heads at 13 weeks to create live-size 3D-printed phantoms with a view to training or assessment of diagnostic abilities for normal and abnormal nuchal translucency measurements. The phantoms are suitable for use in a water bath, imitating a real-life exam. They were then used to study measurement accuracy and reproducibility in examiners of different skill levels.Ultrasound scans of a 13 + 0-week fetus were processed using 3D Slicer software, producing a stereolithography file for 3D printing. The model, crafted in Autodesk Fusion360™, adhered to FMF guidelines for NT dimensions (NT 2.3 mm). Additionally, a model with pathologic NT was designed (NT 4.2 mm). Printing was performed via Formlabs Form 3® printer using High Temp Resin V2. The externally identical looking 3D models were embedded in water-filled condoms for ultrasound examination. Eight specialists of varying expertise levels conducted five NT measurements for each model, classifying them in physiological and abnormal models.Classification of the models in physiological or abnormal NT resulted in a detection rate of 100%. Average measurements for the normal NT model and the increased NT model were 2.27 mm (SD ± 0.38) and 4.165 mm (SD ± 0.51), respectively. The interrater reliability was calculated via the intraclass correlation coefficient (ICC) which yielded a result of 0.883, indicating robust agreement between the raters. Cost-effectiveness analysis demonstrated the economical nature of the 3D printing process.This study underscores the potential of 3D printed fetal models for enhancing ultrasound training through high inter-rater reliability, consistency across different expert levels, and cost-effectiveness. Limitations, including population variability and direct translation to clinical outcomes, warrant further exploration. The study contributes to ongoing discussions on integrating innovative technologies into medical education, offering a practical and economical method to acquire, refine and revise diagnostic skills in prenatal ultrasound. Future research should explore broader applications and long-term economic implications, paving the way for transformative advancements in medical training and practice. [ABSTRACT FROM AUTHOR]

Despite ultrasound being an inherent part of medical education, only a few German medical schools have established a comprehensive ultrasound curriculum. This study aimed to explore medical students' perspectives on ultrasound in medical education (USMed). Questionnaire and Distribution. An anonymous, voluntary online survey was developed to collect information regarding student opinions on USMed. The survey consisted of 17 questions, structured into three sections. In total, 1040 questionnaires from 31 medical schools (of total 37) were completed. Between January 1st, 2019 und June 30th, 2019, an online survey was conducted among German medical students via the students' associations and their respective teaching facilities. The survey consisted of 17 items regarding USMed. Statements were rated on a 4-point Likert scale for agreement. In total, 1040 students from 31 German medical faculties participated. The majority (1021, 98.2%) reported a very high to high interest in curricular USMed. Students agreed (n = 945, 90.9%) that USMed would be helpful along their entire course of medical studies. Considering the best starting time for USMed, the opinions of German medical students diverged: students studying in a model curriculum preferred to start in the second year (40.7%) while 49%of the students studying in a traditional curriculum preferred to start in the third year (p ≤ 0.001). An insufficient allotment of time for USMed in the planned curriculum (675, 65%) and a lack of courses run by medical faculty (305, 29.4%) were listed as perceived significant barriers to the participation in USMed. Peer teaching was regarded as an effective method in realizing USMed by 731 (70.3%) students. German medical students are very interested and willing to participate in USMed. There appears to be a high demand for US courses offered by medical schools. [ABSTRACT FROM AUTHOR]