Search

Purpose: With the increasing adoption of artificial intelligence (AI) in various domains, including healthcare, there is growing acceptance and interest in consulting AI models to provide medical information and advice. This study aimed to evaluate the accuracy of ChatGPT's responses to practice quiz questions designed for otolaryngology board certification and decipher potential performance disparities across different otolaryngology subspecialties. Methods: A dataset covering 15 otolaryngology subspecialties was collected from an online learning platform funded by the German Society of Oto-Rhino-Laryngology, Head and Neck Surgery, designed for board certification examination preparation. These questions were entered into ChatGPT, with its responses being analyzed for accuracy and variance in performance. Results: The dataset included 2576 questions (479 multiple-choice and 2097 single-choice), of which 57% (n = 1475) were answered correctly by ChatGPT. An in-depth analysis of question style revealed that single-choice questions were associated with a significantly higher rate (p < 0.001) of correct responses (n = 1313; 63%) compared to multiple-choice questions (n = 162; 34%). Stratified by question categories, ChatGPT yielded the highest rate of correct responses (n = 151; 72%) in the field of allergology, whereas 7 out of 10 questions (n = 65; 71%) on legal otolaryngology aspects were answered incorrectly. Conclusion: The study reveals ChatGPT's potential as a supplementary tool for otolaryngology board certification preparation. However, its propensity for errors in certain otolaryngology areas calls for further refinement. Future research should address these limitations to improve ChatGPT's educational use. An approach, with expert collaboration, is recommended for the reliable and accurate integration of such AI models. [ABSTRACT FROM AUTHOR]

Copyright of HNO is the property of Springer Nature and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Purpose: SARS-CoV-2 is detected on the mucosa of the upper airways to a high degree. In the course of the COVID-19 pandemic, otorhinolaryngologists (ORL) are assumed to be at high risk due to close contact with the mucosa of the upper airways. No data are yet available providing evidence that ORLs have an increased risk of infection. Methods: German ORLs were invited via e-mail through the German Society of ORL, Head and Neck Surgery and the German ENT Association to participate in a web-based survey about infection with SARS-CoV-2 and development of COVID-19. Data of infections and concomitant parameters in German ORLs were collected and compared to the total number of infections in Germany. Results: Out of 6383 German ORLs, 970 (15%) participated. 54 ORLs reported testing positive for SARS-CoV-2. Compared to the total population of Germany, ORLs have a relative risk of 3.67 (95% CI 2.82; 4.79) of contracting SARS-CoV-2. Domestic quarantine was conducted in 96.3% of cases. Two individuals were admitted to hospital without intensive care. No casualties were reported. In 31 cases, the source of infection was not identifiable whereas 23 had a clear medical aetiology: infected patients: n = 5, 9.26%; medical staff: n = 13, 14.1%. 9.26% (n = 5) of the identified cases were related to contact to infected family members (n = 3), closer neighbourhood (n = 1) or general public (n = 1). There was no identified increased risk of infection due to performing surgery. Conclusion: German ORLs have an almost 3.7-fold risk of contracting SARS-CoV-2 compared to the population baseline level. Appropriate protection appears to be necessary for this occupational group. [ABSTRACT FROM AUTHOR]