Search

Background: The diagnosis of inflammatory rheumatic diseases (IRDs) is often delayed due to unspecific symptoms and a shortage of rheumatologists. Digital diagnostic decision support systems (DDSSs) have the potential to expedite diagnosis and help patients navigate the health care system more efficiently., Objective: The aim of this study was to assess the diagnostic accuracy of a mobile artificial intelligence (AI)-based symptom checker (Ada) and a web-based self-referral tool (Rheport) regarding IRDs., Methods: A prospective, multicenter, open-label, crossover randomized controlled trial was conducted with patients newly presenting to 3 rheumatology centers. Participants were randomly assigned to complete a symptom assessment using either Ada or Rheport. The primary outcome was the correct identification of IRDs by the DDSSs, defined as the presence of any IRD in the list of suggested diagnoses by Ada or achieving a prespecified threshold score with Rheport. The gold standard was the diagnosis made by rheumatologists., Results: A total of 600 patients were included, among whom 214 (35.7%) were diagnosed with an IRD. Most frequent IRD was rheumatoid arthritis with 69 (11.5%) patients. Rheport's disease suggestion and Ada's top 1 (D1) and top 5 (D5) disease suggestions demonstrated overall diagnostic accuracies of 52%, 63%, and 58%, respectively, for IRDs. Rheport showed a sensitivity of 62% and a specificity of 47% for IRDs. Ada's D1 and D5 disease suggestions showed a sensitivity of 52% and 66%, respectively, and a specificity of 68% and 54%, respectively, concerning IRDs. Ada's diagnostic accuracy regarding individual diagnoses was heterogenous, and Ada performed considerably better in identifying rheumatoid arthritis in comparison to other diagnoses (D1: 42%; D5: 64%). The Cohen κ statistic of Rheport for agreement on any rheumatic disease diagnosis with Ada D1 was 0.15 (95% CI 0.08-0.18) and with Ada D5 was 0.08 (95% CI 0.00-0.16), indicating poor agreement for the presence of any rheumatic disease between the 2 DDSSs., Conclusions: To our knowledge, this is the largest comparative DDSS trial with actual use of DDSSs by patients. The diagnostic accuracies of both DDSSs for IRDs were not promising in this high-prevalence patient population. DDSSs may lead to a misuse of scarce health care resources. Our results underscore the need for stringent regulation and drastic improvements to ensure the safety and efficacy of DDSSs., Trial Registration: German Register of Clinical Trials DRKS00017642; https://drks.de/search/en/trial/DRKS00017642., (©Johannes Knitza, Koray Tascilar, Franziska Fuchs, Jacob Mohn, Sebastian Kuhn, Daniela Bohr, Felix Muehlensiepen, Christina Bergmann, Hannah Labinsky, Harriet Morf, Elizabeth Araujo, Matthias Englbrecht, Wolfgang Vorbrüggen, Cay-Benedict von der Decken, Stefan Kleinert, Andreas Ramming, Jörg H W Distler, Peter Bartz-Bazzanella, Nicolas Vuillerme, Georg Schett, Martin Welcker, Axel Hueber. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 23.07.2024.)

Background: The development and potential of artificial intelligence (AI) is remarkable. Its application in all medical disciplines, including rheumatology, is attracting attention. To what extent AI is already used in clinical routine in rheumatology is unknown. In addition, the perceived barriers, potentials, and expectations regarding AI by rheumatologists have not yet been studied. Objectives: To examine the current usage and perceived barriers and facilitators of AI, including large language models (LLMs), among rheumatologists. Design: National, observational, non-interventional, and cross-sectional web-based study. Methods: A web-based survey was developed by the Working Group Young Rheumatology (AGJR) of the German Society for Rheumatology. The survey was distributed at the Congress of the German Society for Rheumatology and via social media, QR code, and email from August 30 until November 4, 2023. Results: Responses from 172 rheumatologists (55% female; mean age 43 years) were analyzed. The majority stated that they did not previously use AI (73%) in their daily practice. Eighty-eight percent of rheumatologists rated their AI knowledge as low to intermediate and 84% would welcome dedicated training on LLMs. The majority of rheumatologists anticipated AI implementation to improve patient care (60%) and reduce daily workload (62%). Especially for diagnosis (73%), writing medical reports (70%), and data analysis (70%), rheumatologists reported a potential positive benefit of AI. Main AI concerns addressed the responsibility for medical decisions (64%) and data security (58%). Conclusion: Overall, the results indicate that rheumatologists currently have little AI knowledge and make very little use of AI in clinical routine. However, the majority of rheumatologists anticipate positive AI effects and would welcome increased AI implementation and dedicated training programs. [ABSTRACT FROM AUTHOR]