Back to Search Start Over

A Novel Approach for Mixed‐Methods Research Using Large Language Models: A Report Using Patients' Perspectives on Barriers to Arthroplasty.

Authors :
Mannstadt, Insa
Goodman, Susan M.
Rajan, Mangala
Young, Sarah R.
Wang, Fei
Navarro‐Millán, Iris
Mehta, Bella
Source :
ACR Open Rheumatology; Jun2024, Vol. 6 Issue 6, p375-379, 5p
Publication Year :
2024

Abstract

Objective: Mixed‐methods research is valuable in health care to gain insights into patient perceptions. However, analyzing textual data from interviews can be time‐consuming and require multiple analysts for investigator triangulation. This study aims to explore a novel approach to investigator triangulation in mixed‐methods research by employing a large language model (LLM) for analyzing data from patient interviews. Methods: This study compared the thematic analysis and survey generation performed by human investigators and ChatGPT‐4, which uses GPT‐4 as its backbone model, using data from an existing study that explored patient perceptions of barriers to arthroplasty. The human‐ and ChatGPT‐4–generated themes and surveys were compared and evaluated based on their representation of salient themes from a predetermined topic guide. Results: ChatGPT‐4 generated analogous dominant themes and a comprehensive corresponding survey as the human investigators but in significantly less time. The survey questions generated by ChatGPT‐4 were less precise than those developed by human investigators. The mixed‐methods flowchart proposes integrating LLMs and human investigators as a supplementary tool for the preliminary thematic analysis of qualitative data and survey generation. Conclusion: By utilizing a combination of LLMs and human investigators through investigator triangulation, researchers may be able to conduct more efficient mixed‐methods research to better understand patient perspectives. Ethical and qualitative implications of using LLMs should be considered. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
25785745
Volume :
6
Issue :
6
Database :
Complementary Index
Journal :
ACR Open Rheumatology
Publication Type :
Academic Journal
Accession number :
177841924
Full Text :
https://doi.org/10.1002/acr2.11662