1. GPT-4 shows potential for identifying social anxiety from clinical interview data.
- Author
-
Ohse J, Hadžić B, Mohammed P, Peperkorn N, Fox J, Krutzki J, Lyko A, Mingyu F, Zheng X, Rätsch M, and Shiban Y
- Subjects
- Humans, Male, Female, Adult, Middle Aged, Surveys and Questionnaires, Self Report, Young Adult, Artificial Intelligence, Natural Language Processing, Aged, Phobia, Social diagnosis, Anxiety diagnosis
- Abstract
While the potential of Artificial Intelligence (AI)-particularly Natural Language Processing (NLP) models-for detecting symptoms of depression from text has been vastly researched, only a few studies examine such potential for the detection of social anxiety symptoms. We investigated the ability of the large language model (LLM) GPT-4 to correctly infer social anxiety symptom strength from transcripts obtained from semi-structured interviews. N = 51 adult participants were recruited from a convenience sample of the German population. Participants filled in a self-report questionnaire on social anxiety symptoms (SPIN) prior to being interviewed on a secure online teleconference platform. Transcripts from these interviews were then evaluated by GPT-4. GPT-4 predictions were highly correlated (r = 0.79) with scores obtained on the social anxiety self-report measure. Following the cut-off conventions for this population, an F
1 accuracy score of 0.84 could be obtained. Future research should examine whether these findings hold true in larger and more diverse datasets., Competing Interests: Competing interests: The authors declare no competing interests., (© 2024. The Author(s).)- Published
- 2024
- Full Text
- View/download PDF