On the Effectiveness of an AI-Driven Educational Resource Recommendation System for Higher Education

Authors :: International Association for Development of the Information Society (IADIS)
Schrumpf, Johannes
Source :: International Association for Development of the Information Society. 2022Paper presented at the International Conference on Cognition and Exploratory Learning in Digital Age (CELDA) (19th, 2022).
Publication Year :: 2022
Abstract: Digital resources offer a vast assortment of educational opportunities for students in higher education. From 2018 to 2022, a digital study assistant (DSA), named SIDDATA, was developed at three German universities and consequently field-tested. One of the DSA's features is an AI-driven natural language interface for educational resource recommendation. This paper performs an analysis of the effectiveness of recommendations, by analyzing data generated over the course of two years of DSA usage. We find that although initial user interest is high, only a small percentage of users engage with the recommendation feature. Furthermore, we find that quality of recommendations was perceived as mixed to negative.

Language :: English
Database :: ERIC
Journal :: International Association for Development of the Information Society
Publication Type :: Conference
Accession number :: ED626903
Document Type :: Speeches/Meeting Papers<br />Reports - Evaluative

Tools