1. Analysis of the interaction between elderly people and a simulated virtual coach
- Author
-
Begoña Fernandez Ruanova, Mikel De Velasco Vázquez, Anna Torp Johansen, Sergio Escalera, Eduardo González Fraile, Maria Stylianou Korsnes, Stephan Schlögl, Micaela Silva, Leila Zouari, Anna Esposito, Cristina Palmero, Gennaro Cordasco, Joffre Tenorio Laranga, María Inés Torres Barañano, Raquel Justo Blanco, Alain Vázquez Risco, European Commission, Justo, R, Ben Letaifa, L, Palmero, C., Gonzalez-Fraile, E, Torp Johansen, A., Vázquez, A., Cordasco, G., Schlögl, S., Fernández-Ruanova, B., Silva, M., Escalera, S., Develasco, M., Tenorio-Laranga, J., Esposito, A., Korsnes, M., and Torres, M. I.
- Subjects
Emotional analysis from speech, Human behavior analysis, Human–machine interaction, Language and face, Spanish ,human behavior analysis ,General Computer Science ,Operations research ,Horizon (archaeology) ,Computer science ,05 social sciences ,Computational intelligence ,02 engineering and technology ,spanish ,emotional analysis from speech ,language and face ,Human machine interaction ,0202 electrical engineering, electronic engineering, information engineering ,Elderly people ,media_common.cataloged_instance ,020201 artificial intelligence & image processing ,0501 psychology and cognitive sciences ,European union ,050107 human factors ,science ,media_common ,human-machine interaction - Abstract
The EMPATHIC project develops and validates new interaction paradigms for personalized virtual coaches (VC) to promote healthy and independent aging. To this end, the work presented in this paper is aimed to analyze the interaction between the EMPATHIC-VC and the users. One of the goals of the project is to ensure an end-user driven design, involving senior users from the beginning and during each phase of the project. Thus, the paper focuses on some sessions where the seniors carried out interactions with a Wizard of Oz driven, simulated system. A coaching strategy based on the GROW model was used throughout these sessions so as to guide interactions and engage the elderly with the goals of the project. In this interaction framework, both the human and the system behavior were analyzed. The way the wizard implements the GROW coaching strategy is a key aspect of the system behavior during the interaction. The language used by the virtual agent as well as his or her physical aspect are also important cues that were analyzed. Regarding the user behavior, the vocal communication provides information about the speaker's emotional status, that is closely related to human behavior and which can be extracted from the speech and language analysis. In the same way, the analysis of the facial expression, gazes and gestures can provide information on the non verbal human communication even when the user is not talking. In addition, in order to engage senior users, their preferences and likes had to be considered. To this end, the effect of the VC on the users was gathered by means of direct questionnaires. These analyses have shown a positive and calm behavior of users when interacting with the simulated virtual coach as well as some difficulties of the system to develop the proposed coaching strategy. The research presented in this paper is conducted as part of the project EMPATHIC that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement no 769872.
- Published
- 2020