Search

People living with dementia are at risk of social isolation, and conversational AI agents can potentially support such individuals by reducing their loneliness. In our study, a conversational AI agent, called MindTalker, co-designed with therapists and utilizing the GPT-4 Large Language Model (LLM), was developed to support people with early-stage dementia, allowing them to experience a new type of “social relationship” that could be extended to real life. Eight PwD engaged with MindTalker for one month or even longer, and data was collected from interviews. Our findings emphasized that participants valued the novelty of AI, but sought more consistent, deeper interactions. They desired a personal touch from AI, while stressing the irreplaceable value of human interactions. The findings underscore the complexities of AI engagement dynamics, where participants commented on the artificial nature of AI, highlighting important insights into the future design of conversational AI for this population.

Navigation systems often aid users when traveling in unfamiliar locations. Current navigation systems tend to focus on identifying the shortest or fastest routes between two points. However, path cost expressed in terms of length and distance (i.e., the utilitarian qualities of travel) is only one attribute which could be used in route recommendation. Recent years have seen navigation systems moving beyond such utilitarian attributes. These include systems aimed at providing users with scenic, safe or attractive routes among other dimensions. In this paper, we contribute to the existing research domain by providing an overview of the different quality-aware route navigation systems that have been proposed in past research for pedestrians. In particular, we examine the different qualities which have been used as key criteria in route recommendation. As the outcome of the paper, we provide a categorization of these systems based on our proposed SWEEP taxonomy. In addition, we outline the various data sources, algorithms and evaluation approaches that have been used to implement quality-aware route navigation systems. Afterwards, we conclude by discussing potential problems encountered in previous studies and highlight promising directions for future research.

While conversational agents have traditionally been used for simple tasks such as scheduling meetings and customer service support, recent advancements have led researchers to examine their use in complex social situations, such as to provide emotional support and companionship. For mourners who could be vulnerable to the sense of loneliness and disruption of self-identity, such technology offers a unique way to help them cope with grief. In this study, we explore the potential benefits and risks of such a practice, through semi-structured interviews with 10 mourners who actively used chatbots at different phases of their loss. Our findings indicated seven approaches in which chatbots were used to help people cope with grief, by taking the role of listener, acting as a simulation of the deceased, romantic partner, friend and emotion coach. We then highlight how interacting with the chatbots impacted mourners’ grief experience and conclude the paper with further research opportunities.

It is estimated that 55 million people are living with dementia worldwide in 2021, and the numbers are expected to rise to 78 million in 2030 and 139 million in 2050 (Siriaraya et al., 2022; World Health Organisation, 2022). Dementia is an umbrella term that describes neurodegenerative disorders that impact memory, cognition, language, and behaviour (Beck et al., 1998; Cohen-Mansfield, 2001; Kane, 2001). Along with symptoms of dementia such as forgetfulness, disorientation and communication, People with Dementia (PwD) often lose their sense of autonomy and capacity to make decisions in various or all aspects of their life (Garcia-Palacios et al., 2002; Jones et al., 2015). Currently, there is no cure for dementia. Thus, promoting well-being in PwD or Quality of Life (QoL) is considered a quintessential measure of effective dementia care (Van Nieuwenhuizen and Nijman, 2009). QoL for dementia care is multifaceted, which includes measures related to i. physical comfort, hygiene, and wellbeing, ii. safety, security, and order, iii. maintaining a sense of autonomy, dignity, and privacy, as well as iv. living a meaningful life, individuality, maintaining relationships, and enjoyment (Kane, 2001). However, such measures of QoL can be challenging to achieve due to the complexity of dementia symptoms (i.e. cognitive decline, losing the ability to communicate, behaviour that challenges, etc.) (Hennelly et al., 2021) and families’ burden of caring for PwD against other competing priorities (Sury et al., 2013). In the case of institutionalised care, care settings suffer from understaffing and a low retention rate (Brown Wilson, 2009; Bunn et al., 2020), which leads care settings to focus on delivering everyday care (i.e. physical safety, assistance in eating and bathing) over other psychosocial QoL measures (Hicks et al., 2022). As such, there is an immense need to develop tools, interventions, and solutions to preserve and promote PwD’s QoL and overall physical, emotional and

Losing a loved one through death is known to be one of the most challenging life events. To help the bereaved and their therapists monitor and better understand the factors that contribute to Prolonged Grief Disorder (PGD), we co-designed and studied a web-based explainable AI screening system named “Grief Inquiries Following Tragedy (GIFT).” We used an initial iteration of the system to collect PGD-related data from 611 participants. Using this data, we developed a model that could be used to screen and explain the different factors contributing to PGD. Our results showed that a Random Forest model using Bereavement risk and outcome features performed best in detecting PGD (AUC=0.772), with features such as a negative intepretation of grief and the ability to integrate stressful life events contributing strongly to the model. Afterwards, five grief experts were asked to provide feedback on a mock-up of the results generated by the GIFT model, and discuss the potential value of the explanatory AI model in real-world PGD care. Overall, the grief experts were generally receptive towards using such a tool in a clinical setting and acknowledged the benefit of offering a personalized result to the users based on the explainable AI model. Our results also showed that, in addition to the explainability of the model, the grief experts also preferred a more “empathetic” and “actionable” AI system, especially, when designing for patient end-users.

The loss of autonomy that comes with being in the care of others has a significant impact on the emotional well-being of people with dementia (PwD). Our research aims to investigate key design factors when creating Virtual Reality (VR) non-pharmacological interventions to improve their emotional wellbeing and enhance their interactions with caregivers. This paper, presents the iterative design and initial evaluation of a VR system aiming to enhance the procedure of admitting VR interventions.

Mindless eating, or the lack of awareness of the food we are consuming, has been linked to health problems attributed to unhealthy eating behaviour, including obesity. Traditional approaches used to moderate eating behaviour often rely on inaccurate self-logging, manual observations or bulky equipment. Overall, there is a clear unmet clinical need to develop an intelligent and lightweight system which can automatically monitor eating behaviour and provide feedback. In this paper, we investigate: i) the development of an automated system for detecting eating behaviour using wearable Electromyography (EMG) sensors, and ii) the application of the proposed system combined with real-time wristband haptic feedback to facilitate mindful eating. For this, the collected data from 16 participants were used to develop an algorithm for detecting chewing and swallowing. We extracted 18 features from EMG which were presented to different classifiers, to develop a system enabling participants to self-moderate their chewing behaviour using haptic feedback. An additional experimental study was conducted with 20 further participants to evaluate the effectiveness of eating monitoring and haptic interface in promoting mindful eating. We used a standard validation scheme with a leave-one-participant-out to assess model performance using standard metrics (F1-score). The proposed algorithm automatically assessed eating behaviour accurately using the EMG-extracted features and a Support Vector Machine (SVM): F1-Score=0.95 for chewing classification, and F1-Score=0.87 for swallowing classification. The experimental study showed that participants exhibited a lower rate of chewing when haptic feedback was delivered in the form of wristband vibration, compared to a baseline and non-haptic condition (F (2,38) = 58.243, p <.001). These findings may have major implications for research in eating behaviour, providing key insights into the impact of automatic chewing detection and haptic feedback s

Despite the substantial research interest in using Virtual Reality (VR) in healthcare in general and in Psychological, Cognitive, and Behavioral (PC&B) interventions in specific, as well as emerging research supporting the efficacy of VR in healthcare, the design process of translating therapies into VR to meet the needs of critical stakeholders such as users and clinicians is rarely addressed. In this paper, we aim to shed light onto the design needs, opportunities and challenges in designing efficient and effective PC&B-VR interventions. Through analyzing the co-design processes of four user-centered PC&B-VR interventions, we examined how therapies were adapted into VR to meet stakeholders’ requirements, explored design elements for meaningful experiences, and investigated how the understanding of healthcare contexts contribute to the VR intervention design. This paper presents the HCI research community with design opportunities and challenges as well as future directions for PC&B-VR intervention design.

While there has been increasing interest in the use of gamification in mental health care, there is a lack of design knowledge on how elements from games could be integrated into existing therapeutic treatment activities in a manner that is balanced and effective. To help address this issue, we propose a design process framework to support the development of mental health gamification. Based on the concept of experienced game versus therapy worlds, we highlight 4 different therapeutic components that could be gamified to increase user engagement. By means of a Dual-Loop model, designers can balance the therapeutic and game design components and design the core elements of a mental health care gamification. To support the proposed framework, 4 cases of game design in mental health care (eg, therapeutic protocols for addiction, anxiety, and low self-esteem) are presented.

Momentary photography is enjoyed by many smartphone users, especially with the popularity of apps such as Snapchat and Instagram. Many traditional positive psychology interventions focus on lengthy writing tasks to express positive emotions experienced during past events, acts of kindness and gratuitous situations. In this work we developed SnapAppy, a smartphone application to integrate momentary photography with traditional intervention methodologies to conduct a month-long positive psychology intervention to improve emotional well-being. A study involving 74 participants aimed to assess whether photo-taking, photo viewing and image contents are correlated with improvements in certain aspects of the participant’s emotional well-being including their mood, affect and satisfaction with life. The results indicated that features including the number of photos, the variety of categories, the effort applied to annotating photos, the number of photos revisited and photos taken of people were positively correlated with an improvement in the participant’s mood and positive and negative affect (PANAS).

Prolong Grief Disorder (PGD) is a condition in which mourners are stuck in the grief process for a prolonged period and continue to suffer from an intense, mal-adaptive level of grief. Despite the increased popularity of virtual mourning practices, and subsequently the emergence of HCI research in this area, there is little research looking into how continuing bonds maintained digitally promote or impede bereavement adjustment. Through a one-month diary study and in-depth interviews with 17 participants who recently lost their loved ones, we identified four broad mechanisms of how grievers engage in what we called "backstage" grieving (as opposed to bereavement through digital public space like social media). We further discuss how this personal and private grieving is important in maintaining emotional well-being hence avoiding developing PGD, as well as possible design opportunities and challenges for future digital tools to support grieving.

Motor imagery offers an excellent opportunity as a stimulus-free paradigm for brain-machine interfaces. Conventional electroencephalography (EEG) for motor imagery requires a hair cap with multiple wired electrodes and messy gels, causing motion artifacts. Here, we introduce a wireless scalp electronic system with virtual reality for real-time, continuous classification of motor imagery brain signals. This low-profile, portable system integrates imperceptible microneedle electrodes and soft wireless circuits. Virtual reality addresses subject variance in detectable EEG response to motor imagery by providing clear, consistent visuals and instant biofeedback. The wearable soft system offers advantageous contact surface area and reduced electrode impedance density, resulting in significantly enhanced EEG signals and classification accuracy. The combination with convolutional neural network-machine learning provides a real-time, continuous motor imagery-based brain-machine interface. With four human subjects, the scalp electronic system offers a high classification accuracy (93.22±1.33% for four classes), allowing wireless, real-time control of a virtual reality game.

Navigation systems often aid users when traveling in unfamiliar locations. Current navigation systems tend to focus on identifying the shortest or fastest routes between two points. However, path cost expressed in terms of length and distance (i.e., the utilitarian qualities of travel) is only one attribute which could be used in route recommendation. Recent years have seen navigation systems moving beyond such utilitarian attributes. These include systems aimed at providing users with scenic, safe or attractive routes among other dimensions. In this paper, we contribute to the existing research domain by providing an overview of the different quality-aware route navigation systems that have been proposed in past research for pedestrians. In particular, we examine the different qualities which have been used as key criteria in route recommendation. As the outcome of the paper, we provide a categorization of these systems based on our proposed SWEEP taxonomy. In addition, we outline the various data sources, algorithms and evaluation approaches that have been used to implement quality-aware route navigation systems. Afterwards, we conclude by discussing potential problems encountered in previous studies and highlight promising directions for future research., identifier:2169-3536

Virtual worlds offer much potential in supporting social interaction for older adults, particularly as a platform which can provide an interactive and immersive social experience. Yet, there has not been much work carried out to study the use, interaction and behavior of older people in 3D virtual world systems, especially studies which investigate their interactions in a fully functional virtual world. Most focus on issues related to usability such as cognitive difficulties when navigation in a 3D space and we know little about their perceptions and preferences when socializing in a virtual space. In this chapter, we report an experimental study examining the various factors which affected the social experience of older users in virtual worlds. The study involved 38 older participants engaging with a 3D and non-3D virtual grocery store. A mixed method of questionnaire and contextual interview was used for data collection and analysis. Overall, we found that physical presence was a significant predictor of many measures defining the quality of social interaction, yet participants often reported a sense of artificiality in their virtual experience. Interestingly, avatars were not considered directly important for social interaction and instead were only seen as a “place holder” to complete the tasks. Two factors contributed to this, the lack of non-verbal communication and the perceived difficulty in embodying physical people with virtual avatars.

Many people with dementia (PWD) residing in long-term care may face barriers in accessing experiences beyond their physical premises; this may be due to location, mobility constraints, legal mental health act restrictions, or offence-related restrictions. In recent years, there have been research interests towards designing non-pharmacological interventions aiming to improve the Quality of Life (QoL) for PWD within long-term care. We explored the use of Virtual Reality (VR) as a tool to provide 360°-video based experiences for individuals with moderate to severe dementia residing in a locked psychiatric hospital. We discuss at depth the appeal of using VR for PWD, and the observed impact of such interaction. We also present the design opportunities, pitfalls, and recommendations for future deployment in healthcare services. This paper demonstrates the potential of VR as a virtual alternative to experiences that may be difficult to reach for PWD residing within locked setting.

A novel sensor-based Internet of Educational Things (IoET) platform named OBSY was iteratively designed, developed and evaluated to support education in rural regions in Thailand. To assess the effectiveness of this platform, a study was carried out at four primary schools located near the Thai northern border with 244 students and 8 teachers. Participants were asked to carry out three science-based learning activities and were measured for improvements in learning outcome and learning engagement. Overall, the results showed that students in the IoET group who had used OBSY to learn showed significantly higher learning outcome and had better learning engagement than those in the control condition. In addition, for those in the IoET group, there was no significant effect regarding gender, home location (Urban or Rural), age, prior experience with technology and ethnicity on learning outcome. For learning engagement, only age was found to influence interest/enjoyment. The study demonstrated the potential of IoET technologies in underprivileged area, through a co-design approach with teachers and students, taking into account the local contexts.

Education plays an important role in helping developing nations reduce poverty and improving quality of life. Ubiquitous and mobile technologies could greatly enhance education in such regions by providing augmented access to learning. This paper presents a three-year iterative study where a ubiquitous sensor based learning platform was designed, developed and tested to support science learning among primary school students in underprivileged Northern Thailand. The platform is built upon the school’s existing mobile devices and was expanded to include sensor-based technology. Throughout the iterative design process, observations, interviews and group discussions were carried out with stakeholders. This lead to key reflections and design concepts such as the value of injecting anthropomorphic qualities into the learning device and providing personally and culturally relevant learning experiences through technology. Overall, the results outlined in this paper help contribute to knowledge regarding the design, development and implementation of ubiquitous sensor-based technology to support learning.

This paper reports on a study which investigated the effects of gesture-based avatar-mediated communication on younger users (12–13 years old), in comparison to video-mediated communication. Specifically, we looked at how these technologies were used by school pupils to brainstorm and negotiate ideas in a bullying context. 64 school pupils were divided into two conditions (Skype and AvatarKinect) and were instructed to carry out two tasks (a brainstorming and a negotiation task). Objective task performance, perceived satisfaction and perceived partner’s characteristics were compared. We found no difference in term of perceived satisfaction. AvatarKinect users reported more positive changes in perceptions toward their partner. The results on task performance were ambivalent; Skype users seemed to generate more ideas, whilst AvatarKinect produced better quality ideas. In summary, gesture-based avatar technology appears to be a useful modality to help resolve bullying in schools.

There is an increasing need to find innovative activities to help the older population maintain a healthy life. Virtual worlds, which can provide social engagement, entertainment and creativity as well as useful information and services for older people might offer a solution to this issue. Although emerging studies have begun to look into the benefits of virtual worlds in healthcare, little has been done in the context of older people. Based on semi-structured interviews and previous research on healthy aging, we identified and described in depth four areas in which virtual worlds could be useful to support older people. In general, it was found that virtual worlds could help empower older people to manage their disabilities, facilitate social engagement, provide mental stimulation and productive activities.

3D online multi-user virtual environments (MUVEs) have a lot of potential in supporting older people in their daily lives, yet little research has been conducted to explore how older people engage with this type of technology. This paper aims to investigate the characteristics, user groups and activity patterns (particularly social networks and gift giving behaviour) of older users within a 3D online multi-user virtual environment. Data from approximately 5000 online user profiles of older and younger users from a 3D MUVE, namely IMVU, was collected for analysis. Overall, we identified several distinct patterns of use (e.g. size of social ties, level of reciprocity, etc.) among older users when compared with younger users. We also found that despite the capabilities of 3D MUVEs to provide the users immersion in alternative realities, a feature well embraced by younger users in this study, older users seemed more interested in activities which serve as an extension to their physical life.

This article reports a study that investigated the occurrences of empathy in online support communities for teenagers. Qualitative content analysis with 400 messages from a discussion board about depression was used to identify how empathy was expressed in the specific online communication. Emphasis was also placed on the comparison of this age group to older people, by comparing the results with those from a previous study on empathy in an online support community about depression for older people. Specifically, the analysis focused on the frequencies of the categories of the code scheme, linguistic characteristics of the communication content, the occurring components of empathy, and the roles as well as activities of the members. From our analysis, we concluded that young people exchanged a substantial amount of empathic emotional communication when participating in an online support community, and they communicated on a more personal level compared to older people, who tended to engage in a more formal communication. In addition, teenagers also showed a high level of understanding but lower level of concern compared to older persons when expressing empathy online.