Search

User experience (UX) research relies heavily on survey scales to measure users' subjective experiences with technology. However, repeatedly raised concerns regarding the improper use of survey scales in UX research and adjacent fields call for a systematic review of current measurement practices. Therefore, we conducted a systematic literature review, screening 153 papers from four years of the ACM Conference on Human Factors in Computing Systems proceedings (ACM CHI 2019 to 2022), of which 60 were eligible empirical studies using survey scales to study users' experiences. We identified 85 different scales and 172 distinct constructs measured. Most scales were used once (70.59%), and most constructs were measured only once (66.28%). The System Usability Scale was the most popular scale, followed by the User Experience Questionnaire, and the NASA Task Load Index. Regarding constructs, usability was the most frequently measured, followed by attractiveness, effort, and presence. Furthermore, results show that papers rarely contained complete rationales for scale selection (20.00%) and seldom provided all scale items used (30.00%). More than a third of all scales were adapted (34.19%), while only one-third of papers reported any scale quality investigation (36.67%). On the basis of our results, we highlight questionable measurement practices in UX research and suggest opportunities to improve scale use for UX-related constructs. Additionally, we provide six recommended steps to promote enhanced rigor in following best practices for scale-based UX research.

Transparency is widely regarded as crucial for the responsible real-world deployment of artificial intelligence (AI) and is considered an essential prerequisite to establishing trust in AI. There are several approaches to enabling transparency, with one promising attempt being human-centered explanations. However, there is little research into the effectiveness of human-centered explanations on end-users' trust. What complicates the comparison of existing empirical work is that trust is measured in different ways. Some researchers measure subjective trust using questionnaires, while others measure objective trust-related behavior such as reliance. To bridge these gaps, we investigated the effects of two promising human-centered post-hoc explanations, feature importance and counterfactuals, on trust and reliance. We compared these two explanations with a control condition in a decision-making experiment (N = 380). Results showed that human-centered explanations can significantly increase reliance but the type of decision-making (increasing a price vs. decreasing a price) had an even greater influence. This challenges the presumed importance of transparency over other factors in human decision-making involving AI, such as potential heuristics and biases. We conclude that trust does not necessarily equate to reliance and emphasize the importance of appropriate, validated, and agreed-upon metrics to design and evaluate human-centered AI.

Past research has demonstrated that aesthetics affect users' experiences in various ways. However, there is little research on the impact of interface aesthetics on user performance in a smartphone app context. The present paper addresses this research gap using an online experiment (N = 281). Two variants of the same web app were created and manipulated in their aesthetics. Participants were randomly assigned to either variant and asked to explore the app before answering questions concerning the app's content. Results showed a significant positive effect of aesthetics on perceived usability and aesthetics. Furthermore, results point toward a positive impact of interface aesthetics on performance (i.e., the number of questions answered correctly). Thus, results indicate that a visually appealing smartphone web app increases users' subjective experience and objective performance compared to an unaesthetic app. This suggests that user interface aesthetics impact users' experiences and provide stakeholders with quantifiable value and competitive advantage.

Interest in science topics is an important prerequisite for science learning and achievement. Here, as part of a field experiment, we studied whether teenagers’ interest and learning of physics topics would be influenced by the aesthetics of a multimedia learning app. More specifically, we investigated with the example of learning about energy (types of power plants) how different interface designs of a multimedia learning app would influence aesthetic experience, interest, and learning outcome. In our study Swiss high school students (N = 108) were assigned to one of two conditions (i.e., game-style vs. industrial-style) differing in various aesthetic features. Results indicate that high-quality interfaces support learning and expressive aesthetic design features additionally foster interest in order to engage with the topic. Moreover, our findings on aesthetic experience suggest that deep perceptual processes, such as emotion and cognitive stimulation induced by interfaces, further impact interest and learning. Thus, our study gives implications for the design of interest-generating and learning-supporting science apps for teenagers and emphasizes the significance to consider aesthetic experience in future research.

There is a growing interest in understanding how to best represent complexity using IDNs. We conceptualize this as the aim to make players of such IDNs reflect critically on the complexity being represented. We argue that current understandings of player experience do not lend themselves to this aim. Research on interactive media has assumed immersion to be a universal positive for the player experience. However, in this article we argue that immersion into the Magic Circle of an IDN could be antagonistic to a critical experience. This is because immersion persuades players into suspending their disbelief, rather than facilitating critical reflection. Instead we propose, on the basis of the Epic Theater, an alternative form of play called alienated play. Meaning, a form of play in which the player is playing, while also observing themselves play. This form of play should allow for players to benefit from the enjoyable nature of play, while simultaneously remaining at a critical distance. To illustrate our theory we design two models, one for immersed play and one for alienated play. Furthermore, we present examples of the design for alienation in commercial video games, as well as hypotheses to test out theory in future research. Therefore, this work contributes an initial theoretical and practical informed form of play, specifically designed to facilitate critical reflection on IDNs representing complexity.

Most people encounter art images as digital reproductions on a computer screen instead of as originals in a museum or gallery. With the development of digital technologies, high-resolution artworks can be accessed anywhere and anytime by a large number of viewers. Since these digital images depict the same content and are attributed to the same artist as the original, it is often implicitly assumed that their aesthetic evaluation will be similar. When it comes to the digital reproductions of art, however, it is also obvious that reproductions do differ from the originals in various aspects. Besides image quality, resolution, and format, the most obvious change is in the representation of color. The effects of subjectively varying surface-level image features on art evaluation have not been clearly assessed. To address this gap, we compare the evaluation of digital reproductions of 16 expressionist and impressionist paintings manipulated to have a high color saturation vs. a saturation similar to the original. We also investigate the impact of viewing time (100 ms vs. unrestricted viewing time) and expertise (art experts vs. laypersons), two other aspects that may impact the perception of art in online contexts. Moreover, we link these dimensions to a recent model of aesthetic experience [the Vienna Integrated Model of Top-Down and Bottom-Up Processes in Art Perception (VIMAP)]. Results suggest that color saturation does not exert a major influence on liking. Cognitive and emotional aspects (interest, confusion, surprise, and boredom), however, are affected – to different extents for experts and laypersons. For laypersons, the increase in color saturation led to more positive assessments of an artwork, whereas it resulted in increased confusion for art experts. This insight is particularly important when it comes to reproducing artworks digitally. Depending on the intended use, increasing or decreasing the color saturation of the digitally reproduced image might be most appropriate. We conclude with a discussion of these findings and address the question of why empirical aesthetics requires more precise dimensions to better understand the subtle processes that take place in the perception of today’s digitally reproduced art environment.

Despite recent concerns about data quality, various academic fields rely increasingly on crowdsourced samples. Thus, the goal of this study was to systematically assess carelessness in a crowdsourced sample (N = 394) by applying various measures and detection methods. A Latent Profile Analysis revealed that 45.9% of the participants showed some form of careless behavior. Excluding these participants increased the effect size in an experiment included in the survey. Based on our findings, several recommendations of easy to apply measures for assessing data quality are given.

Successful computer-supported collaborative learning (CSCL) relies on collaborative group engagement, a complex construct characterized by multifaceted, dynamic, socio-emotional, and socio-cognitive processes. This paper provides a detailed analysis of collaborative group engagement, with a particular focus on nonverbal behaviors as indicators of high versus low group engagement. Using video observations and a multi-method approach, we examine in detail the relationships between different dimensions of group engagement (i.e., behavioral, social, cognitive, and conceptual-to-consequential engagement) and nonverbal behaviors. Using qualitative case analysis, we also provide a rich examination of selected cases to identify the role that nonverbal behaviors play in high-engagement sequences compared with low-engagement sequences. Our findings shed light on specific nonverbal behaviors, including nodding, laughing, and eye contact, as significant indicators of high versus low collaborative group engagement. Notably, more of these nonverbal behaviors are evident in high-engagement sequences, suggesting mutual reinforcement on each dimension of engagement--with the exception of behavioral engagement, where increased laughing or smiling is evident in low-engagement sequences, but still serves a productive group process. The paper concludes with a discussion and implications of the findings. By demonstrating the role of nonverbal behaviors as important indicators, this work contributes to the understanding of the complex, dynamic, and contextualized nature of collaborative group engagement in CSCL settings.

BackgroundThis longitudinal mixed methods experimental study aimed to better understand the interplay between digital technology exposure over time, self-efficacy, and prosocial behavior in everyday contexts.Methods66 psychology students tracked their daily prosocial behavior over three weeks. Additionally, half of the participants were randomly assigned to receive access to an online platform, which made personalized suggestions for prosocial actions to complete. Qualitative post-study interviews complemented quantitative measures.ResultsPlatform exposure had no measurable impact beyond that of tracking over time on either prosocial behavior or self-efficacy. Tracking increased self-efficacy to perform everyday prosocial actions, but did not affect self-efficacy to impact change. Prosocial behavior was predicted by self-efficacy to impact change. Enjoyment of the platform predicted completing higher numbers of suggested prosocial actions and was related to a higher likelihood to continue using the platform in the future. Avenues for increasing platform effectiveness include context-specific action personalization, an effective reminder system, and better support for the development of self-efficacy to impact change through meaningful actions.ConclusionTechnology for prosocial behavior should be enjoyable, capable of being seamlessly integrated into everyday life, and ensure that suggested actions are perceived as meaningful in order to support the sustainable development of self-efficacy and prosocial behavior over time.

Poly- and cyclophosphazenes are excellent flame retardants but currently, are not used as textile finishing agents because water-soluble and permanent washing systems are missing. Here, we demonstrate for the first time, the successful usage of a water-soluble cyclotriphosphazene derivative for textile finishing for cotton, different cotton/polyester, and cotton/polyamide blend fabrics. A durable finish was achieved using a photoinduced grafting reaction. The flame retardant properties of the various fabrics were improved with a higher limiting oxygen index, a reduced heat release rate, and an exhibition of intumescent. Furthermore, the finished textiles passed several standardized flammability tests.

The theory of the archetypes and the hypothesis of the collective unconscious are two of the central characteristics of analytical psychology. These provoke, however, varying reactions among academic psychologists. Empirical studies which test these hypotheses are rare. Rosen, Smith, Huston and Gonzales proposed a cognitive psychological experimental paradigm to investigate the nature of archetypes and the collective unconscious as archetypal (evolutionary) memory. In this article we report the results of a cross-cultural replication of Rosen et al. conducted in the German-speaking part of Switzerland. In short, this experiment corroborated previous findings by Rosen et al., based on English speakers, and demonstrated a recall advantage for archetypal symbol meaning pairs vs. other symbol/meaning pairings. The fact that the same pattern of results was observed across two different cultures and languages makes it less likely that they are attributable to a specific cultural or linguistic context.

Purpose: Patients with Parkinson’s disease (PD) show inefficiencies in cognitive performance including working memory functions. Since these problems impact on quality of life and overall well-being, the current study was aimed at improving patients’ situations by evaluating the computerized cognitive training tool, BrainStim. Method: A total of 19 healthy controls (HCs) and six patients with PD were included in the study. While all PD patients received cognitive training, the HC sample was subdivided into 12 subjects with training (HC-T) and 10 subjects without (HC-NT). Participants underwent a double baseline assessment, a post-training assessment, and a 3-month follow up on neuropsychological tests and self-report measures on fatigue and depression. Training was administered between the second baseline and postassessment. It comprised 16 supervised sessions according to a standardized training protocol over 4 weeks. Results: Significant improvements in verbal and visuospatial short-term and long-term memory were found in both training groups. In addition, the HC-T improved on mental speed, and verbal and visuospatial working memory. Both training groups showed stable results for all short-term visuospatial measures after 3 months. Further, the HC-T showed stable results for working memory, verbal, and visuospatial short-term and long-term memory. Conclusions: The efficacy of the applied computerized cognitive training tool BrainStim could be verified in patients with PD and healthy age-matched controls. The preliminary findings highlighted the suitability of a specific cognitive intervention to improve cognitive inefficiencies in patients with PD as well as in healthy older people. Further research on cognitive training in combination with PD drug therapy is needed to better understand the mutual interaction and to offer optimal therapeutic approaches to patients.

Solar energy conversion is an object of continuous research, focusing on improving the energy efficiency as well as the structure of photovoltaic cells. With efficiencies continuously increasing, state-of-the-art PV cells offer a good solution to harvest solar energy. However, they are still lacking the flexibility and conformability to be integrated into common objects or clothing. Moreover, many sun-exposed surface areas are textile-based such as garments, tents, truck coverings, boat sails, and home or outdoor textiles. Here, we present a new textile-based dye-sensitized solar cell (DSC) which takes advantage from the properties inherent to fabrics: flexibility, low weight, and mechanical robustness. Due to the necessary thermostability during manufacturing, our DSC design is based on heat-resistant glass-fiber fabrics. After applying all needed layers, the overall structure was covered by a transparent and simultaneously conductive protective film. The light and still flexible large-area devices (up to 6 cm2 per individual unit) are working with efficiencies up to 1.8% at 1/5 of the sun. Stability tests assure no loss of photovoltaic activity over a period of at least seven weeks. Therefore, our technology has paved the way for a new generation of flexible photovoltaic devices, which can be used for the generation of power in the mentioned applications as well as in modern textile architecture.

When an interactive form in the world wide web requires users to fill in exact dates, this can be implemented in several ways. This paper discusses an empirical online study with n = 172 participants which compared six different versions to design input fields for date entries. The results revealed that using a drop-down menu is best when format errors must be avoided, whereas using only one input field and placing the format requirements left or inside the text box led to faster completion time and higher user satisfaction.

If an interactive form in the worldwide web requires users to select multiple answers from a given list, this can be implemented in several ways. This paper discusses an empirical study with 𝑛=106 participants, where two interface elements for choosing multiple answers (checkboxes and list boxes) were compared. Results showed that participants chose the same amount of options in both conditions but were faster and more satisfied using checkboxes. The time differences disappeared after several trials, revealing a learning effect for the list box element. As a conclusion, it can be recommended that website developers and online researchers should use checkboxes instead of list boxes for their online forms and questionnaires to enhance usability and user satisfaction—at least for a smaller number of options.

We analysed four Rational Unified Process (RUP) projects in Switzerland that identified themselves as following a user-centred approach. Grounded theory served for analysis of 12 interviews with software developers, project managers, and UI specialists. For each professional group we analysed their work context, motivations, work practices, and strategies used to overcome the obstacles to user-centred design. Results show that end users did not participate in the projects. Instead of working directly with end users, participants used data from marketing research or consulted colleagues from other departments. Prototypes played an important role. We suggest the following remedies: (1) developing methods for easy integration of existing company knowledge about products with usability features, (2) professionalising UI design by educating project stakeholders in standard UI design, (3) creating an approved pool of company's personas for UI specialists' work, and (4) educating customers on their right to get good user interfaces.

In recent years, electronic services delivered via the World Wide Web have become increasingly important to governments. Substantial investments have been made to provide crucial services and information to citizens, businesses, and governmental institutions. This paper presents the development of a short questionnaire to measure user satisfaction with e-Governmental portals. After two validations of the instrument with federal e-Governmental portals in Switzerland, a final set of 15 items remained that were tested with 2498 participants. The final version showed high internal consistency (Cronbach's 𝛼) of .91, good item difficulties (.51 to .82), and discriminatory power coefficients (.49 to .81), as well as a moderate average homogeneity of .47. The survey was translated into five languages.

Guidelines for designing usable interfaces recommend reducing short term memory load. Cognitive load, that is, working memory demands during problem solving, reasoning, or thinking, may affect users' general satisfaction and performance when completing complex tasks. Whereas in design guidelines numerous ways of reducing cognitive load in interactive systems are described, not many attempts have been made to measure cognitive load in Web applications, and few techniques exist. In this study participants' cognitive load was measured while they were engaged in searching for several products in four different online book stores. NASA-TLX and dual-task methodology were used to measure subjective and objective mental workload. The dual-task methodology involved searching for books as the primary task and a visual monitoring task as the secondary task. NASA-TLX scores differed significantly among the shops. Secondary task reaction times showed no significant differences between the four shops. Strong correlations between NASA-TLX, primary task completion time, and general satisfaction suggest that NASA-TLX can be used as a valuable additional measure of efficiency. Furthermore, strong correlations were found between browse/search preference and NASA-TLX as well as between search/browse preference and user satisfaction. Thus we suggest browse/search preference as a promising heuristic assessment method of cognitive load.