Search

Electroencephalography is a technique, which allows to capture brain activity. Devices BCI (Brain-Computer Interface) are being used to evaluate the UX (User eXperience). We present a study where was designed an experiment using the OPENBCI device. The experiment consisted of capturing the brain activity to analyse the data of a group of people (women; men) when they interacted with a classic game called Snake. Therefore, the study designed two interaction ways. First interaction involved a traditional interaction with computer and keyboard. The second interaction involve the use of NFC cards and a mobile device. Also, were applied questionnaires, such as: SAM (Self-Assessment Manikin), NASA-TLX and SUS (System Usability Scale), to compare the information recollected through of the BCI, which consistency with the data was reflected.

Despite the fact that task-oriented conversation systems have received much attention from the dialogue research community, only a handful of them have been studied in a real-world manufacturing context using industrial robots. One stumbling block is the lack of a domain-specific discourse corpus for training these systems. Another difficulty is that earlier attempts to integrate natural language interfaces (such as chatbots) into the industrial sector have primarily focused on task completion rates. When designing a dialogue system for social robots, the user experience is prioritized above industrial robots. To overcome these challenges, we provide the Industrial Robots Domain Wizard-of-Oz dataset (IRWoZ), a fully-labeled discourse dataset covering four robotics domains. It delivers simulated discussions between shop floor workers and industrial robots, with over 401 dialogues, to promote language-assisted Human-Robot Interaction (HRI) in industrial settings. Small talk concepts and human-to-human conversation strategies are provided to support human-like answer generation and give a more natural and adaptable dialogue environment to increase user experience and engagement. Finally, we propose and evaluate an end-to-end Task-oriented Dialogue for Industrial Robots (ToD4IR) using two types of pre-trained backbone models: GPT-2 and GPT-Neo, on the IRWoZ dataset. We performed a series of trials to validate ToD4IR's performance in a real manufacturing context. Our experiments demonstrate that ToD4IR outperforms three downstream task-oriented dialogue tasks, i.e., dialogue state tracking, dialogue act generation, and response generation, on the IRWoZ dataset. Our source code of ToD4IR and the IRWoZ dataset is accessible at https://github.com/lcroy/ToD4IR for reproducible research.

Stochastic Model Predictive Control (SMPC) has attracted increasing attention for autonomous driving in recent years, since it enables collision-free maneuvers and trajectory planning and can deal with uncertainties in a non-conservative way. Many promising strategies have been proposed on how to use SMPC to select appropriate maneuvers and plan safe trajectories in uncertain environments. The limitation of these approaches is that they focus on scenarios where only one vehicle is controlled by SMPC and is, thus, reacting to the surrounding vehicles; however, the surrounding vehicles do not react to the SMPC-controlled vehicle, which means there is no mutual interaction. However, when multiple autonomous vehicles are driving on the road, each individual vehicle will take the behavior of the other surrounding vehicles into account and adjust its individual decisions accordingly in trajectory planning. This paper, therefore, examines in simulations how the interactive control system of multiple SMPC-controlled vehicles behave based on a Distributed SMPC (DSMPC) framework. For a three-lane highway scenario, we first investigate the effects of the risk parameter of the collision avoidance probabilistic constraint on non-interactive and interactive vehicle systems and provide insights into how to parameterize the controllers in interactive vehicle systems.

Different types of agile approaches and LEAN methodologies have guided the development of solutions based on a minimum viable product mainly from the product design and development body of the knowledge. However, these approaches offer generic practices for a wide variety of solutions. This study presents an original proposal that provides a vertical solution for the conception of a minimum viable multimedia system, with a practice expressed in the graphic notation language of Essence. The study presents a contribution through a case study related to the clarity about the flow of activities, techniques, and specific tools that the practitioners must use to define a minimum viable multimedia system. This work also contributes to the criteria unification of the teamwork to carry out the follow-up of the progress in realizing the activities necessary to complete the job needed for the conception of the minimum viable multimedia system, using an MS-value sub-alpha.

Industry 4.0 derived technologies have the potential to enable a new wave of digital manufacturing solutions for semi and fully automated production. In addition, this paradigm encompasses the use of communication technologies to transmit data to processing stations as well as the utilization of cloud based computational resources for data mining. Despite the rise in automation, future manufacturing systems will initially still require humans in the loop to provide supervisory level mediation for even the most autonomous production scenarios. Through a structured review, this paper details a number of key technologies that are most likely to shape this future and describes a range of scenarios for their use in delivering human mediated automated and autonomous production. This paper argues that in all cases of future manufacturing management it is key that the human has oversight of critical information flows and remains an active participant in the delivery of the next generation of production systems.

When discussing interpretable machine learning results, researchers need to compare them and check for reliability, especially for health-related data. The reason is the negative impact of wrong results on a person, such as in wrong prediction of cancer, incorrect assessment of the COVID-19 pandemic situation, or missing early screening of dyslexia. Often only small data exists for these complex interdisciplinary research projects. Hence, it is essential that this type of research understands different methodologies and mindsets such as the Design Science Methodology, Human-Centered Design or Data Science approaches to ensure interpretable and reliable results. Therefore, we present various recommendations and design considerations for experiments that help to avoid over-fitting and biased interpretation of results when having small imbalanced data related to health. We also present two very different use cases: early screening of dyslexia and event prediction in multiple sclerosis.

International audience; The area of Engineering Interactive Computing Systems (EICS) is defined as the intersection between Software Engineering (SE) and Human-Computer Interaction (HCI). In this paper, we provide an overview of what EICS is and how it is positioned with respect to other venues in HCI, such as CHI, UIST, and IUI, highlighting its legacy and paying homage to past scientific events from which EICS emerged. We also take this opportunity to deliver a comparative analysis of the past, present, and perhaps future research and development questions raised in EICS by analyzing the EICS papers published from its first edition to this one, based on global and chronological word clouds, phrase nets, and topic modelling.

This study proposes a novel technology as a creative method to interact with an augmented reality (AR) system called PhoneCursor, which is incorporated onto head-mounted displays. PhoneCursor is designed to offer more intuitive, portable and natural interaction. Its technical realization combines the gyroscope and acceleration sensor based on mobile phone. In view of the target selection ability as a base function of PhoneCursor, it also enhances the performance in solving some difficult selection problems in AR, including far and small object selection, 3D occlusion, dense object selection, and batch selection problem. An experiment based on the ISO 9241-9 standard is conducted to investigate this ability, wherein the PhoneCursor technique is compared with the widely used and well-performing head-movement-based selection technique. Results show that PhoneCursor performs better in terms of movement time and throughput than the conventional technique. Some applications are further proposed to showcase the potential of using the PhoneCursor technique in AR scenarios.

Collocated interaction has received growing interest in both academic research and the design of information and communication technological applications. An emergent research topic within this area relates to technological enhancement of social interaction. Various envisioned systems aim beyond simply enabling interaction, to actively enhance—i.e., improve the quality or extent of—social interaction between collocated people. However, there is little understanding of the optimal design solutions and roles of technology considering this goal. This literature review outlines the landscape of design explorations in this emergent research topic. We contribute an in-depth study of 92 publications that present relevant solutions or prototypes, analyzing their focus areas, design objectives, and design and evaluation approaches. To contribute with a new theoretical perspective, we identify various roles of technology relevant for enhancement, representing three abstract categories: facilitating, inviting and encouraging. This review helps researchers to describe, analyze, and position relevant prior research and identify gaps in scientific knowledge.

Direct observational time and motion studies, in which one or more observers continuously observe and record an individual's activities over a certain period of time, can provide valuable insights into work and communication patterns and assist in identification of areas to intervene to support safe and effective work. These studies have increased in number and sophistication, also due to the availability of software tools for PDA to support the observers. A key methodological issue for these studies is the assessment of Inter-Observer Reliability (IOR). IOR is crucial for ensuring reliability of data collection in which multiple observers are involved. In workflow time studies the multivariate, time-stamped and ordered nature of the data limits the applicability of traditional inter-rater reliability measures, and makes this assessment challenging. Measures such as Cohen's Kappa, in fact, are only applicable to one variable at the time, so that high K scores for one aspect can be achieved even if two observers disagree substantially on other variables which are the object of their observation. Secondly, computing these measures first requires either matching pairs of datapoints from different observers viewing the same entity, a problem that cannot be done with perfect certainty, or restructuring the data into fixed-length time window sequences. No single method can address all the different aspects on which observers in time and motion studies can disagree, so one should adopt a composite method. We developed a set of functions and a Shiny app to assist this process for data collected with the Work Observation Method By Activity Timing (WOMBAT) method. The app allows the loading of data from pairs/groups of observers and computes a wide set of agreement measures on both matched data and on time window data. These measures are presented in a dashboard along with interactive visualizations of the observers’ data, and can be saved and plotted over time in a different section.

Recently, face recognition became a key element in social cognition which is used in various applications including human–robot interaction (HRI), pedestrian identification, and surveillance systems. Deep convolutional neural networks (CNNs) have achieved notable progress in recognizing faces. However, achieving accurate and real-time face recognition is still a challenging problem, especially in unconstrained environments due to occlusion, lighting conditions, and the diversity in head poses. In this paper, we present a robust face recognition and tracking framework in unconstrained settings. We developed our framework based on lightweight CNNs for all face recognition stages, including face detection, alignment and feature extraction, to achieve higher accuracies in these challenging circumstances while maintaining the real-time capabilities required for HRI systems. To maintain the accuracy, a single-shot multi-level face localization in the wild (RetinaFace) is utilized for face detection, and additive angular margin loss (ArcFace) is employed for recognition. For further enhancement, we introduce a face tracking algorithm that combines the information from tracked faces with the recognized identity to use in the further frames. This tracking algorithm improves the overall processing time and accuracy. The proposed system performance is tested in real-time experiments applied in an HRI study. Our proposed framework achieves real-time capabilities with an average of 99%, 95%, and 97% precision, recall, and F-score respectively. In addition, we implemented our system as a modular ROS package that makes it straightforward for integration in different real-world HRI systems.

Summarization: Medical conditions and cases are growing at a rapid pace, and physical space is starting to be constrained. Hospitals and clinics no longer have the ability to accommodate large numbers of incoming patients. It is clear that the health industry needs to improve the current state of its valuable and limited resources. The evolution of Internet-of-Things (IoT) devices along with assistive technologies can alleviate the problem in health care by providing a convenient and easy means of accessing health-care services wirelessly. There is a plethora of IoT devices and potential applications that can take advantage of the unique characteristics that these technologies can offer. However, at the same time, these services pose novel challenges that need to be properly addressed. In this article, we review some popular categories of IoT-based applications for health care along with their devices. We then describe the challenges and discuss how research can properly address the open issues and improve the already-existing implementations in health care. Further possible solutions, including machine learning (ML) techniques, are also discussed to show their potential as viable solutions for future health-care applications. Presented on: IEEE Signal Processing Magazine

Anomaly detection has gained increasing attention from researchers in recent times. Owing to a lack of reliable ground-truth labels, many current state-of-art techniques focus on unsupervised learning, which lacks a mechanism for user involvement. Further, these techniques do not provide interpretable results in a way that is understandable to the general public. To address this problem, we present RISSAD: an interactive technique that not only helps users to detect anomalies, but automatically characterizes those anomalies with descriptive rules. The technique employs a semi-supervised learning approach based on an algorithm that relies on a partially-labeled dataset. Addressing the need for feedback and interpretability, the tool enables users to label anomalies individually or in groups, using visual tools. We demonstrate the tool's effectiveness using quantitative experiments simulated on existing anomaly-detection datasets, and a usage scenario that illustrates a real-world application., EuroVis 2021 - Short Papers, Machine Learning and SciVis Applications, 25, 29, Jiahao Deng and Eli T. Brown, CCS Concepts: Computing methodologies--> Interactive systems; Pattern analysis

The new technologies applied to complex learning environments need a pedagogical design adapted to the competences that we want to enforce or improve, the adaptation of the teacher, new and actualized resources, and the capacity to make the learning following both, the face-to-face as the on-line mode. Our paper presents the perception of students and teachers, how by using the Project-Based Learning (PBL) approach and using a gamified and interactive Virtual Reality (VR) system in the context of Building, Urban and Architecture studies we can re-force the acquisition of visual management competences. To improve the spatial competences and the visual understanding of 3D complex models for re-organizing the urban space, we have designed an educational proposal based on free applications where the students must design, create and integrate ephemeral architecture proposals for a citizenship final urban interaction. This step incorporates to the student’s assessment an informal feedback, which complements the formal evaluation and gives them a point of view based on valuable social data for further projects. However, the lack of standards, the complexity of the software, the learning times, and the teacher’s rejection to use these approaches, many times due to lack of interest or because of the digital gap derived from age and the classical workflows, are factors that are complicating the modernization of the learning process, establishing a low level of implantation and student’s use in other subjects, as our study demonstrates. For these reasons, we have conducted an explorative research to compare the perception of the students and the teachers, with the clear result, that shows that nowadays in Architecture education, we can find a gender, and age gap in the acceptation of these systems, something that blocks their training, while in the professional sector are used and demanded. info:eu-repo/grantAgreement/MINECO/1PE/ BIA2016-77464-C2-1-R

This paper describes Ivy, an office chair that represents sitting time of an office worker through growing ivy strands. The longer one sits, the more strands will grow onto the chair. By means of a qualitative interface called Ivy, we illustrate a design approach that is currently underrepresented in sedentary behavior interventions. With this approach, we counter the current trend of digitalization and quantification of health interventions. Instead of graphs and numbers, Ivy uses data physicalization as a qualitative interface that represents sitting. We describe the design, the process, and future research steps of Ivy as a critical perspective on sedentary behavior interventions. We aim to spark discussion amongst designers and researchers in the field of Human-Computer Interaction to use qualitative interfaces as a promising approach to deepen the user's relationship with the targeted behavior and enrich the ability to construct meaning from the feedback. © 2020 Owner/Author.

ARETE (Augmented Reality Interactive Educational System) is a European project, which aims to develop an interactive toolkit for Augmented Reality (AR) content. In this work in progress paper, we describe the system which is currently being developed. The ARETE system follows human-centered interaction design practices and has a strong focus in interactive, multi-user and multi-lingual technologies. On completion, the system will be evaluated across three pilot studies. The three pilots will involve more than 3000 students across ten European countries and they will assess the impact of usage of the ARETE system and the educational value of AR for English literacy skills, STEM (Science, Technology, Engineering and Math) skills and in the implementation of Positive Behaviour Support in Schools (PBIS). ARETE will also be involved in the implementation of new standards for the creation of cross platform content and services as well as the creation of learning experience data repositories.

Resumen Este trabajo tuvo como propósito explorar entornos virtuales desde un sistema interactivo que permitiera interpretar los gestos manuales hacia una aproximación musical. La metodología implementada se realizó desde un enfoque cuantitativo, donde se establecieron tres fases de recolección de datos: secuencialidad de gestos, signos de Curwen y aproximación a la realidad. Este estudio fue dividido en tres etapas longitudinales conceptualización, diseño e implementación y evaluación para ampliar el espectro en la interpretación de los gestos. El método Kodály implementado en este trabajo, el cual ha sido adaptado en Colombia, utiliza los gestos manuales para asimilar con mayor rapidez conceptos musicales. La evaluación fue desarrollada con una muestra poblacional de 15 usuarios en cada fase para la recolección de datos. Los resultados se identificó una rápida adaptación en la interpretación de los gestos en relación con las notas musicales. Los tiempos y errores obtenidos permitieron medir aspectos en la ejecución de los gestos. Se adaptó un conjunto de gestos de la mano a un entorno virtual en el que los usuarios pueden tocar la melódica mediante la interpretación gestual, lo que demostró que el reconocimiento de gestos puede ayudar hacia una aproximación musical. Finalmente, los usuarios lograron un alto nivel de comprensión gracias al uso de movimientos naturales de la mano, lo cual fue un proceso significativo para los usuarios en una primera experiencia mediante el reconocimiento de gestos manuales. Abstract This article describes a virtual environment of an interactive computer system that can interpret hand gestures as pitches in a tonal scale. The methodology implemented here is based on a quantitative approach with three data collection stages: sequence of gestures, Curwen’s hand signs, and approximation to reality. This study was divided into three general stages conceptualization, design and implementation, and evaluation, to expand the scope of hand gesture recognition. The Kodály method implemented in this paper, which was adapted in Colombia, uses hand gesture to help students better understand musical concepts. The evaluation was conducted with a population sample of 15 users in each data collection stage. The results show that users adapted quickly to hand gesture recognition and its relationship with musical notes. Times and errors obtained in the tests were used to measure aspects of execution. A set of hand gestures was adapted to a virtual environment where users can play melodica by gestural interpretation, which showed that gesture recognition can help music instruction. Finally, users achieved a high level of understanding thanks to the use of natural hand movements, and it was a meaningful process for them because it was their first experience with a hand gesture recognition.

International audience; Software process capability maturity models are currently widely used in industry. To perform the practices defined in these models, software engineering approaches are applied. We have experimented the definition of a large number of methods, techniques, patterns, and standards for the conception, design, implementation, and evaluation of interactive systems focusing on Human–Computer Interaction (HCI) issues. Nevertheless, it is well-known that HCI approaches are not largely used in industry. In order to take advantage of the widespread use of capability maturity models, we have worked on the identification of appropriate HCI approaches for each practice of the engineering advocated by the most known model - the CMMI-DEV (Capability Maturity Model Integration for Development). By exploring the CMMI-DEV and the literature, we identified a set of HCI approaches for the development of interactive systems. Twenty HCI experts were interviewed for the Validation and improvement of this initial set. As a result, we identified 14 HCI categories of approaches with examples of methods, techniques, patterns, and standards adequate for performing engineering practices of the CMMI-DEV when developing interactive systems.

The ability to display virtual objects midair that can be seen without special headwear is an attractive proposition for the virtual reality systems of the near future. Volumetric display technologies have demonstrated this concept, allowing users to view virtual objects with real dimensions in 3D space while enabling some forms of interaction. Developments have been witnessed in haptic feedback technologies which are used to deliver a sensation of touch in the digital world. As virtual environments find more applications in today's world, haptic feedback devices have potential to integrate with virtual reality systems and contribute to a more immersive and interactive user experience. Herein, an air‐based haptic feedback device, named Aerohaptics, is presented, which delivers mid‐air tactile feedback while the user is manipulating virtual objects within a pseudo‐holographic display. The developed system constitutes a cost‐effective approach with relatively low complexity and various potential applications as no wearable or handheld peripherals are required. The delivered haptic feedback can be accurately directed at specific locations on the user's hand and its intensity can be controlled to suit various interaction scenarios. Through experiments, localized feedback on the user's fingertips as well as varying feedback force according to the user's hand movement is demonstrated.

International audience; Cyber-physical systems (CPS) integrate both physical and computational elements and their engineering requires bridging the continuous analog real world and the discrete digital world. User interfaces of cyber-physical systems belong to the class of command and control systems and their design and engineering usually follow ad-hoc craft processes highly parametrized by the very nature of the physical component(s). This paper proposes a systematic approach for engineering CPS, emphasizing the problems and possible solutions to design and assess their user interfaces (both control and presentation). The paper first proposes a generic architecture for CPS going from the physical element(s) to the user interface. This architecture is then refined, highlighting the behavior and software interfaces of each of its component and showing how information and control from the physical elements have to be processed and transformed to make sense to the operator. The paper presents extracts of the application of the proposed approach to the command and control cockpit application of an aircraft system.

The history of algorithmic composition using a digital computer has undergone many representations—data structures that encode some aspects of the outside world, or processes and entities within the program itself. Parallel histories in cognitive science and artificial intelligence have (of necessity) confronted their own notions of representations, including the ecological perception view of J.J. Gibson, who claims that mental representations are redundant to the affordances apparent in the world, its objects, and their relations. This review tracks these parallel histories and how the orientations and designs of multimodal interactive systems give rise to their own affordances: the representations and models used expose parameters and controls to a creator that determine how a system can be used and, thus, what it can mean.

Part 2: Assistive Technology for Cognition and NeuroDevelopment Disorders; International audience; The design and development of computer assistive technologies must be tied to the needs and goals of end users and must take into account their capabilities and preferences. In this paper, we present MeDeC@, a Methodology for the Development of Computer Assistive Technologies for people with Autism Spectrum Disorders (ASD), which relies heavily in our experience working with end users with ASD. The aim of this methodology is not to design for a broad group of users, but to design highly customizable tools so that they can be easily adapted to specific situations and small user groups. We also present two applications developed using MeDeC@ in order to test its suitability: EmoTraductor, a web application for emotion recognition for people with Asperger Syndrome, and ReadIt, a web browser plug-in to help people with ASD with written language understanding difficulties to navigate the Internet. The results of our evaluation with end users show that the use of MeDeC@ helps developers to successfully design computer assistive technologies taking into account the special requirements and scenarios that arise when developing this kind of assistive applications.

[ES]El GRupo de Investigación en InterAcción y eLearning (GRIAL) es un Grupo de Investigación Reconocido (GIR) de la Universidad de Salamanca y, actualmente, Unidad de Investigación Consolidada (UIC) de la Junta de Castilla y León. Su mayor seña de identidad es que es un grupo de investigación multidisciplinar que surge en torno a la creación y aplicación de tecnología educativa, por tanto, en su composición integra fundamentalmente ingenieros en informática y pedagogos, pero en él se incluyen humanistas, bibliotecólogos, filósofos o filólogos entre otros perfiles. En este artículo se presentan las líneas de investigación del grupo que actualmente son más activas, avaladas por sus proyectos y sus principales publicaciones.

INTRODUCTION: Starting from et ego, a piece for classical guitar and electronics, this paper aims to introduce the notionof the interactive system as a tool to understand the musical activity developed by a composer and/or performer inrelationship with an instrument and a score.OBJECTIVES: The primary objective is to show how the equilibrium within this interactive system can be affected by theintroduction of an external technology.METHODS: In et ego, the external technology is represented by two piezoelectric contact microphones placed on thesoundboard of the guitar, which creates an interference within the usual performer/instrument relationship. The performerhas to interact with these microphones and with a differently amplified classical guitar: the piezoelectric microphones makevery tiny sounds audible and emphasize percussive sounds while feeding the patch for the live electronics. Consequently,the composer enacts different strategies to understand and represent this enriched vocabulary.RESULTS: The use of piezoelectric microphones allows for working with specific gestures and extremely delicate sounds,enriching the vocabulary of sound material available within the compositional process. The use of notation becomes part ofthis process of comprehension and translation of different aural images.CONCLUSION: The interdependencies between the agents of the system, constantly challenged by different levels ofinterferences, reveal the perceptual and recursive nature of the compositional labour.

The article describes the development of fundamentals of machine elements and assemblies design processes automation using artificial intelligence, and descriptions of structural elements’ features in a natural language. In the proposed interactive automated design systems, computational artificial intelligence methods allow communication by speech and natural language, resulting in analyses of design engineer’s messages, analyses of constructions, encoding and assessments of constructions, CAD system controlling and visualizations. The system is equipped with several adaptive intelligent layers for human biometric identification, recognition of speech and handwriting, recognition of words, analyses and recognition of messages, enabling interpretation of messages, and assessments of human reactions. The article proposes a concept of intelligent processing for analysis of descriptions of machine elements’ structural features in a natural language. It also presents the developed methodology for similarity analysis between structural features of designed machine elements and corresponding antipatterns allowing normalization of parameters of the analysed structural solutions.

In this paper, we present an inertial sensor-based touch and shake metaphor for expressive control of a 3D virtual avatar in a virtual environment. An intuitive six degrees-of-freedom wireless inertial motion sensor is used as a gesture and motion control input device with a sensor fusion algorithm. The algorithm enables user hand motions to be tracked in 3D space via magnetic, angular rate, and gravity sensors. A quaternion-based complementary filter is implemented to reduce noise and drift. An algorithm based on dynamic time-warping is developed for efficient recognition of dynamic hand gestures with real-time automatic hand gesture segmentation. Our approach enables the recognition of gestures and estimates gesture variations for continuous interaction. We demonstrate the gesture expressivity using an interactive flexible gesture mapping interface for authoring and controlling a 3D virtual avatar and its motion by tracking user dynamic hand gestures. This synthesizes stylistic variations in a 3D virtual avatar, producing motions that are not present in the motion database using hand gesture sequences from a single inertial motion sensor.

TEC - Travaux en Cours; International audience; Human-Computer Interaction (HCI) community has proposed many methods, techniques and standards for the development of interactive systems. Despite the great recognition of many of these approaches in academia, little is known about the state of practice in industry. To what extent are they known and used, while using a defined software process, to develop interactive systems? What is their level of use compared to software engineering approaches? This paper presents a study that we have conducted to answer these questions. This study is developed on top of one of the widest used software process improvement model: CMMI (Capability Maturity Model Integration). This paper presents the planning of this study, the research protocol and some initial results.

Orientador: Hermes Renato Hildebrand Tese (doutorado) - Universidade Estadual de Campinas, Instituto de Artes Resumo: Por meio do método cartográfico, que inclui a participação prática da pesquisadora em diversos processos de projeto, em diferentes contextos, esta pesquisa realiza um mapeamento de indicadores da emergência de novas condições nos processos de criação, tanto nas artes quanto no design, que estão fazendo com que repensemos a nossa forma de atuar. Tais condições sociais, culturais e tecnológicas investigadas no presente estudo são principalmente ligadas à cocriação e, com isso, à noção de controlabilidade sobre o processo criativo, em um contexto complexo. É examinado como o processo de projeto ¿ como parte do processo de evolução sociocultural ¿ tende a se complexificar e se comportar como sistema aberto e evolutivo, considerando as diversas formas de abertura que podem existir no decorrer do processo. A experiência se deu por meio de: a) revisão crítica de literatura, b) pesquisa exploratória e c) experiências práticas em projetos, como modos complementares de operar e que ocorreram simultaneamente. Foi possível observar como alguns modelos de processo de projeto existentes podem ser reapropriados e transformados de acordo com as singularidades do projeto em questão, principalmente face à natureza evolutiva dos objetos (aqui entendidos como sistemas) que são produzidos na atualidade. Ao examinar a complexidade como principal condição para os processos de criação, destacamos a emergência de estruturas de criação, produção e distribuição ¿ não apenas de produtos de design mas, principalmente, de conhecimento. Com a identificação de algumas práticas e metodologias que estão surgindo e transformando os modos de projetar, foi possível abordar a lógica de abertura, compartilhamento e distribuição que estão atualmente criando novos territórios, ao dialogar com a lógica dos negócios. Ao expor e analisar aspectos que diferenciam o processo de design dito tradicional em relação a um processo de design concebido como evolutivo, expondo também as tensões (principalmente políticas) negociadas durante a prática de projeto, esta pesquisa contribui para a reformulação da noção de controle sobre o processo de projeto e para a projeção de novas formas de se trabalhar com os potenciais de um comportamento emergente Abstract: Through the cartographic method, which includes the participation of the researcher in several design processes, in different contexts, this research conducts a mapping of indicators of the emergence of new conditions in the processes of creation, both in the Arts and in the Design fields, which demand that we rethink our ways of designing. Such social, cultural and technological conditions investigated in the present study are mainly related to co-creation and, therefore, to the notion of controllability over the creative process, in a complex context. It is examined how the design process - as part of the process of sociocultural evolution - tends to become more and more complex and behave as an open and evolutionary system, considering the various forms of openness that may exist during the process. The experience was conducted through: a) critical review of literature, b) exploratory research, and c) practical experiences in projects, as complementary modes of operation that occurred simultaneously. It was possible to observe how some existing models of the design process can be transformed according to the singularities of the project in question, especially in view of the evolutionary nature of the objects (understood as systems) that are produced today. In examining complexity as the main condition for creation processes, we highlight the emergence of creation, production, and distribution structures - not only of design products, but mainly of knowledge. With the identification of some practices and methodologies that are emerging and transforming the ways of designing, it was possible to address the logic of openness, sharing and distribution that are currently creating new territories, when dialoguing with the business logic. By exposing and analyzing aspects that differentiate the traditional design process from a design process conceived as evolutionary, also exposing the tensions (mainly political) negotiated during the project practice, this research contributes to the reformulation of the notion of controllability over the design process, and to the projection of new ways of working with the potentials of the emergent behavior Doutorado Artes Visuais Doutora em Artes Visuais FAPESP 2014/04168-6, 2014/24632-9 CAPES

Advances in usability and design techniques (e.g. user-centered design) try to facilitate the use of interactive systems. However, users still have to adapt to interactive systems, i.e. they have to learn the steps required to accomplish a task either by trial and error or by obtaining help. While advanced users are usually able to adapt without much effort this is far from being the case with beginners. Some interactive systems offer different interaction styles in an attempt to meet the needs of all types of user but this is not the case with all interactive systems. In this sense, we present an approach to support the use of any interactive system making use of enriched models and picture-driven computing to achieve tasks automation. The USS tool (User Support System) is the basis to the adaptation of interactive systems accordingly to the users' needs. The approach provides the foundation for the addition of help (based on demonstration) to any graphical user interfaces (GUI) facilitating learning and use. The work is illustrated by a case study and completed with a preliminary user evaluation which provides insights about the validity of the approach. info:eu-repo/semantics/publishedVersion

Conversation Fillers (CFs), such as `um', `hmm', and `ah', may help to improve the human-robot interaction by smoothening the robot's responses. This paper presents the design and test of such CFs - alongside iconic pensive or acknowledging gestures - for Wizard of Oz (WoZ) controlled open-ended dialogues in child-robot interactions. A controlled experiment with 26 children showed that these CFs can improve the perceived speediness, aliveness, humanness, and likability of the robot, without decreasing perceptions of intelligence, trustworthiness, or autonomy.

Learning Management Systems (LMS) are commonly used for management of online learning activities inside single or many courses. Usually they are rich with different tools and options in order to enable modern interactive learning environment. But from their early beginnings, before migration on web, LMS were designed as closed systems in order to serve single institution learning content. Such development hindered LMS for proper integrations with other systems and brought many challenges which are present up to this date in many LMS solutions. This research explains why some of the most used LMS in the world today are not able to properly integrate in modern cloud environment. Analysis of core functionalities of most used LMS are explained with propositions for improvement and future development.

In this paper, we discuss the importance of information systems in modeling interactive computations performed on (complex) granules and we propose a formal approach to interactive computations based on generalized information systems and rough sets which can be combined with other soft computing paradigms such as fuzzy sets or evolutionary computing, but also with machine learning and data mining techniques. Information systems are treated as dynamic granules used for representing the results of the interaction of attributes with the environment. Two kinds of attributes are distinguished, namely, the perception attributes, including sensory attributes, and the action attributes. Sensory attributes are the basic perception attributes, other perception attributes are constructed on the basis of the sensory ones. Actions are activated when their guards, being often complex and vague concepts, are satisfied to a satisfactory degree. The guards can be approximated on the basis of measurements performed by sensory attributes rather than defined exactly. Satisfiability degrees for guards are results of reasoning called the adaptive judgment. The approximations are induced using hierarchical modeling. We show that information systems can be used for modeling more advanced forms of interactions in hierarchical modeling. The role of hierarchical interactions is emphasized in the modeling of interactive computations. Some illustrative examples of interactions used in the ACT-R 6.0 system are reported. ACT-R 6.0 is based on a cognitive architecture and can be treated as an example of a highly interactive complex granule which can be involved in hierarchical interactions. For modeling of interactive computations, we propose much more general information systems than the studied dynamic information systems (see, e.g., Ciucci (2010) [8] and Pałasiński and Pancerz (2010) [32]). For example, the dynamic information systems are making it possible to consider incremental changes in information systems. However, they do not contain the perception and action attributes necessary for modeling interactive computations, in particular for modeling intrastep interactions.

The cost of deploying a ubiquitous system to enhance a physical environment is likely to be considerable. The success of its deployment is highly dependent on its context: the physical environment and the activities that are to be carried out within it. This paper provides an initial exploration of whether stochastic process algebras (in particular PEPA with a Fluid Flow semantics) might be used to explore consequences before deployment. The focus of the exploration is to aid understanding of how a proposed system supports users within the environment. The challenge is to provide notations and techniques that will enable the analysis of potentially complex systems.

© 2016, International Journal of Pharmacy and Technology. All rights reserved.The current stage of development of software is characterized by the prevalence of interactive systems which provide solution of various classes of problems on the basis of the optimum separation of functions between a user and a computational machine. The task of development of interactive systems is multiple-aspect and incorporates virtually all of the major problems in the field of programming. For its solution it is necessary to use theoretical apparatus and tools which are the technological basis for creation of modern effective interactive systems. A significant role among the main and mandatory phases of building such systems is given to selection and development of a formalized system model to streamline the system description, make it easier for its design and analysis, provide a conceptual framework to analyze its behavior and implementation. An interactive system model is a description of schemes of dialog processes and actions performed by the system. In the paper we present a specific classification and review of formal and informal models of interactive systems, as well as the tools and techniques of their building. The analysis was conducted in order to identify the most strong points of presented formalism which, according to the authors, could be useful in formulating a common approach to description of interactive systems.

The Smart Innovation, Systems and Technologies book series encompasses the topics of knowledge, intelligence, innovation and sustainability. The aim of the series is to make available a platform for the publication of books on all aspects of single and multi-disciplinary research on these themes in order to make the latest results available in a readily-accessible form. Volumes on interdisciplinary research combining two or more of these areas is particularly sought. The series covers systems and paradigms that employ knowledge and intelligence in a broad sense. Its scope is systems having embedded knowledge and intelligence, which may be applied to the solution of world problems in industry, the environment and the community. It also focusses on the knowledge-transfer methodologies and innovation strategies employed to make this happen effectively. The combination of intelligent systems tools and a broad range of applications introduces a need for a synergy of disciplines from science, technology, business and the humanities. The series will include conference proceedings, edited collections, monographs, handbooks, reference books, and other relevant types of book in areas of science and technology where smart systems and technologies can offer innovative solutions. High quality content is an essential feature for all book proposals accepted for the series. It is expected that editors of all accepted volumes will ensure that contributions are subjected to an appropriate level of reviewing process and adhere to KES quality principles.

Socio-Technical Systems (STS) such as Air Traffic Management Systems (ATM) are considered as complex as they encompass interactions involving humans and machines deeply influenced by environmental aspects (e.g. weather conditions) and by the overall organizational structure in which they are deployed in. Within such STS, interactive systems are omnipresent allowing operators to interact with the underlying system. Such interactive systems must be both usable (i.e. enabling users to perform their tasks efficiently and effectively while ensuring a certain level of operator satisfaction) and resilient to adverse events including software malfunctions (e.g. automation degradation) as well as interaction related problems (e.g. human errors or interactive system failures). Current techniques, methods and tools do not allow to model STSs as a whole and thus to analyze both usability and resilience properties. This paper proposes a multi-models based approach for the modelling and the analysis of partly-autonomous interactive systems for assessing their resilience and usability. The approach integrates 3 modelling techniques: Functional Resonance Analysis Method (FRAM) (focused on organizational functions), Human-centered Assessment and Modelling to Support Task Engineering for Resilient Systems (HAMSTERS) (centered on human goals and activities) and Interactive Cooperative Objects (ICO) (dedicated to the modelling of interactive systems). The principles of the multi-models approach is illustrated on an example for carefully showing the extensions proposed to the selected modelling techniques and how they integrate together. A case study dealing with aircraft route change due to bad weather conditions demonstrates the scalability and benefits of the approach.

In clinical settings, Human-computer systems need to be designed in a way that medical errors are reduced and patient care is enhanced. Inspection methods are usually employed in HCI to assess usability of interactive systems. However, they do not consider the state of the operator while executing a task, the surrounding environment and the task demands. It is argued that assessing performance of operators is fundamental for designing optimal systems with which healthcare can be effectively delivered. The aim of our solution is to assess performance of operators employing the notion of Mental Workload (MWL) this being a construct believed to strongly correlate with performance. The proposal is to develop a model for MWL assessment using supervised machine learning. This model will be evaluated via user studies involving clinicians and operators interacting with a set of medical systems. Assessments of MWL will be compared and validated with objective indexes of performance such as error rate and task execution time.

In this paper, we present an interactive motion deformation method to modify animations so that they satisfy a set of prioritized constraints. Our approach successfully handles the problem of retargeting and adjusting a motion, as well as adding significant changes to preexisting animations. We introduce the concept of prioritized constraints for motion editing by exploiting an arbitrary large number of priority-layers. Each frame is individually and smoothly adjusted to enforce a set of prioritized constraints. The iterative construction of the solution channels the convergence through intermediate solutions, enforcing the highest prioritized constraints first. In addition, we propose a new, simple formulation to control the position of the center of mass so that the resulting motions are physically plausible. Finally, we demonstrate that our method can address a wide range of motion editing problems. [All rights reserved Elsevier]

To enable Interactive multiview video systems with a minimum view-switching delay, multiple camera views are sent to the users, which are used as reference images to synthesize additional virtual views via depth-image-based rendering. In practice, bandwidth constraints may however restrict the number of reference views sent to clients per time unit, which may in turn limit the quality of the synthesized viewpoints. We argue that the reference view selection should ideally be performed close to the users, and we study the problem of in-network reference view synthesis such that the navigation quality is maximized at the clients. We consider a distributed cloud network architecture where data stored in a main cloud is delivered to end users with the help of cloudlets, i.e., resource-rich proxies close to the users. In order to satisfy last-hop bandwidth constraints from the cloudlet to the users, a cloudlet re-samples viewpoints of the 3D scene into a discrete set of views (combination of received camera views and virtual views synthesized) to be used as reference for the synthesis of additional virtual views at the client. This in-network synthesis leads to better viewpoint sampling given a bandwidth constraint compared to simple selection of camera views, but it may however carry a distortion penalty in the cloudlet-synthesized reference views. We therefore cast a new reference view selection problem where the best subset of views is defined as the one minimizing the distortion over a view navigation window defined by the user under some transmission bandwidth constraints. We show that the view selection problem is NP-hard, and propose an effective polynomial time algorithm using dynamic programming to solve the optimization problem. Simulation results finally confirm the performance gain offered by virtual view synthesis in the network.

The large diffusion of concurrent and distributed systems has spawned in recent years a variety of new formalisms, equipped with features for supporting an easy specification of such systems. The aim of our note is to compare two recent formalisms for the design of concurrent and distributed systems, namely the tile logic and the cospan-span model. We first present a simple, yet rather expressive Hoare-style process algebra; then, after presenting the basics of both approaches, we compare them via their modeling of the calculus.

In this paper, we describe the concept of remixing playware, which allows sampling and remixing of both physical and functional (e.g. music content) aspects of a system. Such remixing playware has a number of distinguished features which are explained in the paper: user-configurable modularity, which allows the user to interact and manipulate with samples; user-guided behavior-based system, which allows music compositions to emerge from the way performer interacts with the instruments that provide the primitive behaviours; intelligent sampling as the ability of creating samples that allow anybody to remix with the samples ensuring an engaging outcome. The paper exemplifies remixing playware with a variety of implementations in RoboMusic concerts, the virtual MusicTiles app, the physical MagicCubes, the physical dices in Peter Gabriel concerts, and the S'n'S system. These examples focus on music creation and performance, based upon the concept of RoboMusic, and it is argued that the concept of remixing playware extends to many other application areas of playware.

The Moving Pictures Experts Group (MPEG), which produced the MPEG-1 and MPEG-2 video and audio compression standards, is developing the MPEG-4 standard. MPEG-4 targets interactive multimedia applications and will become a standard in 1999. As well as an increased compression efficiency, MPEG-4 will also offer content-based functionality, i.e. the possibility of accessing and manipulating individual objects in the picture. Furthermore, MPEG-4 will offer possibilities for efficient video storage and for transmission over poor audio and video channels at bit rates between 5 kbit/s and 4 Mbit/s. This paper gives an overview of the state of the art of MPEG-4 development, concentrating especially on video content-based functionality, which is so important for interactive applications.

Since their inception, interactive virtual environments have not been able to interpret users' gestures. Researchers have investigated a few tentative solutions, but most of them concern a specific set of body parts like hands, arms, or facial expressions. However, when placing a participant in a virtual world to interact with synthetic inhabitants, it would be more convenient and intuitive to use body-oriented actions. To achieve this, we developed a hierarchical model of human actions based on fine-grained primitives. An associated recognition algorithm identifies simultaneous actions on the fly.

Language is an essential aspect of human communication and interaction, not only between humans but also between humans and interactive systems. Indeed, the use of the language is a keystone for the design of interactive systems.Inappropriate use of language might limit the access of users to information and induce users to make mistakes or to lose control of interactive systems. Despite the existence of public policies, the diversity of languages poses serious problems when considering full-fledged/seamless support for all existing languages. And yet standardization processes have successfully defined mechanisms for ensuring cross-platform compatibility between languages, at least at the level of format and the set of characters that can be used.

Search-based software testing uses meta-heuristic search techniques to automate or partially automate testing tasks, such as test case generation or test data generation. It uses a fitness function to encode the quality characteristics that are relevant, for a given problem, and guides the search to acceptable solutions in a potentially vast search space. From an industrial perspective, this opens up the possibility of generating and evaluating lots of test cases without raising costs to unacceptable levels. First, however, the applicability of search-based software engineering in an industrial setting must be evaluated. In practice, it is difficult to develop a priori a fitness function that covers all practical aspects of a problem. Interaction with human experts offers access to experience that is otherwise unavailable and allows the creation of a more informed and accurate fitness function. Moreover, our industrial partner has already expressed a view that the knowledge and experience of domain specialists are more important to the overall quality of the systems they develop than software engineering expertise. In this paper we describe our application of Interactive Search Based Software Testing (ISBST) in an industrial setting. We used SBST to search for test cases for an industrial software module and based, in part, on interaction with a human domain specialist. Our evaluation showed that such an approach is feasible, though it also identified potential difficulties relating to the interaction between the domain specialist and the system.

This paper describes VolDmi, an open system for volume modeling and visualization defined as an interactive platform which will integrate current and future research developments, as well as specific applications. The article begins with the analysis of the main functional modules of the system. Then, the design criteria which have been followed are explained and the system's global operation is described, with special emphasis on user interaction. Subsequently, the central kernel of the system is presented. This kernel is mainly composed of input/output modules along with creation and operation modules for a generalized voxel-model. Finally, the default visualization of the voxel-model that has been implemented in the system and which is based on the slice stacking algorithm, is presented.

We describe the HUMANOID environment dedicated to human modeling and animation for general multimedia, VR, and CAD applications integrating virtual humans. We present the design of the system and the integration of the various features: generic modeling of a large class of entities with the BODY data structure, realistic skin deformation for body and hands, facial animation, collision detection, integrated motion control and parallelization of computation intensive tasks.

This paper reports outcomes of a pilot study to develop a conceptual framework to allow people to retrofit a building-layer to gain better control of their own built- environments. The study was initiated by the realisation that discussions surrounding the improvement of building performances tend to be about top-down technological solutions rather than to help and encourage bottom-up involvement of building-users. While users are the ultimate beneficiaries and their feedback is always appreciated, their direct involvements in managing buildings would often be regarded as obstruction or distraction. This is largely because casual interventions by uninformed building-users tend to disrupt the system. Some earlier researches showed however that direct and active participation of users could improve the building performance if appropriate training and/or systems were introduced. We also speculate this in long run would also make the built environment more sustainable. With this in mind, we looked for opportunities to retrofit our own office with an interactive layer to study how we could introduce ad-hoc systems for building-users. The aim of this paper is to describe our vision and initial attempts followed by discussion.

Train drivers as well as signallers interact with several computer based information and communication systems to ensure safe and effective train operations. So far the technical progress mostly determines the design of such interactive systems and requirements out of a human factors perspective are not integrated. Beside the development of technical functions it is essential to take the usability as a quality attribute of every interactive system into account. If the usability is not considered during system development, it could occur that there are several functions available within a system but the user does not know how to use them in an efficient way. This chapter describes a psychological approach to design or redesign usable interactive systems within the railway domain. Some examples will be discussed to demonstrate the approach and the results.

Interactive cinema will soon be a reality, following the current evolution of computer games. So far, however, interactivity is still limited, in particular because it is based on conscious operations of the viewer (e.g. through buttons, joystick, keyboards, voice, gestures). Instead, it would be desirable to adapt the movie plot to the viewers state of mind, without the need of deliberate actions, just by means of thoughts, unconscious preferences, and feelings. Such an interaction would represent an interesting alternative to traditional ways of movie watching, and an advance with respect to more mechanical types of interactivity.