Author: "Popular interaction with 3d content (Potioc)" / Search Limiters: Full Text - Searchworks@Jio Institute Digital Library Search Results

Your search keyword '"Popular interaction with 3d content (Potioc)"' showing total 244 results

Start Over Author "Popular interaction with 3d content (Potioc)" Search Limiters Full Text

244 results on '"Popular interaction with 3d content (Potioc)"'

1. Towards Truly Accessible MOOCs for Persons with Cognitive Disabilities: Design and Field Assessment

Author: Pascal Guitton, Pierre-Antoine Cinquin, Hélène Sauzéon, Université de Bordeaux ( UB ), Laboratoire Handicap Activité Cognition et Système Nerveux ( HACS ), Popular interaction with 3d content ( Potioc ), Laboratoire Bordelais de Recherche en Informatique ( LaBRI ), Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique ( Inria ) -Institut National de Recherche en Informatique et en Automatique ( Inria ), Programming Language Technology For Communication Services ( Phoenix ), Institut National de Recherche en Informatique et en Automatique ( Inria ) -Institut National de Recherche en Informatique et en Automatique ( Inria ) -Handicap et système nerveux :Action, communication, interaction: rétablissement de la fonction et de la participation [Bordeaux] ( EA4136 ), UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2]-UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2], Cinquin, Pierre-Antoine, Université de Bordeaux (UB), Laboratoire Handicap Activité Cognition et Système Nerveux (HACS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Programming Language Technology For Communication Services (Phoenix), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Handicap et système nerveux :Action, communication, interaction: rétablissement de la fonction et de la participation [Bordeaux] (EA4136), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Handicap et système nerveux :Action, communication, interaction: rétablissement de la fonction et de la participation [Bordeaux] (EA4136), UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2]-UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2]-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Bordelais de Recherche en Informatique (LaBRI), and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)
Subjects: Cognitive disabilities, Computer science, Process (engineering), Ability based design, Internet privacy, Usability, [SCCO.COMP]Cognitive science/Computer science, 050109 social psychology, MOOC, Field (computer science), [SCCO.COMP] Cognitive science/Computer science, Participatory design, 0501 psychology and cognitive sciences, Set (psychology), 050107 human factors, business.industry, Instructional design, 4. Education, 05 social sciences, Cognition, Universal Design for Learning, Accessibility, Participatory Design, [ SCCO.COMP ] Cognitive science/Computer science, business
Abstract: International audience; MOOCs are playing an increasingly important role in education systems. Unfortunately, MOOCs are not fully accessible. In this paper, we propose design principles to enhance the accessibility of MOOC players, especially for persons with cognitive disabilities. These principles result from a participatory design process gathering 7 persons with disabilities and 13 expert professionals. They are also inspired by various design approaches (Universal Design for Learning, Instructional Design, Environmental Support). We also detail the creation of a MOOC player offering a set of accessibility features that users can alter according to their needs and capabilities. We used it to teach a MOOC on digital accessibility. Finally, we conducted a field study to assess learning and usability outcomes for persons with cognitive and non-cognitive impairments. Results support the effectiveness of our player for increasing accessibility.
Published: 2018

2. Dišimo: Anchoring Our Breath

Author: Jérémy Frey, Jelena Mladenović, Jessica R. Cauchard, Interdisciplinary Center [Israël] (IDC), Interdisciplinary Center, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Ullo, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Interdisciplinary Center [Israël] ( IDC ), Popular interaction with 3d content ( Potioc ), Laboratoire Bordelais de Recherche en Informatique ( LaBRI ), Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique ( Inria ) -Institut National de Recherche en Informatique et en Automatique ( Inria )
Subjects: Ambient display, Computer science, medicine.medical_treatment, Diaphragmatic breathing, Anchoring, Biofeedback, 02 engineering and technology, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.2: User Interfaces/H.5.2.7: Interaction styles (e.g., commands, menus, forms, direct manipulation), ACM : H.: Information Systems/H.1: MODELS AND PRINCIPLES/H.1.2: User/Machine Systems/H.1.2.1: Human information processing, [ INFO.INFO-HC ] Computer Science [cs]/Human-Computer Interaction [cs.HC], Human–computer interaction, ACM : H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.2: User Interfaces/H.5.2.7: Interaction styles (e.g., commands, menus, forms, direct manipulation), 0202 electrical engineering, electronic engineering, information engineering, medicine, Heart rate variability, 0501 psychology and cognitive sciences, Cardiac coherence, Session (computer science), [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Pace, Focus (computing), Relaxation (psychology), 05 social sciences, ACM: H.: Information Systems/H.1: MODELS AND PRINCIPLES/H.1.2: User/Machine Systems/H.1.2.1: Human information processing, 020207 software engineering
Abstract: International audience; We present a system that raises awareness about users' inner state. Dišimo is a multimodal ambient display that provides feedback about one's stress level, which is assessed through heart rate monitoring. Upon detecting a low heart rate variability for a prolonged period of time, Dišimo plays an audio track, setting the pace of a regular and deep breathing. Users can then choose to take a moment to focus on their breath. By doing so, they will activate the Dišimo devices belonging to their close ones, who can then join for a shared relaxation session.
Published: 2018
Full Text: View/download PDF

3. Towards VE that are More Closely Related to the Real World

Author: Guillaume Moreau, Géry Casiez, Martin Hachet, Xavier Granier, Vincent Lepetit, Olivier Nannipieri, Technology and knowledge for interaction (LOKI), Inria Lille - Nord Europe, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS)-Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Laboratoire Photonique, Numérique et Nanosciences (LP2N), Université de Bordeaux (UB)-Institut d'Optique Graduate School (IOGS)-Centre National de la Recherche Scientifique (CNRS), Melting the frontiers between Light, Shape and Matter (MANAO), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Photonique, Numérique et Nanosciences (LP2N), Université de Bordeaux (UB)-Institut d'Optique Graduate School (IOGS)-Centre National de la Recherche Scientifique (CNRS)-Institut d'Optique Graduate School (IOGS)-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB), École Centrale de Nantes (ECN), Ambiances, Architectures, Urbanités (AAU ), École Centrale de Nantes (ECN)-École nationale supérieure d'architecture de Nantes (ENSA Nantes)-École nationale supérieure d'architecture de Grenoble (ENSAG)-Ministère de la Culture et de la Communication (MCC)-Centre National de la Recherche Scientifique (CNRS), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Institut mediterranéen des sciences de l'information et de la communication (IMSIC), Aix Marseille Université (AMU)-Université de Toulon (UTLN), Bruno Arnaldi, Pascal Guitton, Guillaume Moreau, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, École nationale supérieure d'architecture de Nantes (ENSA Nantes)-Ministère de la Culture et de la Communication (MCC)-École nationale supérieure d'architecture de Grenoble (ENSAG)-Centre National de la Recherche Scientifique (CNRS)-École Centrale de Nantes (ECN), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Toulon (UTLN)-Aix Marseille Université (AMU), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189 (CRIStAL), Ecole Centrale de Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS)-Ecole Centrale de Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189 (CRIStAL), Ecole Centrale de Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Inria Bordeaux - Sud-Ouest, Université de Bordeaux (UB)-Institut d'Optique Graduate School (IOGS)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-Institut d'Optique Graduate School (IOGS)-Centre National de la Recherche Scientifique (CNRS), Ambiances, Architectures, Urbanités (AAU), École Centrale de Nantes (ECN)-École nationale supérieure d'architecture de Grenoble (ENSAG)-École nationale supérieure d'architecture de Nantes (ENSA Nantes)-Centre National de la Recherche Scientifique (CNRS)-Ministère de la Culture et de la Communication (MCC), Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes 1 (UR1), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Université de Toulon (UTLN), Technology and knowledge for interaction ( LOKI ), Institut National de Recherche en Informatique et en Automatique ( Inria ) -Institut National de Recherche en Informatique et en Automatique ( Inria ), Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189 ( CRIStAL ), Ecole Centrale de Lille-Institut National de Recherche en Informatique et en Automatique ( Inria ) -Institut Mines-Télécom [Paris]-Université de Lille-Centre National de la Recherche Scientifique ( CNRS ), Institut d'Optique Graduate School ( IOGS ), Popular interaction with 3d content ( Potioc ), Laboratoire Bordelais de Recherche en Informatique ( LaBRI ), Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Inria Bordeaux - Sud-Ouest, Université de Bordeaux ( UB ), École Centrale de Nantes ( ECN ), Ambiances, Architectures, Urbanités ( AAU ), École Centrale de Nantes ( ECN ) -École nationale supérieure d'architecture de Nantes ( ENSA Nantes ) -École nationale supérieure d'architecture de Grenoble ( ENSAG ) -Ministère de la Culture et de la Communication ( MCC ) -Centre National de la Recherche Scientifique ( CNRS ), 3D interaction with virtual environments using body and mind ( Hybrid ), Institut National de Recherche en Informatique et en Automatique ( Inria ) -Institut National de Recherche en Informatique et en Automatique ( Inria ) -MEDIA ET INTERACTIONS ( IRISA_D6 ), Institut de Recherche en Informatique et Systèmes Aléatoires ( IRISA ), Université de Rennes 1 ( UR1 ), Université de Rennes ( UNIV-RENNES ) -Université de Rennes ( UNIV-RENNES ) -Institut National des Sciences Appliquées - Rennes ( INSA Rennes ) -Université de Bretagne Sud ( UBS ) -École normale supérieure - Rennes ( ENS Rennes ) -Institut National de Recherche en Informatique et en Automatique ( Inria ) -CentraleSupélec-Centre National de la Recherche Scientifique ( CNRS ) -IMT Atlantique Bretagne-Pays de la Loire ( IMT Atlantique ) -Université de Rennes 1 ( UR1 ), Université de Rennes ( UNIV-RENNES ) -Université de Rennes ( UNIV-RENNES ) -Institut National des Sciences Appliquées - Rennes ( INSA Rennes ) -Université de Bretagne Sud ( UBS ) -École normale supérieure - Rennes ( ENS Rennes ) -Institut National de Recherche en Informatique et en Automatique ( Inria ) -CentraleSupélec-Centre National de la Recherche Scientifique ( CNRS ) -IMT Atlantique Bretagne-Pays de la Loire ( IMT Atlantique ) -Institut de Recherche en Informatique et Systèmes Aléatoires ( IRISA ), Université de Rennes ( UNIV-RENNES ) -Université de Rennes ( UNIV-RENNES ) -Institut National des Sciences Appliquées - Rennes ( INSA Rennes ) -Université de Bretagne Sud ( UBS ) -École normale supérieure - Rennes ( ENS Rennes ) -CentraleSupélec-Centre National de la Recherche Scientifique ( CNRS ) -IMT Atlantique Bretagne-Pays de la Loire ( IMT Atlantique ), and Université de Toulon ( UTLN )
Subjects: 3D interaction, Computer science, Computation, 05 social sciences, Digital data, 020207 software engineering, 02 engineering and technology, Interaction Styles, [ INFO.INFO-GR ] Computer Science [cs]/Graphics [cs.GR], Field (computer science), [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], [ INFO.INFO-HC ] Computer Science [cs]/Human-Computer Interaction [cs.HC], Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, Natural (music), 0501 psychology and cognitive sciences, Augmented reality, State (computer science), [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, ComputingMilieux_MISCELLANEOUS
Abstract: International audience; This chapter provides an overview of the current state of augmented reality (AR). It examines the questions of pose computation, which could be used to locate a user in an immersive room or to model the real world, interactions in AR, and the concept of presence in environments that combine real and virtual elements. The chapter describes important innovations in the field of 3D interaction over the last decade. While 3D interaction is less central to AR, its importance is rising nonetheless. From simple applications to visualize digital data that is superimposed on the natural view, RA systems today are offering users increasingly more refined interaction systems in order to enhance usage. The chapter overviews recent developments allowing users to easily and efficiently interact with 3D content displayed on tactile surfaces. In the current interfaces, a trend towards an integration of the interaction styles can be observed.
Published: 2018
Full Text: View/download PDF

4. Pano: Design and Evaluation of a 360° Through-the-Lens Technique

Author: Pascal Guitton, Damien Clergeaud, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Popular interaction with 3d content ( Potioc ), Laboratoire Bordelais de Recherche en Informatique ( LaBRI ), Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Centre National de la Recherche Scientifique ( CNRS ) -École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique ( Inria ) -Institut National de Recherche en Informatique et en Automatique ( Inria ), and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest
Subjects: 0301 basic medicine, Multimedia, Computer science, Window (computing), K7m [The Computing Profession]: Miscellaneous—Ethics, 020207 software engineering, Body movement, 02 engineering and technology, [ INFO.INFO-GR ] Computer Science [cs]/Graphics [cs.GR], Virtual reality, computer.software_genre, Object (computer science), [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Through-the-lens metering, Task (project management), 03 medical and health sciences, K61 [Management of Computing and Information Systems]: Project and People Management—Life Cycle, 030104 developmental biology, Human–computer interaction, Virtual image, Virtual machine, 0202 electrical engineering, electronic engineering, information engineering, computer
Abstract: International audience; Virtual Reality experiments have enabled immersed users to perform virtual tasks in a Virtual Environment (VE). Before beginning a task, however, users must locate and select the different objects they will need in the VE. This first step is important and affects global performance in the virtual task. If a user takes too long to locate and select an object, the duration of the task is increased. Moreover, both the comfort and global efficiency of users deteriorate as search and selection time increase. We have developed Pano, a technique which reduces this time by increasing the users natural field of view. More precisely, we provide a 360 panoramic virtual image which is displayed on a specific window, called the PanoWindow. Thanks to the PanoWindow, users can perceive and interact with the part of the Virtual Environment (VE) that is behind them without any additional head or body movement. In this paper, we present two user studies with 30 and 21 participants in different VEs. For the first study, participants were invited to perform object-finding tasks with and without Pano. The second study involved position-estimating tasks in order to know if the PanoWindow image enables users to build an accurate representation of the environment. First, the results show that Pano both reduces task duration and improves user comfort. Second, they demonstrate that good object-localization accuracy can be achieved using Pano.
Published: 2017
Full Text: View/download PDF

5. Gazealytics: A Unified and Flexible Visual Toolkit for Exploratory and Comparative Gaze Analysis

Author: Kun-Ting Chen, Arnaud Prouzeau, Joshua Langmead, Ryan T Whitelock-Jones, Lee Lawrence, Tim Dwyer, Christophe Hurter, Daniel Weiskopf, Sarah Goodwin, University of South Australia [Adelaide], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Monash University [Melbourne], Monash university, Ecole Nationale de l'Aviation Civile (ENAC), Visualization Research Center [Stuttgart] (VISUS), and Universität Stuttgart [Stuttgart]
Subjects: FOS: Computer and information sciences, Eye tracking, time window of interest, matrix-based overview, Computer Science - Human-Computer Interaction, [INFO]Computer Science [cs], visual analytics, area of interest, group-level visualisation, Human-Computer Interaction (cs.HC)
Abstract: International audience; We present a novel, web-based visual eye-tracking analytics tool called Gazealytics. Our open-source toolkit features a unified combination of gaze analytics features that support flexible exploratory analysis, along with annotation of areas of interest (AOI) and filter options based on multiple criteria to visually analyse eye tracking data across time and space. Gazealytics features coordinated views unifying spatiotemporal exploration of fixations and scanpaths for various analytical tasks. A novel matrix representation allows analysis of relationships between such spatial or temporal features. Data can be grouped across samples, user-defined AOIs or time windows of interest (TWIs) to support aggregate or filtered analysis of gaze activity. This approach exceeds the capabilities of existing systems by supporting flexible comparison between and within subjects, hypothesis generation, data analysis and communication of insights. We demonstrate in a walkthrough that Gazealytics supports multiple types of eye tracking datasets and analytical tasks.
Published: 2023
Full Text: View/download PDF

6. An Interdisciplinary Approach to Designing and Evaluating Data-Driven Interactive Experiences for Sustainable Decision-Making

Author: Jansen, Yvonne, Assor, Ambre, Dragicevic, Pierre, Ferron, Aymeric, Prouzeau, Prouzeau, Hachet, Martin, Le Gallic, Thomas, Ajdukovic, Ivan, Montagner, Eleonora, Spiegelman, Eli, Sutan, Angela, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Centre International de Recherche sur l'Environnement et le Développement (CIRED), Centre de Coopération Internationale en Recherche Agronomique pour le Développement (Cirad)-École des hautes études en sciences sociales (EHESS)-AgroParisTech-École des Ponts ParisTech (ENPC)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Laboratoire d'Expérimentation en Sciences Sociales et Analyse des Comportements (LESSAC), Burgundy School of Business (BSB) - Ecole Supérieure de Commerce de Dijon Bourgogne (ESC) (BSB), and ANR-22-CE33-0003,Be-aware,Rapprocher les questions environnementales du public avec la réalité augmentée(2022)
Subjects: interdisciplinarity, evaluation, modeling, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Sustainable HCI
Abstract: International audience; Running long-term field studies is a valuable yet slow and costly approach to test the efficacy of interaction designs on people's everyday decision making and behavior. In this position paper we describe the rationale behind an interdisciplinary approach to designing and evaluating data-driven interactive experiences for sustainable decision-making. We are a group consisting of HCI and visualization researchers, energy-economy modeling experts who work on mitigation pathways, and behavioral economists who run controlled experiments to study how people make decisions in an incentivized context. The intent of this collaboration is twofold: (1) we study how to design efficient data-driven experiences to help people build an intuition concerning the sustainability of daily choices and actions; (2) we explore the mutual benefit of working across disciplinary boundaries to go beyond the limits of our respective methodological toolboxes. We illustrate our approach through an example of a work-in-progress.
Published: 2023
Full Text: View/download PDF

7. Exploring How Visualization Design and Situatedness Evoke Compassion in the Wild

Author: L. Morais, N. Andrade, D. Sousa, Luiz, Morais, Visualisations situées pour l'analyse de données personnelles - - EMBER2019 - ANR-19-CE33-0012 - AAPG2019 - VALID, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Universidade Federal de Campina Grande [Campina Grande] (UFCG), and ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019)
Subjects: [INFO.INFO-CY] Computer Science [cs]/Computers and Society [cs.CY], [INFO.INFO-CY]Computer Science [cs]/Computers and Society [cs.CY], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Computer Graphics and Computer-Aided Design
Abstract: International audience; This work explores how the design and situatedness of data representations affect people’s compassion with a case study concerning harassment episodes in a public place. Results contribute to advancing the understanding of how visualizations can evoke emotions and their impact on prosocial behaviors, such as helping people in need. Recent literature examined the effect of different on-screen data representations on emotion or prosociality, but little has been done concerning visualizations shown in a public place — especially a space contextually relevant to the data — or presented through unconventional media formats such as physical marks. We conducted two in-the-wild studies to investigate how different factors affect people’s self-reported compassion and intention to donate. We compared three ways of presenting data about the harassment cases: (1) communicating data only verbally; (2) using a printed poster with aggregated information; and (3) using a physicalization with detailed information about each story. We found that the physicalization influenced people to donate more than only hearing about the data, but it is unclear if the same applied to the poster visualization. Also, passers-by reported a likely small increase in compassion when they saw the physicalization instead of the poster. We also examined the role of situatedness by showing the physicalization in a site that is not contextually relevant to the data. Our results suggest that people had a similar intention to donate and levels of compassion in both places. Those findings may indicate that using specific visualization designs to support campaigns about sensitive causes (e.g., sexual harassment) can increase the emotional response of passers-by and may motivate them to help, independently of where the data representation is shown. Finally, this work also informs on the strengths and weaknesses of using research in the wild to evaluate data visualizations in public spaces.
Published: 2022
Full Text: View/download PDF

8. Augmented Reality Waste Accumulation Visualizations

Author: Assor, Ambre, Prouzeau, Arnaud, Dragicevic, Pierre, Hachet, Martin, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019), and Assor, Ambre
Subjects: Concrete Scales, Augmented Reality, [SDE.IE]Environmental Sciences/Environmental Engineering, Embedded Visualizations, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Augmented Reality AR, [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Eco-Feedback
Abstract: The negative impact humans have on the environment is partly caused by thoughtless consumption leading to unnecessary waste. A likely contributing factor is the relative invisibility of waste: waste produced by individuals is either out of their sight or quickly taken away. Nevertheless, waste disposal systems sometimes break down, creating natural information displays of waste production that can have educational value. We take inspiration from such natural displays and introduce a class of situated visualizations we call augmented-reality waste accumulation visualizations or ARwavs, which are literal representations of waste data embedded in users' familiar environment. We implemented examples of ARwavs and demonstrated them in feedback sessions with experts in pro-environmental behavior, and during a large tech exhibition event. We discuss general design principles and trade-offs for ARwavs. Finally, we conducted a study suggesting that ARwavs yield stronger emotional responses than non-immersive waste accumulation visualizations and plain numbers.
Published: 2023

9. Deimos: A Grammar of Dynamic Embodied Immersive Visualisation Morphs and Transitions

Author: Benjamin Lee, Arvind Satyanarayan, Maxime Cordeil, Arnaud Prouzeau, Bernhard Jenny, Tim Dwyer, Monash university, MIT Computer Science & Artificial Intelligence Lab (MIT CSAIL), Massachusetts Institute of Technology (MIT), University of Queensland [Brisbane], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: FOS: Computer and information sciences, Grammar, User study, Immersive Analytics, Animated transitions, Computer Science - Human-Computer Interaction, [INFO]Computer Science [cs], Embodied interaction, Data visualisation, Human-Computer Interaction (cs.HC)
Abstract: We present Deimos, a grammar for specifying dynamic embodied immersive visualisation morphs and transitions. A morph is a collection of animated transitions that are dynamically applied to immersive visualisations at runtime and is conceptually modelled as a state machine. It is comprised of state, transition, and signal specifications. States in a morph are used to generate animation keyframes, with transitions connecting two states together. A transition is controlled by signals, which are composable data streams that can be used to enable embodied interaction techniques. Morphs allow immersive representations of data to transform and change shape through user interaction, facilitating the embodied cognition process. We demonstrate the expressivity of Deimos in an example gallery and evaluate its usability in an expert user study of six immersive analytics researchers. Participants found the grammar to be powerful and expressive, and showed interest in drawing upon Deimos' concepts and ideas in their own research., Comment: CHI 2023
Published: 2023
Full Text: View/download PDF

10. Simple Probabilistic Data-driven Model for Adaptive BCI Feedback

Author: Jelena Mladenović, Fabien Lotte, Jérémie Mattout, Jérémy Frey, Computer Science Faculty RAFLab, Union University, Belgrade (RAF), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Centre de recherche en neurosciences de Lyon - Lyon Neuroscience Research Center (CRNL), Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Université Jean Monnet - Saint-Étienne (UJM)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS), CIC CHU Lyon (inserm), Université de Lyon-Université de Lyon-Institut National de la Santé et de la Recherche Médicale (INSERM), Université de Lyon, Ullo, ERC BrainConquest, European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Mladenovic, Jelena, and Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-SY] Computer Science [cs]/Systems and Control [cs.SY], Dynamic Behaviour, [INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing, Adaptive modeling, EEG Signal, [SCCO.COMP]Cognitive science/Computer science, [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-MO]Computer Science [cs]/Modeling and Simulation, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.EIAH] Computer Science [cs]/Technology for Human Learning, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [SCCO.COMP] Cognitive science/Computer science, [INFO.INFO-SY]Computer Science [cs]/Systems and Control [cs.SY], [INFO.EIAH]Computer Science [cs]/Technology for Human Learning, [INFO.INFO-MO] Computer Science [cs]/Modeling and Simulation, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Brain-computer interfaces BCI
Abstract: International audience; Due to abundant signal and user variability among others, BCIs remain difficult to control. To increase performance, adaptive methods are a necessary means to deal with such a vast spectrum of variable data. Typically, adaptive methods deal with the signal or classification corrections (adaptive spatial filters [1], co-adaptive calibration [2], adaptive classifiers [3]). As such, they do not necessarily account for the implicit alterations they perform on the feedback (in real-time), and in turn, on the user, creating yet another potential source of unpredictable variability. Namely, certain user's personality traits and states have shown to correlate with BCI performance, while feedback can impact user states [4]. For instance, altered (biased) feedback was distorting the participants' perception over their performance, influencing their feeling of control, and online performance [5]. Thus, one can assume that through feedback we might implicitly guide the user towards a desired state beneficial for BCI performance. We propose a novel, simple probabilistic, data-driven dynamic model to provide such feedback that will maximize performance.
Published: 2022

11. Envisioning Situated Visualizations of Environmental Footprints in an Urban Environment

Author: Jansen, Yvonne, Bucchieri, Federica, Dragicevic, Pierre, Hachet, Martin, Koval, Morgane, Petiot, Léana, Prouzeau, Arnaud, Schmalstieg, Dieter, Yao, Lijie, Isenberg, Petra, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Analysis and Visualization (AVIZ), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Graz University of Technology [Graz] (TU Graz), and ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019)
Subjects: workshop, Situated visualization, environmental footprint, workshop, ideation exercise, Situated visualization, ideation exercise, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], environmental footprint
Abstract: International audience; We present the results of a brainstorming exercise focused on how situated visualizations could be used to better understand the state of the environment and our personal behavioral impact on it. Specifically, we conducted a day long workshop in the French city of Bordeaux where we envisioned situated visualizations of urban environmental footprints. We explored the city and took photos and notes about possible situated visualizations of environmental footprints that could be embedded near places, people, or objects of interest. We found that our designs targeted four purposes and used four different methods that could be further explored to test situated visualizations for the protection of the environment.
Published: 2022
Full Text: View/download PDF

12. Towards curating personalized art exhibitions in Virtual Reality with multimodal Brain-Computer-Interfaces

Author: Welter, Marc, Bouneau, Axel, Lotte, Fabien, Ward, Tomas, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Dublin City University [Dublin] (DCU), ANR-21-CHRA-0003,BITSCOPE,Brain Integrated Tagging for Socially Curated Online Personalised Experiences(2021), Welter, Marc, and Brain Integrated Tagging for Socially Curated Online Personalised Experiences - - BITSCOPE2021 - ANR-21-CHRA-0003 - CHIST-ERA - VALID
Subjects: [SCCO]Cognitive science, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [SHS.ART] Humanities and Social Sciences/Art and art history, [SCCO] Cognitive science, [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], [SHS.ART]Humanities and Social Sciences/Art and art history
Abstract: International audience; Today, we live in an age of 'Like' where appreciation of digital content is expressed constantly by interacting with feedback icons. In contrast, Brain-Computer-Interfaces (BCIs) can decode cognitive states from neural signals without explicit user feedback that interrupts aesthetic experiences (AEs). This recently started project will elucidate the neuro-cognitive mechanisms behind art appreciation and implement an Electroencephalography (EEG)-based BCI to detect physiological correlates of artwork preference in order to curate personalized art exhibitions in Virtual Reality. Most EEG recordings in visual neuroaesthetics focused on Event-Related Potentials, often using paradigms with unatural viewing conditions. On the other hand, the neural dynamics during visual art appreciation remain obscure and previous studies reported conflicting results. Furthermore, the liking of visual artworks was mostly investigated from the perspective of beauty or pleasantness, concepts which are not applicable to all aesthetic pleasures. We hypothesize instead that art preferences in general depend on rewarding AEs. Therefore, we will develop novel algorithms to decode and discriminate EEG neuromarkers of hedonic AEs. In a first step, we conceptualized neuro-cognitive components of AE, such as attention, emotion and intrinsic reward, as well as their established EEG neuromarkers. In the future, we will record EEG and other physiological measures, e.g. eye-tracking and heart rate, in naturalistic single trial experiments, use advanced Machine Learning to detect artwork preference and recommend further objects based on this multimodal information. Finally, we embrace open science and will make subject data and BCI algorithms publicly accessible.
Published: 2022

13. ERD modulations during motor imageries relate to users’ traits and BCI performances

Author: Sebastien Rimbert, Fabien Lotte, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), This work was supported by the ERC with project Brain-Conquest (grant ERC-2016-STG-714567), European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), RIMBERT, Sébastien, and Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID
Subjects: Imagery, Psychotherapy, Neurophysiology, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, Electroencephalography, [INFO] Computer Science [cs], Hand, [STAT.ML] Statistics [stat]/Machine Learning [stat.ML], [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], Brain-Computer Interfaces, Humans, [INFO]Computer Science [cs], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], [SDV.NEU.SC] Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences
Abstract: International audience; Improving user performances is one of the major issues for Motor Imagery (MI)-based BCI control. MI-BCIs exploit the modulation of sensorimotor rhythms (SMR) over the motor and sensorimotor cortices to discriminate several mental states and enable user interaction. Such modulations are known as Event-Related Desynchronization (ERD) and Synchronization (ERS), coming from the mu (7-13 Hz) and beta (15-30 Hz) frequency bands. This kind of BCI opens up promising fields, particularly to control assistive technologies, for sport training or even for post-stroke motor rehabilitation. However, MI-BCIs remain barely used outside laboratories, notably due to their lack of robustness and usability (15 to 30% of users seem unable to gain control of an MI-BCI). One way to increase user performance would be to better understand the relationships between user traits and ERD/ERS modulations underlying BCI performance. Therefore, in this article we analyzed how cerebral motor patterns underlying MI tasks (i.e., ERDs and ERSs) are modulated depending (i) on nature of the task (i.e., right-hand MI and left-hand MI), (ii) the session during which the task was performed (i.e., calibration or user training) and (iii) on the characteristics of the user (e.g., age, gender, manual activity, personality traits) on a large MI-BCI data base of N=70 participants. One of the originality of this study is to combine the investigation of human factors related to the user's traits and the neurophysiological ERD modulations during the MI task. Our study revealed for the first time, associations between ERD and both age, level of study, impression management and anxiety.
Published: 2022

14. X-Road

Author: Lauren Thévin, Carine Briant, Anke Brock, Ludwig Maximilian University [Munich] (LMU), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institution Régionale des Sourds et des Aveugles (IRSA), ENAC - Equipe Informatique Interactive (LII), Ecole Nationale de l'Aviation Civile (ENAC), This project was conducted with the support of the Erasmus+ Program of the European Union Pr. no 2016-1-EL01-KA201-023731., and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Computer science, Visual impairment, Augmented reality, 02 engineering and technology, Space (commercial competition), Virtual reality, Training (civil), Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, medicine, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Bespoke, 05 social sciences, Orientation and Mobility, 020207 software engineering, Accessibility, Computer Science Applications, Human-Computer Interaction, Mobility training, Audio feedback, medicine.symptom
Abstract: International audience; Orientation and Mobility (O&M) classes teach people with visual impairments how to navigate the world, for instance how to cross a road. Yet, this training can be difficult and dangerous due to conditions such as traffic and weather. Virtual Reality (VR) can overcome these challenges by providing interactive controlled environments. However, most existing VR tools rely on visual feedback, which limits their use with students with visual impairment. In a collaborative design approach with O&M instructors, we designed an affordable and accessible VR system for O&M classes, called X-Road. Using a smartphone and a bespoke headmount, X-Road provides both visual and audio feedback and allows users to move in space, as in the real world. In a study with 13 students with visual impairments, X-Road proved to be an effective alternative to teaching and learning classical O&M tasks, and both students and instructors were enthusiastic about this technology. We conclude with design recommendations for inclusive VR systems.
Published: 2020
Full Text: View/download PDF

15. Riemannian Channel Selection for BCI With Between-Session Non-Stationarity Reduction Capabilities

Author: Fabien Lotte, Khadijeh Sadatnejad, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017)
Subjects: General Neuroscience, MESH: channel selection, Rehabilitation, Biomedical Engineering, Electroencephalography, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, MESH: non-stationarity, Brain-Computer Interfaces, MESH: EEG, MESH: Brain-computer interfaces, Internal Medicine, MESH: Riemannian manifold, Humans, [MATH.MATH-AG]Mathematics [math]/Algebraic Geometry [math.AG], [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Algorithms
Abstract: L'institution a financé les frais de publication pour que cet article soit en libre accès; International audience; Objective: Between-session non-stationarity is a major challenge of current Brain-Computer Interfaces (BCIs) that affects system performance. In this paper, we investigate the use of channel selection for reducing between-session non-stationarity with Riemannian BCI classifiers. We use the Riemannian geometry framework of covariance matrices due to its robustness and promising performances. Current Riemannian channel selection methods do not consider between-session non-stationarity and are usually tested on a single session. Here, we propose a new channel selection approach that specifically considers non-stationarity effects and is assessed on multi-session BCI data sets. Methods: We remove the least significant channels using a sequential floating backward selection search strategy. Our contributions include: 1) quantifying the non-stationarity effects on brain activity in multi-class problems by different criteria in a Riemannian framework and 2) a method to predict whether BCI performance can improve using channel selection. Results: We evaluate the proposed approaches on three multi-session and multi-class mental tasks (MT)-based BCI datasets. They could lead to significant improvements in performance as compared to using all channels for datasets affected by between-session non-stationarity and to significant superiority to the state-of-the-art Riemannian channel selection methods over all datasets, notably when selecting small channel set sizes. Conclusion: Reducing non-stationarity by channel selection could significantly improve Riemannian BCI classification accuracy. Significance: Our proposed channel selection approach contributes to make Riemannian BCI classifiers more robust to between-session non-stationarities.
Published: 2022
Full Text: View/download PDF

16. Retrospective on the First Passive Brain-Computer Interface Competition on Cross-Session Workload Estimation

Author: Roy, Raphaëlle N., Hinss, Marcel F., Darmet, Ludovic, Ladouce, Simon, Jahanpour, Emilie S., Somon, Bertille, Xu, Xiaoqi, Drougard, Nicolas, Dehais, Frédéric, Lotte, Fabien, Institut Supérieur de l'Aéronautique et de l'Espace (ISAE-SUPAERO), Université de Toulouse (UT), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), This work was funded by ANITI (Artificial and Natural Intelligence Toulouse Institute), Toulouse, France. FL was also supported by the European Research Council with project BrainConquest (grant ERC-2016-STG-714567)., European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Centre National de la Recherche Scientifique - CNRS (FRANCE), Ecole Nationale Supérieure d’Electronique, Informatique et Radiocommunications de Bordeaux - ENSEIRB (FRANCE), Institut National de la Recherche en Informatique et en Automatique - INRIA (FRANCE), Institut Supérieur de l'Aéronautique et de l'Espace - ISAE-SUPAERO (FRANCE), Artificial and Natural Intelligence Toulouse Institute - ANITI (FRANCE), and Université de Bordeaux (FRANCE)
Subjects: passive brain-computer interface, estimation, Workload, Passive brain-computer interface, workload, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], Benchmarking, Autre, cross-session variability, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, dataset, Cross-session variability, benchmarking, EEG, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Riemannian geometry, [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Estimation, Dataset
Abstract: As is the case in several research domains, data sharing is still scarce in the field of Brain-Computer Interfaces (BCI), and particularly in that of passive BCIs—i.e., systems that enable implicit interaction or task adaptation based on a user's mental state(s) estimated from brain measures. Moreover, research in this field is currently hindered by a major challenge, which is tackling brain signal variability such as cross-session variability. Hence, with a view to develop good research practices in this field and to enable the whole community to join forces in working on cross-session estimation, we created the first passive brain-computer interface competition on cross-session workload estimation. This competition was part of the 3rd International Neuroergonomics conference. The data were electroencephalographic recordings acquired from 15 volunteers (6 females; average 25 y.o.) who performed 3 sessions—separated by 7 days—of the Multi-Attribute Task Battery-II (MATB-II) with 3 levels of difficulty per session (pseudo-randomized order). The data -training and testing sets—were made publicly available on Zenodo along with Matlab and Python toy code (https://doi.org/10.5281/zenodo.5055046). To this day, the database was downloaded more than 900 times (unique downloads of all version on the 10th of December 2021: 911). Eleven teams from 3 continents (31 participants) submitted their work. The best achieving processing pipelines included a Riemannian geometry-based method. Although better than the adjusted chance level (38% with an α at 0.05 for a 3-class classification problem), the results still remained under 60% of accuracy. These results clearly underline the real challenge that is cross-session estimation. Moreover, they confirmed once more the robustness and effectiveness of Riemannian methods for BCI. On the contrary, chance level results were obtained by one third of the methods—4 teams- based on Deep Learning. These methods have not demonstrated superior results in this contest compared to traditional methods, which may be due to severe overfitting. Yet this competition is the first step toward a joint effort to tackle BCI variability and to promote good research practices including reproducibility.
Published: 2022
Full Text: View/download PDF

17. Detection of Motor Cerebral Activity After Median Nerve Stimulation During General Anesthesia (STIM-MOTANA): Protocol for a Prospective Interventional Study

Author: Sébastien Rimbert, Julien Lelarge, Philippe Guerci, Seyed Javad Bidgoli, Claude Meistelman, Guy Cheron, Ana Maria Cebolla Alvarez, Denis Schmartz, Centre Hospitalier Universitaire Brugmann [Bruxelles] (CHU), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université libre de Bruxelles (ULB), Centre Hospitalier Régional Universitaire de Nancy (CHRU Nancy), and Fondation BrugmannFNRS (Belgique)
Subjects: brain-computer interfaces, median nerve stimulation, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], [SCCO.NEUR]Cognitive science/Neuroscience, General Medicine, general anesthesia, intraoperative awareness, electroencephalography, [SDV.MHEP]Life Sciences [q-bio]/Human health and pathology
Abstract: Background Accidental awareness during general anesthesia (AAGA) is defined as an unexpected awareness of the patient during general anesthesia. This phenomenon occurs in 1%-2% of high-risk practice patients and can cause physical suffering and psychological after-effects, called posttraumatic stress disorder. In fact, no monitoring techniques are satisfactory enough to effectively prevent AAGA; therefore, new alternatives are needed. Because the first reflex for a patient during an AAGA is to move, but cannot do so because of the neuromuscular blockers, we believe that it is possible to design a brain-computer interface (BCI) based on the detection of movement intention to warn the anesthetist. To do this, we propose to describe and detect the changes in terms of motor cortex oscillations during general anesthesia with propofol, while a median nerve stimulation is performed. We believe that our results could enable the design of a BCI based on median nerve stimulation, which could prevent AAGA. Objective To our knowledge, no published studies have investigated the detection of electroencephalographic (EEG) patterns in relation to peripheral nerve stimulation over the sensorimotor cortex during general anesthesia. The main objective of this study is to describe the changes in terms of event-related desynchronization and event-related synchronization modulations, in the EEG signal over the motor cortex during general anesthesia with propofol while a median nerve stimulation is performed. Methods STIM-MOTANA is an interventional and prospective study conducted with patients scheduled for surgery under general anesthesia, involving EEG measurements and median nerve stimulation at two different times: (1) when the patient is awake before surgery (2) and under general anesthesia. A total of 30 patients will receive surgery under complete intravenous anesthesia with a target-controlled infusion pump of propofol. Results The changes in event-related desynchronization and event-related synchronization during median nerve stimulation according to the various propofol concentrations for 30 patients will be analyzed. In addition, we will apply 4 different offline machine learning algorithms to detect the median nerve stimulation at the cerebral level. Recruitment began in December 2022. Data collection is expected to conclude in June 2024. Conclusions STIM-MOTANA will be the first protocol to investigate median nerve stimulation cerebral motor effect during general anesthesia for the detection of intraoperative awareness. Based on strong practical and theoretical scientific reasoning from our previous studies, our innovative median nerve stimulation–based BCI would provide a way to detect intraoperative awareness during general anesthesia. Trial Registration Clinicaltrials.gov NCT05272202; https://clinicaltrials.gov/ct2/show/NCT05272202 International Registered Report Identifier (IRRID) PRR1-10.2196/43870
Published: 2023
Full Text: View/download PDF

18. Perception! Immersion! Empowerment! Superpowers as Inspiration for Visualization

Author: Petra Isenberg, Bon Adriel Aseniero, Sheelagh Carpendale, Yvonne Jansen, Wesley Willett, Lora Oehlberg, Pierre Dragicevic, University of Calgary, Autodesk Reasearch [Toronto], Autodesk Reasearch, Department of Computer Science (Simon Fraser University), Simon Fraser University (SFU.ca), Analysis and Visualization (AVIZ), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: FOS: Computer and information sciences, Computer science, Vision, media_common.quotation_subject, Computer Science - Human-Computer Interaction, 02 engineering and technology, Comics, Human-Computer Interaction (cs.HC), Cognition, Intersection, Situated visualization, Perception, Immersion, 0202 electrical engineering, electronic engineering, information engineering, Computer Graphics, Fiction, Humans, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Set (psychology), Empowerment, media_common, Visualization, Cognitive science, superpowers, business.industry, 020207 software engineering, Computer Graphics and Computer-Aided Design, Variety (cybernetics), Signal Processing, Computer Vision and Pattern Recognition, business, Software
Abstract: We explore how the lens of fictional superpowers can help characterize how visualizations empower people and provide inspiration for new visualization systems. Researchers and practitioners often tout visualizations' ability to "make the invisible visible" and to "enhance cognitive abilities." Meanwhile superhero comics and other modern fiction often depict characters with similarly fantastic abilities that allow them to see and interpret the world in ways that transcend traditional human perception. We investigate the intersection of these domains, and show how the language of superpowers can be used to characterize existing visualization systems and suggest opportunities for new and empowering ones. We introduce two frameworks: The first characterizes seven underlying mechanisms that form the basis for a variety of visual superpowers portrayed in fiction. The second identifies seven ways in which visualization tools and interfaces can instill a sense of empowerment in the people who use them. Building on these observations, we illustrate a diverse set of "visualization superpowers" and highlight opportunities for the visualization community to create new systems and interactions that empower new experiences with data., 11 pages, 13 figures. To appear at IEEE VIS 2021. Supplemental material and illustrations are available at https://osf.io/8yhfz
Published: 2022
Full Text: View/download PDF

19. User-specific frequency band and time segment selection with high class distinctiveness for Riemannian BCIs

Author: Yamamoto, Maria Sayu, Lotte, Fabien, Yger, Florian, Chevallier, Sylvain, Lotte, Fabien, Programme Doctoral en Intelligence Artificielle de l'Université Paris-Saclay - - UDOPIA2020 - ANR-20-THIA-0013 - PNIA - VALID, Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID, Université Paris-Saclay, Laboratoire d'Ingénierie des Systèmes de Versailles (LISV), Université de Versailles Saint-Quentin-en-Yvelines (UVSQ), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision (LAMSADE), Université Paris Dauphine-PSL, Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Centre National de la Recherche Scientifique (CNRS), Université Paris sciences et lettres (PSL), ANR-20-THIA-0013,UDOPIA,Programme Doctoral en Intelligence Artificielle de l'Université Paris-Saclay(2020), and European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017)
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-BT] Computer Science [cs]/Biotechnology, [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing, [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Riemannian geometry, oscillatory activity based BCIs, frequency band and time segment selection, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Abstract: International audience; User-specific settings are known to enhance Brain-Computer Interface (BCI) performances. In particular, the optimal frequency band and time segment for oscillatory activity classification are highly user-dependent and many selection methods have been developed in the past two decades. However, it has not been studied well whether those conventional methods can provide optimal settings for the Riemannian BCIs, a recent family of BCI systems that utilize different data representation, based on covariance matrices, compared to conventional BCI pipelines. In this work, we proposed a novel frequency band and time segment selection method considering class distinctiveness on the Riemannian manifold. The class distinctiveness of each combination of frequency band and time segment is quantified based on inter-class distance and intra-class variance on the Riemannian manifold. An advantage of this method is the user-specific settings can be adjusted without computationally heavy optimization steps. To the best of our knowledge, this is the first optimization method for selecting both the frequency band and the time segment on the Riemannian manifold. We evaluated the contributions of the 3 different selection models (frequency band, time or frequency band+time), comparing classification accuracy with a baseline (a fixed frequency band of 8-30 Hz and a fixed 2s time window) and a conventional popular method for non-Riemannian BCIs, on the BCI competition IV dataset 2a (2-class motor imagery). Our method showed higher average accuracy than baseline and a conventional method in all three models, and especially the frequency band selection model showed the highest performance. This preliminary result suggests the importance of developing new selection algorithms considering the properties of the manifold, rather than directly applying methods developed prior to the rise of Riemannian BCIs as they are.
Published: 2022

20. Modeling subject perception and behaviour during neurofeedback training

Author: Annicchiarico, Côme, Lotte, Fabien, Mattout, Jérémie, Lotte, Fabien, Centre de recherche en neurosciences de Lyon - Lyon Neuroscience Research Center (CRNL), Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Université Jean Monnet - Saint-Étienne (UJM)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], Modeling, Active Inference, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-MO] Computer Science [cs]/Modeling and Simulation, Neurofeedback, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-MO]Computer Science [cs]/Modeling and Simulation, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Abstract: International audience; Neurofeedback training (NFT) describes a closed-loop paradigm in which a subject is provided with a real time evaluation of his/her brain activity. As a learning process, it is designed to help the subject learn to apprehend his/her own cognitive states and better modulate them through mental actions. Its use for therapeutic purposes has gained a lot of traction in the public sphere in the last decade, but conflicting evidence concerning its efficacy has led to a two-pronged effort from the scientific community. First, a call for experimental protocols and reports standardization [1], aiming to reduce the variability of the results and provide a reliable set of data to describe empirical findings. Second, an effort towards a formal description of the neurofeedback loop and the main hypotheses that guide the design of our experiments, in order to explain or even predict the effects of such training [2,3].
Published: 2022

21. Towards Immersive Humanitarian Visualizations

Author: Pierre Dragicevic, Dragicevic, Pierre, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: FOS: Computer and information sciences, Computer Science - Human-Computer Interaction, ComputerApplications_COMPUTERSINOTHERSYSTEMS, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Human-Computer Interaction (cs.HC)
Abstract: This paper introduces immersive humanitarian visualization as a promising research area in information visualization. Humanitarian visualizations are data visualizations designed to promote human welfare. This paper explains why immersive display technologies taken broadly (e.g, virtual reality, augmented reality, ambient displays and physical representations) open up a range of opportunities for humanitarian visualization. In particular, immersive displays offer ways to make remote and hidden human suffering more salient. They also offer ways to communicate quantitative facts together with qualitative information and visceral experiences, in order to provide a holistic understanding of humanitarian issues that could support more informed humanitarian decisions. But despite some promising preliminary work, immersive humanitarian visualization has not taken off as a research topic yet. The goal of this paper is to encourage, motivate, and inspire future research in this area.
Published: 2022

22. Visualisation d'information pour l'altruisme efficace

Author: Dragicevic, Pierre, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: FOS: Computer and information sciences, Information visualization, human-computer interaction, Effective altruism, Computer Science - Human-Computer Interaction, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Human-Computer Interaction (cs.HC)
Abstract: Effective altruism is a movement whose goal it to use evidence and reason to figure out how to benefit others as much as possible. This movement is becoming influential, but effective altruists still lack tools to help them understand complex humanitarian trade-offs and make good decisions based on data. Visualization-the study of computer-supported, visual representations of data meant to support understanding, communication, and decision makingcan help alleviate this issue. Conversely, effective altruism provides a powerful thinking framework for visualization research that focuses on humanitarian applications.
Published: 2022
Full Text: View/download PDF

23. Interfaces cerveau-machine (Les)

Author: Dehais, Frédéric, Lotte, Fabien, Institut Supérieur de l'Aéronautique et de l'Espace (ISAE-SUPAERO), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Lotte, Fabien, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], [SCCO]Cognitive science, [INFO.INFO-BT] Computer Science [cs]/Biotechnology, [SCCO] Cognitive science, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-BT]Computer Science [cs]/Biotechnology, ComputingMilieux_MISCELLANEOUS, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Abstract: International audience
Published: 2022

24. Editorial: Long Term User Training and Preparation to Succeed in a Closed-Loop BCI Competition

Author: Gernot R. Müller-Putz, Damien Coyle, Fabien Lotte, Jing Jin, David Steyrl, Graz University of Technology [Graz] (TU Graz), BioTechMed-Graz, Graz University of Technology [Graz] (TU Graz)-Karl-Franzens-Universität Graz-Medical University Graz, Faculty of Computing and Engineering [University of Ulster], University of Ulster, Intelligent Systems Research Centre, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), East China University of Science and Technology, and University of Vienna [Vienna]
Subjects: Brain-Computer Interface, Brain-Computer Interface electroencephalogram transfer learning user learning user-centered training closed-loop learning, electroencephalogram, transfer learning, user-centered training, Behavioral Neuroscience, Psychiatry and Mental health, Neuropsychology and Physiological Psychology, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], Neurology, user learning, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Biological Psychiatry, closed-loop learning
Abstract: The abstract is available here: https://uscholar.univie.ac.at/o:1674457
Published: 2022
Full Text: View/download PDF

25. Relationship between ERD modulations, MI-based BCI performance and users' traits

Author: Rimbert, Sébastien, Lotte, Fabien, RIMBERT, Sébastien, Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017)
Subjects: Event, electroencephaography, Motor imagery, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], [SCCO.NEUR]Cognitive science/Neuroscience, [SCCO.NEUR] Cognitive science/Neuroscience, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], users' traits, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], [STAT.ML] Statistics [stat]/Machine Learning [stat.ML], related desynchronization
Abstract: International audience; Improving user performances is one of the major issues for Motor Imagery (MI)-based BCI control. MI-BCIs exploit the modulation of sensorimotor rhythms (SMR) over the motor and sensorimotor cortices to discriminate several mental states and enable user interaction. Such modulations are known as Event-Related Desynchronization (ERD) and Synchronization (ERS), coming from the mu (7-13 Hz) and beta (15-30 Hz) frequency bands. This kind of BCI opens up promising fields, particularly to control assistive technologies, for sport training or even for post-stroke motor rehabilitation. However, MI-BCIs remain barely used outside laboratories, notably due to their lack of robustness and usability (15 to 30% of users seem unable to gain control of an MI-BCI). One way to increase user performance would be to better understand the relationships between user traits and ERD/ERS modulations underlying BCI performance. Therefore, in this study we analyzed how cerebral motor patterns underlying MI tasks (i.e., ERDs) are modulated depending (i) on nature of the task (i.e., right-hand MI and left-hand MI), (ii) the session during which the task was performed (i.e., calibration or user training) and (iii) on the characteristics of the user (e.g., age, gender, manual activity, personality traits) on a large MI-BCI data set (N=70 participants). Our results confirmed a stronger ERD contralateraly, while we still observed a bilateral ERD overall. We also observed stronger ERD during calibration (with sham feedback) than during online training (with real-time feedback and instructions to explore promising MI strategies). Finally, and more importantly, our study revealed for the first time, associations between ERD and both age, level of study, impression management and anxiety. This may suggest that such factors should be taken into account when designing MI-BCI based on ERD or when selecting an ERD-based BCI for a given user.
Published: 2022

26. The Effect of Increased Body Motion in Virtual Reality on a Placement-Retrieval Task

Author: Thibault Friedrich, Michael McGuffin, Arnaud Prouzeau, Ecole de Technologie Supérieure [Montréal] (ETS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Controlled experiment, business.industry, Computer science, 05 social sciences, Work (physics), Volume (computing), 020207 software engineering, 02 engineering and technology, Virtual reality, Motion (physics), [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Task (computing), 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, Computer vision, Artificial intelligence, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], business, 050107 human factors, Locomotion
Abstract: International audience; Previous work has shown that increased effort and use of one's body can improve memory. When positioning windows inside a virtual reality, does the use of a larger volume, and using one's legs to move around, improve the ability to later find the windows? The results of our experiment indicate there can be a modest benefit for spatial memory and retrieval time, but at the cost of increased time spent initially positioning the windows.
Published: 2021
Full Text: View/download PDF

27. Non-isomorphic Interaction Techniques for Controlling Avatar Facial Expressions in VR

Author: Thomas Pietrzak, Martin Hachet, Géry Casiez, Marc Baloup, Technology and knowledge for interaction (LOKI), Inria Lille - Nord Europe, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS)-Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Université de Lille, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut Universitaire de France (IUF), Ministère de l'Education nationale, de l’Enseignement supérieur et de la Recherche (M.E.N.E.S.R.), Inria challenge Avatar, ACM, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: VR, Facial expression, Computer science, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.2: User Interfaces, Input device, 02 engineering and technology, Virtual reality, Emoji, Control theory, Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, [INFO]Computer Science [cs], 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Set (psychology), 050107 human factors, Avatar, Emotion, Emoticons, 05 social sciences, 020207 software engineering, Interaction technique, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems/H.5.1.1: Artificial, augmented, and virtual realities, [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Expression (mathematics)
Abstract: International audience; The control of an avatar’s facial expressions in virtual reality is mainly based on the automated recognition and transposition of the user’s facial expressions. These isomorphic techniques are limited to what users can convey with their own face and have recognition issues. To overcome these limitations, non-isomorphic techniques rely on interaction techniques using input devices to control the avatar’s facial expressions. Such techniques need to be designed to quickly and easily select and control an expression, and not disrupt a main task such as talking. We present the design of a set of new non- isomorphic interaction techniques for controlling an avatar facial expression in VR using a standard VR controller. These techniques have been evaluated through two controlled experiments to help designing an interaction technique combining the strengths of each approach. This technique was evaluated in a final ecological study showing it can be used in contexts such as social applications.
Published: 2021
Full Text: View/download PDF

28. Definitely Maybe: Hedges And Boosters in the HCI Literature

Author: Yvonne Jansen, Andy Cockburn, Lonni Besançon, Pierre Dragicevic, Linköpings universitet, Monash University [Melbourne], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), University of Canterbury [Christchurch], Analysis and Visualization (AVIZ), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), and Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
Subjects: Computer science, Hedges, Boosters, computer.software_genre, Data science, Scientific communication, Literature survey, Content analysis, Scripting language, Statistical inference, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Hedge (finance), Baseline (configuration management), computer
Abstract: Introduction: Hedges and boosters are terms respectively used to decrease and increase the strength of statements. They are therefore essential lexical tools in scientific communication, in particular in fields conducting human-subjects experiments such as Human-Computer Interaction (HCI). Objectives: We present an analysis of the use of hedges and boosters in the proceedings of the main HCI conference, namely CHI, between 2010 and 2018 to better understand how CHI authors report empirical findings. Methods: We only considered papers reporting a user study and focused our analysis on the sentences in the abstract that describe empirical results. We used a program to detect boosters and hedges and manually adjusted their classifications. Results: We found that CHI studies reporting inferential statistics are more likely to boost than they hedge. Conclusion: Our work intends to raise awareness within the HCI community of the importance of hedging and boosting when reporting research results. Further, our results establish a baseline of the current use of these linguistic devices in HCI, adding to the current body of linguistic research. We finally contribute tools, procedures, and materials to facilitate future analyses of hedges and boosters in scientific communication. Reproducibility: All data and scripts are available on https://osf.io/kefmr/
Published: 2021

29. Investigating Cognitive Load in Energy Network Control Rooms: Recommendations for Future Designs

Author: Umair Afzal, Arnaud Prouzeau, Lee Lawrence, Tim Dwyer, Saikiranrao Bichinepally, Ariel Liebman, Sarah Goodwin, Monash University [Melbourne], Swinburne University of Technology [Melbourne], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: energy market operators, situational awareness, cognitive load, control room, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], eye tracking, General Psychology
Abstract: International audience; This study analyzed and explored the cognitive load of Australian energy market operators managing one of the longest inter-connected electrical networks in the world. Each operator uses a workstation with seven screens in an active control room environment, with a large coordination screen to show information and enable collaboration between different control centers. Cognitive load was assessed during both training scenarios and regular control room operations via the integration of subjective and physiological measures. Eye-tracking glasses were also used to analyze the operators gaze behavior. Our results indicate that different events (normal or unexpected), different participants for the same session, and different periods of one session all have varying degrees of cognitive load. The system design was observed to be inefficient in some situations and to have an adverse affect on cognitive load. In critical situations for instance, operator collaboration was high and the coordination screen was used heavily when collaborating between two control centers, yet integration with the system could be improved. Eye tracking data analysis showed that the layout of applications across the seven screens was not optimal for many tasks. Improved layout strategies, potential combination of applications, redesigning of certain applications, and linked views are all recommended for further exploration in addition to improved integration of procedures and linking alarms to visual cues.
Published: 2021
Full Text: View/download PDF

30. Effet d'une sédation légère au propofol sur les oscillations cérébrales du cortex moteur: étude randomisée, contrôlée chez le volontaire sain

Author: Guerci, Philippe, Bougrain, Laurent, Schmartz, Denis, Losser, Marie-Reine, Meistelman, Claude, Rimbert, Sébastien, Institut Lorrain du Coeur et des Vaisseaux Louis Mathieu [Nancy], Analysis and modeling of neural systems by a system neuroscience approach (NEUROSYS), Inria Nancy - Grand Est, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Department of Complex Systems, Artificial Intelligence & Robotics (LORIA - AIS), Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS), Centre Hospitalier Universitaire Brugmann [Bruxelles] (CHU), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and RIMBERT, Sébastien
Subjects: [SDV] Life Sciences [q-bio], [SCCO]Cognitive science, [SDV.MHEP] Life Sciences [q-bio]/Human health and pathology, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], [SDV]Life Sciences [q-bio], [INFO]Computer Science [cs], [SCCO] Cognitive science, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO] Computer Science [cs], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], [STAT.ML] Statistics [stat]/Machine Learning [stat.ML], ComputingMilieux_MISCELLANEOUS, [SDV.MHEP]Life Sciences [q-bio]/Human health and pathology
Abstract: International audience
Published: 2021

31. Embodied gesture interaction for immersive maps

Author: Arnaud Prouzeau, Maxime Cordeil, Jiazhou Liu, Kadek Ananta Satriadi, Jesse Bolton, Bernhard Jenny, Rhys Newbury, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Newbury, Rhys, Satriadi, Kadek Ananta, Bolton, Jesse, Liu, Jiazhou, Cordeil, Maxime, Prouzeau, Arnaud, and Jenny, Bernhard
Subjects: Computer science, Geography, Planning and Development, 02 engineering and technology, Virtual reality, immersive map, immersive analytics, Human–computer interaction, Management of Technology and Innovation, Immersive analytics, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], embodied interaction, 050107 human factors, Civil and Structural Engineering, embodiment, 05 social sciences, 020207 software engineering, augmented reality, Embodied cognition, Key (cryptography), virtual reality, Augmented reality, origin-destination flow map, Gesture
Abstract: International audience; With the increasing availability of head-mounted displays for virtual reality and augmented reality, we can create immersive maps in which the user is closer to the data. Embodiment is a key concept, allowing the user to act upon virtual objects in an immersive environment. Our work explores the use of embodied interaction for immersive maps. We propose four design considerations for embodied maps and embodied gesture interaction with immersive maps: object presence, consistent physics, human body skills, and direct manipulation. We present an example of an immersive flow map with a series of novel embodied gesture interactions, which adhere to the proposed design considerations. The embodied interactions allow users to directly manipulate immersive flow maps and explore origin-destination flow data in novel ways. Authors of immersive maps can use the four proposed design considerations for creating embodied gesture interactions. The discussed example interactions apply to diverse types of immersive maps and will hopefully incite others to invent more embodied interactions for immersive maps.
Published: 2021
Full Text: View/download PDF

32. Tools for affective, cognitive and conative states estimation from both EEG and physiological signals

Author: Appriou, Aurélien, Lotte, Fabien, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Lotte, Fabien
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], [SCCO]Cognitive science, [INFO.INFO-BT] Computer Science [cs]/Biotechnology, [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing, [SCCO] Cognitive science, [INFO.INFO-BT]Computer Science [cs]/Biotechnology, ComputingMilieux_MISCELLANEOUS, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Abstract: International audience
Published: 2021

33. BioPyC, an Open-Source Python Toolbox for Offline Electroencephalographic and Physiological Signals Classification

Author: Fabien Lotte, Aurélien Appriou, Dan Dutartre, Léa Pillette, Andrzej Cichocki, David Trocellier, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), RIKEN Center for Brain Science [Wako] (RIKEN CBS), RIKEN - Institute of Physical and Chemical Research [Japon] (RIKEN), Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria), Skolkovo Institute of Science and Technology [Moscow] (Skoltech), and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest
Subjects: OpenVibe, Computer science, 0206 medical engineering, TP1-1185, 02 engineering and technology, [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Electroencephalography, Machine learning, computer.software_genre, Biochemistry, Python platform, Article, physiological signals, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], Analytical Chemistry, 03 medical and health sciences, 0302 clinical medicine, [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, brain–computer interfaces (BCI), medicine, Animals, Biosignal, electroencephalography (EEG), [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Electrical and Electronic Engineering, signal processing, Instrumentation, Protocol (object-oriented programming), Graphical user interface, computer.programming_language, Brain–computer interface, Signal processing, medicine.diagnostic_test, business.industry, Chemical technology, Brain, Signal Processing, Computer-Assisted, Python (programming language), 020601 biomedical engineering, Atomic and Molecular Physics, and Optics, Boidae, machine learning, Brain-Computer Interfaces, Artificial intelligence, business, computer, Algorithms, 030217 neurology & neurosurgery
Abstract: International audience; Research on brain–computer interfaces (BCIs) has become more democratic in recent decades, and experiments using electroencephalography (EEG)-based BCIs has dramatically increased. The variety of protocol designs and the growing interest in physiological computing require parallel improvements in processing and classification of both EEG signals and bio signals, such as electrodermal activity (EDA), heart rate (HR) or breathing. If some EEG-based analysis tools are already available for online BCIs with a number of online BCI platforms (e.g., BCI2000 or OpenViBE), it remains crucial to perform offline analyses in order to design, select, tune, validate and test algorithmsbefore using them online. Moreover, studying and comparing those algorithms usually requires expertise in programming, signal processing and machine learning, whereas numerous BCI researchers come from other backgrounds with limited or no training in such skills. Finally, existing BCI toolboxes are focused on EEG and other brain signals but usually do not include processing tools for other bio signals. Therefore, in this paper, we describe BioPyC, a free, open-source and easy-to-use Python platform for offline EEG and biosignal processing and classification. Based on an intuitive and well-guided graphical interface, four main modules allow the user to follow the standard steps of the BCI process without any programming skills: (1) reading different neurophysiological signal data formats, (2) filtering and representing EEG and bio signals, (3) classifying them, and (4) visualizing and performing statistical tests on the results. We illustrate BioPyC use on four studies, namely classifying mental tasks, the cognitive workload, emotions and attention states from EEG signals.
Published: 2021
Full Text: View/download PDF

34. Publishing Visualization Studies as Registered Reports: Expected Benefits and Researchers' Attitudes

Author: Yvonne Jansen, Petra Isenberg, Pierre Dragicevic, Anastasia Bezerianos, Lonni Besançon, Monash University [Melbourne], Linköpings universitet, Interacting with Large Data (ILDA), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Analysis and Visualization (AVIZ), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), and CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
Subjects: Medical education, Publishing, business.industry, Research quality, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], business, Psychology, Visualization
Abstract: Background: Registered Reports are publications in which study proposals are peer reviewed and pre-accepted before the study is ran. Their adoption in other disciplines has been found to promote research quality and save time and resources. Objectives: We offer a brief introduction to Registered Reports and their expected benefits for visualization research. We then report a survey of the visualization community on their attitudes towards Registered Reports. This survey takes the form of a quasi Registered Report, the first one presented at a visualization venue as far as we know.Method: We will run an online survey that will be open from the end of August until the day of the alt.VIS workshop.Results: Most respondents expressed interest in Registered Reports as an additional submission format. Junior researchers as well as researchers with prior experience of preregistration tended to be more inclined to adopt this format. However, qualitative feedback highlights several perceived drawbacks and worries about Registered Reports, such as low suitability for some types of research, and increased workload for reviewers and authors.Conclusion: While many respondents expressed interest in (and sometimes enthusiasm for) Registered Reports, many also voiced concerns that should be considered and discussed in the community.Reproducibility: All the material is available on osf.io/4nrma/.
Published: 2021

35. HOBIT - a New Concept for Pedagogical Innovations in Learning and Teaching Optics

Author: Jean-Paul Guillet, Stéphanie Fleck, Bruno Bousquet, Lionel Canioni, Martin Hachet, Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB), Université de Lorraine (UL), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Psychologie Ergonomique et Sociale pour l'Expérience utilisateurs (PErSEUs), Centre d'Etudes Lasers Intenses et Applications (CELIA), Université de Bordeaux (UB)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Centre National de la Recherche Scientifique (CNRS)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université de Bordeaux (UB), and Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université Sciences et Technologies - Bordeaux 1-Université Bordeaux Segalen - Bordeaux 2-Inria Bordeaux - Sud-Ouest
Subjects: [PHYS]Physics [physics], Engineering, business.industry, 4. Education, [SHS.EDU]Humanities and Social Sciences/Education, Mathematics education, [SPI.OPTI]Engineering Sciences [physics]/Optics / Photonic, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], business, ComputingMilieux_MISCELLANEOUS
Abstract: International audience
Published: 2021

36. A framework for user training adaptation in Brain-Computer Interfaces based on mental tasks (MT-BCIs)

Author: Roc, Aline, Lotte, Fabien, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), This work is supported by the grant ERC-2016-STG-714567, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Roc, Aline
Subjects: [SCCO]Cognitive science, [SCCO.COMP] Cognitive science/Computer science, [SCCO.NEUR]Cognitive science/Neuroscience, [SCCO.NEUR] Cognitive science/Neuroscience, [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, [SCCO.COMP]Cognitive science/Computer science, [SCCO] Cognitive science, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC]
Abstract: International audience; Mental Task (MT-)based BCIs allow for spontaneous and asynchronous interactions with external devices solely through mental tasks such as motor imagery or mental math. Such BCIs require their users to develop the ability to encode mental commands that are as stable, clear and distinct as possible-making them easy to recognize by a computer. Despite their promises and achievements, traditional closed-loop training programs are suboptimal [1] and could be further improved. Some aspects of training programs were studied in depth in light of methods from the fields of educational sciences, ergonomics, or user-centered design [1, 2]. However, the best way to train users is still unknown and some aspects of user training protocols possibly impacting skill acquisition may not have been sufficiently explored yet. Although successful additions of a human perspective in the traditional BCI interaction model were already possible (e.g. [3, 4, 5]), these representations might not sufficiently depict the many aspects that could be improved/adapted in BCI human training protocols. Therefore, we propose a framework identifying and defining the various parameters composing a BCI user training program. Method, Results: Based on the existing literature [6], we propose a framework describing, at different time scales, the different aspects of BCI user training. As seen in Fig. 1, training is composed of one or more sessions (days) whose order, number or duration can vary. Sessions are themselves composed of runs that can vary as well, etc. In this framework, a training program consists of practicing exercises, which refer to what MT-BCI users are expected to do and how to practice it. Although traditional training usually requires users to practice the same exercise over and over, exercises can vary in many ways across experiments and they can also be adapted within trials, runs or sessions. This representation emphasizes the multiple entry points that allow for training adaptation, for example what skill users should practice (e.g. training for speed or accuracy, etc.), in which spontaneity mode (e.g. cue-based vs. self-decided, synchronous trials vs. self-paced exercise), with which instructions or feedback (e.g. content, modality, timing), or in which environment (i.e. the context in which training takes place). Discussion: Not only the properties of training aspects should be questioned, but also their presence. For example, there is no indication that the uniform presence of feedback at each step throughout the entire training is the best way to train users. Besides, rather than universally refining training parameters, it may be preferable to adapt the choice of parameters to the user before and/or throughout sessions [5] based e.g. on changes in users' understanding, perceptions, motivation, fatigue, performances, etc. Significance: Future work should investigate further whether the variation of different training aspects has an influence on behavioral BCI performance, user-related metrics [4] or users' understanding of instructions, self-instructed cognitive strategy, perception of trial-specific quality, willingness to change/redo tasks, etc. This is a preliminary step on the way to designing new training programs composed of exercise sequences adapted to human learning and/or adaptive according to users' experience or performances. Figure 1. Representation of MT-BCI training in decreasing order of time scales. Different aspects of the training feedback, instructions or exercises can be modulated-including their goal, modality, content, duration, variety, frequency, number and/or order.
Published: 2021

37. MI-BCI Performances correlate with subject-specific frequency band characteristics

Author: Benaroch, Camille, Jeunet, Camille, Lotte, Fabien, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Cognition, Langues, Langage, Ergonomie (CLLE), Centre National de la Recherche Scientifique (CNRS)-École pratique des hautes études (EPHE), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université Toulouse - Jean Jaurès (UT2J), This work was supported by the European Research Council with project BrainConquest (grant ERC-2016-STG-714567)., European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, École Pratique des Hautes Études (EPHE), Université de Toulouse (UT)-Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT), Benaroch, Camille, and Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID
Subjects: [SCCO.NEUR]Cognitive science/Neuroscience, [SCCO.NEUR] Cognitive science/Neuroscience, [SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing, ComputingMilieux_MISCELLANEOUS, [SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processing
Abstract: International audience
Published: 2021

38. Freedom! Making a case for more options for users during training in BCI

Author: Pramij, Smeety, Roc, Aline, Lotte, Fabien, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Roc, Aline
Subjects: [SCCO]Cognitive science, [SCCO.COMP] Cognitive science/Computer science, [SCCO.NEUR]Cognitive science/Neuroscience, [SCCO.NEUR] Cognitive science/Neuroscience, [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, [SCCO.COMP]Cognitive science/Computer science, [SCCO] Cognitive science, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS
Abstract: International audience
Published: 2021

39. Virtual, Real or Mixed: How Surrounding Objects Influence the Sense of Embodiment in Optical See-Through Experiences?

Author: Genay, Adélaïde, Lécuyer, Anatole, Hachet, Martin, Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-RÉALITÉ VIRTUELLE, HUMAINS VIRTUELS, INTERACTIONS ET ROBOTIQUE (IRISA-D5), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Université de Bordeaux (UB), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), L'institution a financé les frais de publication pour que cet article soit en libre accès., Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), and Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1)
Subjects: User study, [SCCO.PSYC]Cognitive science/Psychology, Optical see-through, [SCCO.COMP]Cognitive science/Computer science, Augmented reality, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Sense of embodiment, Mixed reality
Abstract: International audience; This paper studies the sense of embodiment of virtual avatars in Mixed Reality (MR) environments visualized with an Optical See-Through display. We investigated whether the content of the surrounding environment could impact the user’s perception of their avatar, when embodied from a first-person perspective. To do so, we conducted a user study comparing the sense of embodiment toward virtual robot hands in three environment contexts which included progressive quantities of virtual content: real content only, mixed virtual/real content, and virtual content only. Taken together, our results suggest that users tend to accept virtual hands as their own more easily when the environment contains both virtual and real objects (mixed context), allowing them to better merge the two “worlds”. We discuss these results and raise research questions for future work to consider.
Published: 2021
Full Text: View/download PDF

40. Assessing a new form of BCI user learning

Author: Sadatnejad, Khadijeh, Lotte, Fabien, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Lotte, Fabien
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Abstract: International audience
Published: 2021

41. Exploring Smartphone-enabled Text Selection in AR-HMD

Author: Darbar, Rajkumar, Prouzeau, Arnaud, Odicio-Vilchez, Joan, Lainé, Thibault, Hachet, Martin, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Asobo Studio, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Hachet, Martin
Subjects: 000 computer science, Human-centered computing—Human computerinteraction (HCI)—Interaction paradigms—Mixed / augmented reality, Human-centered computing—Human computer interaction(HCI)—Interaction paradigms—Graphical user interfaces, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC]
Abstract: International audience; Text editing is important and at the core of most complex tasks, likewriting an email or browsing the web. Efficient and sophisticatedtechniques exist on desktops and touch devices, but are still under-explored for Augmented Reality Head Mounted Display (AR-HMD).Performing text selection, a necessary step before text editing, in ARdisplay commonly uses techniques such as hand-tracking, voice com-mands, eye/head-gaze, which are cumbersome and lack precision.In this paper, we explore the use of a smartphone as an input deviceto support text selection in AR-HMD because of its availability,familiarity, and social acceptability. We propose four eyes-free textselection techniques, all using a smartphone — continuous touch,discrete touch, spatial movement, and raycasting. We compare themin a user study where users have to select text at various granularitylevels. Our results suggest that continuous touch, in which we usedthe smartphone as a trackpad, outperforms the other three techniquesin terms of task completion time, accuracy, and user preference.
Published: 2021

42. Grand Challenges in Immersive Analytics

Author: Christoph Anthes, Wesley Willett, Jens Grubert, Wolfgang Büschel, Cody Dunne, Nazmus Saquib, Tica Lin, Maxime Cordeil, Dylan Kobayashi, Matt Whitlock, Yalong Yang, Dieter Schmalstieg, Danielle Albers Szafir, Jason H. Haga, Monsurat Olaosebikan, Nurit Kirshenbaum, Tim Dwyer, Marcos Serrano, Barrett Ens, Arnaud Prouzeau, Ulrich Engelke, David Saffo, Fabian Pointecker, Benjamin Bach, Monash University [Melbourne], University of Edinburgh, Data61 [Canberra] (CSIRO), Australian National University (ANU)-Commonwealth Scientific and Industrial Research Organisation [Canberra] (CSIRO), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, University of Calgary, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), University of Applied Sciences Upper Austria (FH OÖ), Technische Universität Dresden = Dresden University of Technology (TU Dresden), Khoury College of Computer Sciences [Boston], Northeastern University [Boston], Coburg University of Applied Sciences and Arts, National Institute of Advanced Industrial Science and Technology [Tokyo] (AIST), University of Hawai‘i [Mānoa] (UHM), Harvard University [Cambridge], Tufts University [Medford], MIT media Lab, Massachusetts Institute of Technology (MIT), Graz University of Technology [Graz] (TU Graz), University of Colorado [Boulder], Canada Research Chairs Program, Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strat-egy – EXC-2068 – 390729961 – Cluster of Excellence Physics of Life of TU Dresden, NSF 1764092, Australian Research Council Discov-ery Projects funding scheme DP18010075, a Harvard Physical Sciences and Engineering Accelerator Award, ANR-18-CE33-0009,PERFIN,Interfaces Ubiquitaires à Forme Libre(2018), Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, National Institute of Advanced Industrial Science and Technology (AIST), and Harvard University
Subjects: Engineering, Concepts and models, Emerging technologies, HCI theory, 02 engineering and technology, Augmented reality, Virtual reality, Mixed / augmented reality Immersive analytics, Field (computer science), Data visualization, Immersive analytics, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Grand Challenges, Grand research challenges, data visualisation, business.industry, 05 social sciences, Visualization systems and tools, grand research challenges, 020207 software engineering, Data science, augmented reality, Visualization, virtual reality, business, Data visualisation
Abstract: The definitive version will be published in CHI 2021, May 8–13, 2021, Yokohama, Japan; International audience; Immersive Analytics is a quickly evolving field that unites several areas such as visualisation, immersive environments, and humancomputer interaction to support human data analysis with emerging technologies. This research has thrived over the past years with multiple workshops, seminars, and a growing body of publications, spanning several conferences. Given the rapid advancement of interaction technologies and novel application domains, this paper aims toward a broader research agenda to enable widespread adoption. We present 17 key research challenges developed over multiple sessions by a diverse group of 24 international experts, initiated from a virtual scientific workshop at ACM CHI 2020. These challenges aim to coordinate future work by providing a systematic roadmap of current directions and impending hurdles to facilitate productive and effective applications for Immersive Analytics.
Published: 2021
Full Text: View/download PDF

43. Guidelines to use Transfer Learning for Motor Imagery Detection: an experimental study

Author: Fabien Lotte, Laurent Bougrain, Pedro Rodrigues, Geoffrey Canron, Sébastien Rimbert, Analysis and modeling of neural systems by a system neuroscience approach (NEUROSYS), Inria Nancy - Grand Est, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Department of Complex Systems, Artificial Intelligence & Robotics (LORIA - AIS), Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA), Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS), Psychologie Ergonomique et Sociale pour l'Expérience utilisateurs (PErSEUs), Université de Lorraine (UL), Modelling brain structure, function and variability based on high-field MRI data (PARIETAL), Service NEUROSPIN (NEUROSPIN), Université Paris-Saclay-Direction de Recherche Fondamentale (CEA) (DRF (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université Paris-Saclay-Direction de Recherche Fondamentale (CEA) (DRF (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, The author acknowledges the support of the French Agence Nationale de la Recherche (ANR) under reference ANR-19-CE33-0007 (Grasp-IT project), and the European Research Council with project BrainConquest (grant ERC-2016-STG-714567)., European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Service NEUROSPIN (NEUROSPIN), Direction de Recherche Fondamentale (CEA) (DRF (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Université Paris-Saclay, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Bougrain, Laurent, and Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], Computer science, [SDV.IB.IMA]Life Sciences [q-bio]/Bioengineering/Imaging, 0206 medical engineering, 02 engineering and technology, Machine learning, computer.software_genre, Session (web analytics), Domain (software engineering), [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], 03 medical and health sciences, [SCCO]Cognitive science, 0302 clinical medicine, Motor imagery, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Set (psychology), Reliability (statistics), Brain–computer interface, business.industry, Neural engineering, [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], [SCCO] Cognitive science, 020601 biomedical engineering, [SDV.IB.IMA] Life Sciences [q-bio]/Bioengineering/Imaging, Artificial intelligence, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Transfer of learning, business, computer, 030217 neurology & neurosurgery
Abstract: International audience; Brain-Computer Interfaces (BCI) based on Motor imagery (MI) shown promising results for motor recovery, intraoperative awareness detection or assistive technology control. However, they suffer from several limitations due to the high variability of electroencephalographic (EEG) signals, mainly lengthy and tedious calibration times usually required for each new day of use, and a lack of reliability for all users. Such problems can be addressed, to some extent, using transfer learning algorithms. However, the performance of such algorithms has been very variable so far, and when they can be safely used is still unclear. Therefore, in this article, we study the performance of various state-of-the-art Riemannian transfer learning algorithms on a MI-BCI database (30 users), for various conditions: 1) supervised and unsupervised transfer learning; 2) for various amount of available training EEG data for the target domain; 3) intra-session or inter-session transfer; 4) for both users with good and less good MI-BCI performances. From such experiments, we derive guidelines about when to use which algorithm. Re-centering the target data is effective as soon as a few samples of this target set are taken into account. This is true even for an intra-session transfer learning. Likewise, re-centering is particularly useful for subjects who have difficulty producing stable motor imagery from session to session.
Published: 2021

44. Multi-Session Influence of Two Modalities of Feedback and Their Order of Presentation on MI-BCI User Training

Author: Fabien Lotte, Bertrand Glize, Bernard N'Kaoua, Romain Sabau, Léa Pillette, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), École Centrale de Nantes (ECN), Handicap Activité Cognition Santé [Bordeaux] (HACS), Université de Bordeaux (UB)-Institut National de Recherche en Informatique et en Automatique (Inria)-CHU Bordeaux [Bordeaux]-Institut National de la Santé et de la Recherche Médicale (INSERM), Bordeaux population health (BPH), Université de Bordeaux (UB)-Institut de Santé Publique, d'Épidémiologie et de Développement (ISPED)-Institut National de la Santé et de la Recherche Médicale (INSERM), CHU de Bordeaux Pellegrin [Bordeaux], This research was funded by the French National Research Agency (project REBEL, grant ANR-15-CE23-0013-01) and the European Research Council with the Brain-Conquest project (grant ERC-2016-STG-714567)., ANR-15-CE23-0013,REBEL,Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle(2015), European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Lotte, Fabien, Interactions humain-machine, objets connectés, contenus numériques, données massives et connaissance - Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle - - REBEL2015 - ANR-15-CE23-0013 - AAPG2015 - VALID, Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest
Subjects: Neuroprosthetics, Computer Networks and Communications, Computer science, Brain activity and meditation, InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.,HCI), media_common.quotation_subject, Control (management), Neuroscience (miscellaneous), lcsh:Technology, 050105 experimental psychology, Session (web analytics), realistic visual feedback, 03 medical and health sciences, Presentation, [SCCO]Cognitive science, 0302 clinical medicine, Human–computer interaction, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], lcsh:Science, user training, Brain–computer interface, media_common, Modalities, Modality (human–computer interaction), lcsh:T, 05 social sciences, [SCCO] Cognitive science, multimodal feedback, Computer Science Applications, Human-Computer Interaction, vibrotactile feedback, motor imagery based brain-computer interfaces, lcsh:Q, Brain-computer interfaces, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], 030217 neurology & neurosurgery
Abstract: International audience; By performing motor-imagery tasks, for example, imagining hand movements, Motor-Imagery based Brain-Computer Interfaces (MI-BCIs) users can control digital technologies, for example, neuroprosthesis, using their brain activity only. MI-BCI users need to train, usually using a unimodal visual feedback, to produce brain activity patterns that are recognizable by the system. The literature indicates that multimodal vibrotactile and visual feedback is more effective than unimodal visual feedback, at least for short term training. However, the multi-session influence of such multimodal feedback on MI-BCI user training remained unknown, so did the influence of the order of presentation of the feedback modalities. In our experiment, 16 participants trained to control a MI-BCI during five sessions with a realistic visual feedback and five others with both a realistic visual feedback and a vibrotactile one. training benefits from a multimodal feedback, in terms of performances and self-reported mindfulness. There is also a significant influence of the order presentation of the modality. Participants who started training with a visual feedback had higher performances than those who started training with a multimodal feedback. We recommend taking into account the order of presentation for future experiments assessing the influence of several modalities of feedback.
Published: 2021
Full Text: View/download PDF

45. Long-Term BCI Training of a Tetraplegic User: Adaptive Riemannian Classifiers and User Training

Author: Benaroch, Camille, Sadatnejad, Khadijeh, Roc, Aline, Appriou, Aurélien, Monseigne, Thibaut, Pramij, Smeety, Mladenović, Jelena, Pillette, Léa, Jeunet, Camille, Lotte, Fabien, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Cognition, Langues, Langage, Ergonomie (CLLE), École Pratique des Hautes Études (EPHE), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT), The European Research Council with project BrainConquest (grant ERC-2016-STG-714567) and the French National Research Agency with project REBEL (grant ANR-15-CE23-0013-01) supported this work., ANR-15-CE23-0013,REBEL,Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle(2015), European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Centre National de la Recherche Scientifique (CNRS)-École pratique des hautes études (EPHE)
Subjects: User experience, Riemannian classification, Learning metrics, [SCCO.NEUR]Cognitive science/Neuroscience, Tetraplegic or quadriplegic people, Electroencaphlography, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], Adaptive classification, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Brain computer interface, User training
Abstract: International audience; While often presented as promising assistive technologies for motor-impaired users, electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs) remain barely used outside laboratories due to low reliability in real-life conditions. There is thus a need to design long-term reliable BCIs that can be used outside-of-the-lab by end-users, e.g., severely motor-impaired ones. Therefore, we propose and evaluate the design of a multi-class Mental Task (MT)-based BCI for longitudinal training (20 sessions over 3 months) of a tetraplegic user for the CYBATHLON BCI series 2019. In this BCI championship, tetraplegic pilots are mentally driving a virtual car in a racing video game. We aimed at combining a progressive user MT-BCI training with a newly designed machine learning pipeline based on adaptive Riemannian classifiers shown to be promising for real-life applications. We followed a two step training process: the first 11 sessions served to train the user to control a 2-class MT-BCIby performing either two cognitive tasks (REST and MENTAL SUBTRACTION) or two motor-imagery tasks (LEFT-HAND and RIGHT-HAND). The second training step (9 remaining sessions) applied an adaptive, session-independent Riemannian classifier that combined all 4 MT classes used before. Moreover, as our Riemannian classifier was incrementally updated in an unsupervised way it would capture both within and between-session non-stationarity. Experimental evidences confirm the effectiveness of this approach. Namely, the classification accuracy improved by about 30% at the end of the training compared to initial sessions. We also studied the neural correlates of this performance improvement. Using a newly proposed BCI user learning metric, we could show our user learned to improve his BCI control by producing EEG signals matching increasingly more the BCI classifier training data distribution, rather than by improving his EEG class discrimination. However, the resulting improvementwas effective only on synchronous (cue-based) BCI and it did not translate into improved CYBATHLON BCI game performances. For the sake of overcoming this in the future, we unveil possible reasons for these limited gaming performances and identify a number of promising future research directions. Importantly, we also report on the evolution of the user’s neurophysiological patterns and user experience throughout the BCI training and competition.
Published: 2021
Full Text: View/download PDF

46. Experimenters Influence on Mental-Imagery based Brain-Computer Interface User Training

Author: Léa Pillette, Fabien Lotte, Aline Roc, Bernard N'Kaoua, Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Handicap Activité Cognition Santé [Bordeaux] (HACS), Université de Bordeaux (UB)-Institut National de Recherche en Informatique et en Automatique (Inria)-CHU Bordeaux [Bordeaux]-Institut National de la Santé et de la Recherche Médicale (INSERM), ANR-15-CE23-0013,REBEL,Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle(2015), European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Pillette, Léa, Interactions humain-machine, objets connectés, contenus numériques, données massives et connaissance - Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle - - REBEL2015 - ANR-15-CE23-0013 - AAPG2015 - VALID, and Boosting Brain-Computer Communication with high Quality User Training - BrainConquest - - H2020 Pilier ERC2017-07-01 - 2022-06-30 - 714567 - VALID
Subjects: Social psychology (sociology), Experimenter influence, Brain activity and meditation, Control (management), Human Factors and Ergonomics, Context (language use), Mental imagery, 050105 experimental psychology, Session (web analytics), Education, 03 medical and health sciences, [SCCO]Cognitive science, 0302 clinical medicine, Motor imagery, [INFO.EIAH] Computer Science [cs]/Technology for Human Learning, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Brain–computer interface, User training, 05 social sciences, General Engineering, Gender, [SCCO] Cognitive science, Human-Computer Interaction, Hardware and Architecture, Brain-Computer Interfaces, [INFO.EIAH]Computer Science [cs]/Technology for Human Learning, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Psychology, 030217 neurology & neurosurgery, Software, Cognitive psychology, Mental image
Abstract: International audience; Context Motor Imagery based Brain-Computer Interfaces (MI-BCIs) enable their users to interact with digital technologies, e.g., neuroprosthesis, by performing motor imagery tasks only, e.g., imagining hand movements, while their brain activity is recorded. To control MI-BCIs, users must train to control their brain activity. During such training, experimenters have a fundamental role, e.g., they motivate participants. However, their influence had never been formally assessed for MI-BCI user training. In other fields, e.g., social psychology, experimenters’ gender was found to influence experimental outcomes, e.g., behavioural or neurophysiological measures.ObjectiveOur aim was to evaluate if the experimenters’ gender influenced MI-BCI user training outcomes, i.e., performances and user-experience.MethodsWe performed an experiment involving 6 experimenters (3 women) each training 5 women and 5 men (60 participants) to perform right versus left hand MI-BCI tasks over one session. We then studied the training outcomes, i.e., MI-BCI performances and user-experience, according to the experimenters' and subjects' gender.ResultsA significant interaction between experimenters’ and participants' gender was found on the evolution of trial-wise performances. Another interaction was found between participants’ tension and experimenters’ gender on the average performances.ConclusionExperimenters’ gender could influence MI-BCI performances depending on participants’ gender and tension.SignificanceExperimenters’ influence on MI-BCI user training outcomes should be better controlled, assessed and reported to further benefit from it while preventing any bias.
Published: 2021
Full Text: View/download PDF

47. Data Physicalization

Author: Pierre Dragicevic, Yvonne Jansen, Andrew Vande Moere, Analysis and Visualization (AVIZ), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Institut des Systèmes Intelligents et de Robotique (ISIR), Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU), Interactions Multi-échelles, Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU), Catholic University of Leuven - Katholieke Universiteit Leuven (KU Leuven), Jean Vanderdonckt, Philippe Palanque, Marco Winckler, Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: 05 social sciences, 0202 electrical engineering, electronic engineering, information engineering, 020207 software engineering, 0501 psychology and cognitive sciences, 02 engineering and technology, Data physicalization, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors
Abstract: International audience; Data physicalization is a rich and vast research area that studies the use of physical artifacts to convey data. It overlaps with a number of research areas including information visualization, scientific visualization, visual analytics, tangible user interfaces, shape-changing interfaces, personal fabrication interfaces, as well as graphic design, architecture, and art. This chapter surveys academic work on data physicalization up to 2018, and also provides a brief overview of non-academic work. It discusses how data physicalization has been used for analytical purposes, for communication and education, for accessibility, for self-reflection and self-expression, and finally for enjoyment and meaning. It also discusses enabling technologies, reviews empirical studies, and surveys models and theories of data physicalization.
Published: 2021
Full Text: View/download PDF

48. Interactions au sein d’environnements tangibles et augmentés pour découvrir, comprendre et apprendre

Author: Giraudeau, Philippe, STAR, ABES, Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Université de Bordeaux, Martin Hachet, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: Interface Homme-Machine, Mixed Reality, Reality%22">Augmented >Reality, Réalité Mixte, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Interface tangible, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Human-Computer Interface, Tangible User Interface, Education, Réalité Augmentée
Abstract: Digital technology is now an integral part of our daily lives.We use it to perform everyday tasks such as discovering, understanding and learning. Approaches based on physical manipulation and group activities have the capacity to facilitate such activities. However, traditional digital devices relying on interfaces using screens, keyboards and mice are limited in this type of approach. In this thesis, we propose to use new interaction paradigms with the digital world, based on augmented reality and tangible interactions, in order to create mixed environments where the physical world serves as a support to the virtual world. Although these paradigms have existed for at least two decades, they are still not widely used in our society and are difficult to access outside of very specific use cases. During this PhD, we have designed and evaluated environments that mix physical objects in the classroom such as paper, pencils and books, with projected digital elements (images, sounds, videos), within the same workspace. Thus, students can work actively and collectively, as they would in a purely physical space, while benefiting from the possibilities offered by digital technology. In a second step, we explored the use of tangible interactions and augmented reality to help users become aware of their energy consumption, and to optimize the layout and circulation of people within public buildings, to fight against the coronavirus epidemic., Le numérique fait désormais partie intégrante du quotidien en s’immisçant progressivement dans toute les activités de notre société. Nous l’utilisons pour réaliser des tâches courantes comme découvrir, comprendre et apprendre. Des approches basées sur la manipulation physique et les activités de groupe ont la capacité à faciliter ce genre d’activité. Cependant, les dispositifs numériques traditionnels s’appuyant sur des interfaces utilisant écrans, claviers et souris sont limités dans ce type d’approche. Dans cette thèse, nous proposons d’utiliser de nouveaux paradigmes d’interaction avec le numérique, basés notamment sur la réalité augmentée et les interactions tangibles, afin de créer des environnements mixtes où le monde physique sert de support au monde virtuel. Si ces paradigmes existent depuis aux moins deux décennies, ils sont encore peu répandus au sein de notre société et difficilement accessibles hors de cas d’usage très spécifiques. Dans un premier temps, nous avons conçu et évalué des environnements physico-numériques qui mélangent des objets physiques présents en salle de classe tels que du papier, des crayons et des livres, avec des éléments numériques projetés (images, sons vidéos), au sein d’un même espace de travail. Ainsi, les élèves peuvent travailler de façon active et collective,comme ils le feraient dans un espace purement physique, tout en bénéficiant des possibilités offertes par le numérique. Dans un deuxième temps, nous avons exploré l’utilisation des interactions tangibles et de la réalité augmentée pour aider les utilisateurs à prendre conscience de leur consommation énergétique, et à optimiser la disposition et la circulation des personnes au sein de bâtiments publics, pour lutter contre l’épidémie de coronavirus.
Published: 2021

49. Being an Avatar 'for Real': a Survey on Virtual Embodiment in Augmented Reality

Author: Anatole Lécuyer, Adélaïde Genay, Martin Hachet, Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-RÉALITÉ VIRTUELLE, HUMAINS VIRTUELS, INTERACTIONS ET ROBOTIQUE (IRISA-D5), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), and Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1)
Subjects: Computer science, media_common.quotation_subject, Context (language use), 02 engineering and technology, Virtual reality, Social and Behavioral Sciences, Field (computer science), Entertainment, User-Computer Interface, Human–computer interaction, Taxonomy (general), Perception, Surveys and Questionnaires, 0202 electrical engineering, electronic engineering, information engineering, Computer Graphics, Psychology, Sense of Embodiment, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Avatar, media_common, Augmented Reality, Virtual Reality, 020207 software engineering, Computer Graphics and Computer-Aided Design, Signal Processing, Augmented reality, Computer Vision and Pattern Recognition, Software
Abstract: International audience; Virtual self-avatars have been increasingly used in Augmented Reality (AR) where one can see virtual content embedded into physical space. However, little is known about the perception of self-avatars in such a context. The possibility that their embodiment could be achieved in a similar way as in Virtual Reality opens the door to numerous applications in education, communication, entertainment, or the medical field. This article aims to review the literature covering the embodiment of virtual self-avatars in AR. Our goal is (i) to guide readers through the different options and challenges linked to the implementation of AR embodiment systems, (ii) to provide a better understanding of AR embodiment perception by classifying the existing knowledge, and (iii) to offer insight on future research topics and trends for AR and avatar research. To do so, we introduce a taxonomy of virtual embodiment experiences by defining a "body avatarization" continuum. The presented knowledge suggests that the sense of embodiment evolves in the same way in AR as in other settings, but this possibility has yet to be fully investigated. We suggest that, whilst it is yet to be well understood, the embodiment of avatars has a promising future in AR and conclude by discussing possible directions for research.
Published: 2021
Full Text: View/download PDF

50. Reliable outlier detection by spectral clustering on Riemannian manifold of EEG covariance matrix

Author: Yamamoto, Maria, Sadatnejad, Khadijeh, Islam, Md, Lotte, Fabien, Tanaka, Toshihisa, Lotte, Fabien, Tokyo University of Agriculture and Technology (TUAT), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: [INFO.INFO-AI] Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-BT] Computer Science [cs]/Biotechnology, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [INFO.INFO-CG] Computer Science [cs]/Computational Geometry [cs.CG], [INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing, [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-BT]Computer Science [cs]/Biotechnology, [INFO.INFO-CG]Computer Science [cs]/Computational Geometry [cs.CG], [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Abstract: International audience; Introduction: Automatically identifying and rejecting artifact-contaminated trials is a key problem to design robust BCIs. Here, we propose a novel outlier detection method based on Riemannian Geometry (RG), a promising approach for BCI classification [1]. With RG, EEG signals are represented and processed as Sample Covariance Matrix (SCM), which is also known to reduce EEG artifacts influence. State-of-the-art outlier detection methods in RG include Riemannian Potato (RP) [2] and Median-Based Trimming (MBT) [3]. However, both suffer from the need of a threshold to determine outliers, and both always reject some samples as outliers, even when there is none. Thus, we propose Riemannian Spectral Clustering (RiSC), to detect outliers by clustering SCMs into non-outliers and outliers by similarity, without thresholds. Material, Methods and Results: First, RiSC computes the graph of SCMs similarities using the Riemannian distance between SCMs. Then, the graph nodes are clustered using spectral clustering [4], and all clusters except the most numerous one are rejected as outliers. We compared the classification accuracy of a Minimum Distance to Mean classifier [1] without outlier rejection (baseline) and after rejecting outliers from each class training data using RP, MBT and RiSC. We used EEG signals from 78 subjects from [5, 6], who performed right or left-hand motor imagery. The first two runs were used for training and the remaining runs for testing. Results showed no significant differences between methods (repeated measure ANOVA, p = 0.093). Mean classification accuracy (%) was 59.5±10.2, 59.8±10.1, 59.4±9.99 and 59.5±10.1 for the baseline, RiSC, RP and MBT respectively. Discussion: RiSC did not detect any outlier for most (68 out of 78) subjects. However, when it removed outliers, this increased accuracy for all but one subject (mean gain: 2.39 ± 2.24 %). On the other hand, RP and MBT detected outliers in all subjects, but this decreased accuracy for 46 and 34 out of 78 subjects respectively. Discussion: RiSC did not detect outlier for most subjects, which may suggest EEG contamination was already reduced using SCM. Thus, RiSC might be useful on more contaminated data. Contrary to RP and MBT, RiSC did not inadvertently reduce accuracy by rejecting clean data as outliers. Significance: Describing EEG as SCMs and detecting their outliers by spectral clustering seem to be a robust method that usually does not lead to inadvertent decrease in classification accuracy.
Published: 2021

Catalog

Books, media, physical & digital resources

See catalog results

Searchworks

Select search scope, currently: Articles Catalog books, media & more in Jio Institute collections Articles journal articles & other e-resources

Search

Search Constraints

Refine your results

Search Limiters

Topic

Publication Year Range

Language

Journal

Database

Publisher

244 results on '"Popular interaction with 3d content (Potioc)"'

Search Results

Catalog

Select search scope, currently: Articles

Catalog

books, media & more in Jio Institute collections

Articles

journal articles & other e-resources