Author: "Popular interaction with 3d content (Potioc)" / Language: undetermined - Searchworks@Jio Institute Digital Library Search Results

Your search keyword '"Popular interaction with 3d content (Potioc)"' showing total 85 results

Start Over Author "Popular interaction with 3d content (Potioc)" Language undetermined

85 results on '"Popular interaction with 3d content (Potioc)"'

1. Exploring Capturing Approaches in Shared Fabrication Workshops: Current Practice and Opportunities

Author: Clara Rigaud, Gilles Bailly, Ignacio Avellino, Yvonne Jansen, Interactions Multi-échelles, Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Assistance aux Gestes et Applications THErapeutiques (AGATHE), Institut National de la Santé et de la Recherche Médicale (INSERM)-Institut des Systèmes Intelligents et de Robotique (ISIR), and ANR-17-CE33-0001,AfFABLe,Augmentation des fab labs en intégrant des visualisations de données(2017)
Subjects: knowledge resources, Human-Computer Interaction, Computer Networks and Communications, makerspace, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], capture, fabrication workshop, Social Sciences (miscellaneous)
Abstract: International audience; Capturing content of fabrication activities is the first step for producing knowledge resources and an integral part of maker culture. As a secondary task, it conflicts though with the fabrication activity, and thus it is often forgotten and knowledge resources end up incomplete. In this article, we investigate different dimensions of content capture for knowledge resources in fabrication workshops. Based on past work in this area, we first propose a framework through which we identify two research directions to investigate. From these, we derive three dimensions to explore in more depth: The number of capturing devices, their feature variety and the degree of automation of each feature. We then explore the design space resulting from these three dimensions with the help of a design concept and an online survey study (N=66). Results show (1) a variety of needs and preferences justifying feature variety and multiplicity, (2) challenges in defining the right degree of manual and automatic control, and (3) the socio-technical impact of cameras in a shared space regarding privacy and ethics. We conclude with discussions on the benefits and vulnerabilities of equipping fabrication workshop with distributed camera-based capturing devices and offer opportunities for design.
Published: 2022
Full Text: View/download PDF

2. 'Prediction of Sleepiness Ratings from Voice by Man and Machine': A Perceptual Experiment Replication Study

Author: P. Martin, Vincent, Ferron, Aymeric, Rouas, Jean-Luc, Philip, Pierre, Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Sommeil, Addiction et Neuropsychiatrie [Bordeaux] (SANPSY), Université de Bordeaux (UB)-CHU de Bordeaux Pellegrin [Bordeaux]-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), CHU Bordeaux [Bordeaux], and ANR-10-LABX-0043,BRAIN,Bordeaux Region Aquitaine Initiative for Neuroscience(2010)
Subjects: Experimental study replication, Paralinguistic, Sleepiness, [INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD], Voice, Perceptual study, [SCCO.LING]Cognitive science/Linguistics
Abstract: International audience; Following the release of the SLEEP corpus during the Interspeech 2019 paralinguistic continuous sleepiness estimation challenge, a paper presented at Interspeech 2020 by Huckvale et al. examined the reasons for the poor performance of the models proposed for this task. Careful analyses of the corpus led to the conclusion that its bias makes it hazardous to use for training machine learning systems, but a perceptual experiment on a subset of this corpus seemed to indicate that human hearing is however able to estimate sleepiness on this corpus.In this study, we present the results of the Endymion replication study, in which the same samples were rated by thirty French-speaking naive listeners. We then discuss the causes of the differences between the two studies and examine the effect of listener and sample characteristics on annotation performances
Published: 2023
Full Text: View/download PDF

3. Gazealytics: A Unified and Flexible Visual Toolkit for Exploratory and Comparative Gaze Analysis

Author: Kun-Ting Chen, Arnaud Prouzeau, Joshua Langmead, Ryan T Whitelock-Jones, Lee Lawrence, Tim Dwyer, Christophe Hurter, Daniel Weiskopf, Sarah Goodwin, University of South Australia [Adelaide], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Monash University [Melbourne], Monash university, Ecole Nationale de l'Aviation Civile (ENAC), Visualization Research Center [Stuttgart] (VISUS), and Universität Stuttgart [Stuttgart]
Subjects: FOS: Computer and information sciences, Eye tracking, time window of interest, matrix-based overview, Computer Science - Human-Computer Interaction, [INFO]Computer Science [cs], visual analytics, area of interest, group-level visualisation, Human-Computer Interaction (cs.HC)
Abstract: International audience; We present a novel, web-based visual eye-tracking analytics tool called Gazealytics. Our open-source toolkit features a unified combination of gaze analytics features that support flexible exploratory analysis, along with annotation of areas of interest (AOI) and filter options based on multiple criteria to visually analyse eye tracking data across time and space. Gazealytics features coordinated views unifying spatiotemporal exploration of fixations and scanpaths for various analytical tasks. A novel matrix representation allows analysis of relationships between such spatial or temporal features. Data can be grouped across samples, user-defined AOIs or time windows of interest (TWIs) to support aggregate or filtered analysis of gaze activity. This approach exceeds the capabilities of existing systems by supporting flexible comparison between and within subjects, hypothesis generation, data analysis and communication of insights. We demonstrate in a walkthrough that Gazealytics supports multiple types of eye tracking datasets and analytical tasks.
Published: 2023
Full Text: View/download PDF

4. Exploring How Visualization Design and Situatedness Evoke Compassion in the Wild

Author: L. Morais, N. Andrade, D. Sousa, Luiz, Morais, Visualisations situées pour l'analyse de données personnelles - - EMBER2019 - ANR-19-CE33-0012 - AAPG2019 - VALID, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Universidade Federal de Campina Grande [Campina Grande] (UFCG), and ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019)
Subjects: [INFO.INFO-CY] Computer Science [cs]/Computers and Society [cs.CY], [INFO.INFO-CY]Computer Science [cs]/Computers and Society [cs.CY], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Computer Graphics and Computer-Aided Design
Abstract: International audience; This work explores how the design and situatedness of data representations affect people’s compassion with a case study concerning harassment episodes in a public place. Results contribute to advancing the understanding of how visualizations can evoke emotions and their impact on prosocial behaviors, such as helping people in need. Recent literature examined the effect of different on-screen data representations on emotion or prosociality, but little has been done concerning visualizations shown in a public place — especially a space contextually relevant to the data — or presented through unconventional media formats such as physical marks. We conducted two in-the-wild studies to investigate how different factors affect people’s self-reported compassion and intention to donate. We compared three ways of presenting data about the harassment cases: (1) communicating data only verbally; (2) using a printed poster with aggregated information; and (3) using a physicalization with detailed information about each story. We found that the physicalization influenced people to donate more than only hearing about the data, but it is unclear if the same applied to the poster visualization. Also, passers-by reported a likely small increase in compassion when they saw the physicalization instead of the poster. We also examined the role of situatedness by showing the physicalization in a site that is not contextually relevant to the data. Our results suggest that people had a similar intention to donate and levels of compassion in both places. Those findings may indicate that using specific visualization designs to support campaigns about sensitive causes (e.g., sexual harassment) can increase the emotional response of passers-by and may motivate them to help, independently of where the data representation is shown. Finally, this work also informs on the strengths and weaknesses of using research in the wild to evaluate data visualizations in public spaces.
Published: 2022
Full Text: View/download PDF

5. Designing Resource Allocation Tools to Promote Fair Allocation: Do Visualization and Information Framing Matter?

Author: Arnav Verma, Luiz Morais, Pierre Dragicevic, Fanny Chevalier, University of Toronto, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), This work was supported in part by a grant from NSERC (RGPIN-2018-05072) and University of Toronto FA&S Tri-Council Bridge Funding., and ACM
Subjects: framing, cognitive bias, donation, resource allocation, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], visualization
Abstract: International audience; Studies on human decision-making focused on humanitarian aid have found that cognitive biases can hinder the fair allocation of resources. However, few HCI and Information Visualization studies have explored ways to overcome those cognitive biases. This work investigates whether the design of interactive resource allocation tools can help to promote allocation fairness. We specifically study the effect of presentation format (using text or visualization) and a specific framing strategy (showing resources allocated to groups or individuals). In our three crowdsourced experiments, we provided different tool designs to split money between two fictional programs that benefit two distinct communities. Our main finding indicates that individual-framed visualizations and text may be able to curb unfair allocations caused by group-framed designs. This work opens new perspectives that can motivate research on how interactive tools and visualizations can be engineered to combat cognitive biases that lead to inequitable decisions.
Published: 2023
Full Text: View/download PDF

6. Authoring Interactive and Immersive Experiences Using Programming by Demonstration

Author: Edwige Chauvergne, Martin Hachet, Arnaud Prouzeau, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and ACM
Subjects: manipulation directe, édition d'interactions, Virtual reality, démonstration, utilisateurs finaux, immersive, demonstration, authoring interactions, défis, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], direct manipulation, immersif, end users, challenges Réalité Virtuelle
Abstract: International audience; Immersive technologies, like virtual and augmented reality, allow engaging the general public in interactive experiences, which are particularly promising in educational and cultural activities (e.g. museums, exhibits). For now, the design of such interactive experiences requires extensive knowledge of expert programming tools, and thus they are not accessible to non-developers. A promising method to ease the prototyping of interactive scenes for non-expert users stands on the concept of programming-by-demonstration. With such an approach, novice users can simply demonstrate an interaction or the expected behavior of a virtual object to build their prototype, without knowing the underlying coding mechanisms. In this paper, we propose an immersive authoring system that bases on that approach. We prototyped two use cases based on this system, as well as a user study. Using our observations and the results of the study, we discuss challenges associated with the design of such systems and provide guidelines for the development of future immersive programming-by-demonstration tools.; Les technologies immersives, comme la réalité virtuelle et augmentée, permettent de proposer au grand public des expériences interactives, particulièrement dans les activités éducatives et culturelles. Pour l’instant, la conception de telles expériences nécessite une connaissance approfondie de langages de programmation, difficilement accessibles aux non-développeurs. La programmation par démonstration est une approche qui permet de faciliter le prototypage de scènes interactives pour les utilisateurs non experts. Avec cette approche, les utilisateurs peuvent construire un prototype sans connaître les mécanismes de codages sous-jacents, simplement en effectuant l’interaction ou le comportement attendu d’un objet virtuel. Dans cet article, nous proposons un système de création immersif basé sur cette approche. Nous avons prototypé deux cas d’utilisations, ainsi que réalisé une étude utilisateur. En s’appuyant sur nos observations et les résultats de l’étude, nous discutons des défis et des lignes directrices pour le développement de futurs outils de programmation immersive par démonstration.
Published: 2023
Full Text: View/download PDF

7. I'm Transforming! Effects of Visual Transitions to Change of Avatar on the Sense of Embodiment in AR

Author: Otono, Riku, Genay, Adélaïde, Perusquía-Hernández, Monica, Isoyama, Naoya, Uchiyama, Hideaki, Hachet, Martin, Lécuyer, Anatole, Kiyokawa, Kiyoshi, Nara Institute of Science and Technology - Graduate School of Information Science (NAIST), Nara Institute of Science and Technology, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-RÉALITÉ VIRTUELLE, HUMAINS VIRTUELS, INTERACTIONS ET ROBOTIQUE (IRISA-D5), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), and IEEE
Subjects: Avatars, Embodiment, Augmented Reality, User study, Visual effects, Transitions, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]
Abstract: International audience; Virtual avatars are more and more often featured in Virtual Reality (VR) and Augmented Reality (AR) applications. When embodying a virtual avatar, one may desire to change of appearance over the course of the embodiment. However, switching suddenly from one appearance to another can break the continuity of the user experience and potentially impact the sense of embodiment (SoE), especially when the new appearance is very different. In this paper, we explore how applying smooth visual transitions at the moment of the change can help to maintain the SoE and benefit the general user experience. To address this, we implemented an AR system allowing users to embody a regular-shaped avatar that can be transformed into a muscular one through a visual effect. The avatar’s transformation can be triggered either by the user through physical action (“active” transition), or automatically launched by the system (“passive” transition). We conducted a user study to evaluate the effects of these two types of transformations on the SoE by comparing them to control conditions where there was no visual feedback of the transformation. Our results show that changing the appearance of one’s avatar with an active transition (with visual feedback), compared to a passive transition, helps to maintain the user’s sense of agency, a component of the SoE. They also partially suggest that the Proteus effects experienced during the embodiment were enhanced by these transitions. Therefore, we conclude that visual effects controlled by the user when changing their avatar’s appearance can benefit their experience by preserving the SoE and intensifying the Proteus effects.
Published: 2023
Full Text: View/download PDF

8. Edo: A Participatory Data Physicalization on the Climate Impact of Dietary Choices

Author: Kim Sauvé, Pierre Dragicevic, Yvonne Jansen, Lancaster University, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019)
Subjects: Participatory Data Physicalization, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Packed Bubble Chart, Climate Change Communication
Abstract: International audience; A participatory data physicalization, or PDP, is a physical visualization that allows people to physically participate in the creation of the visualization, by directly encoding their data. PDPs offer a way to engage a community with data of personal relevance that otherwise would be intangible. However, their design space has only begun to be explored, and most prior work shows relatively simple encoding rules. Therefore, we present a design exploration of different ways of faceting contributed data: by week, day, or person. Specifically, we designed Edo, a PDP that allows a small community to contribute their data to a physical visualization showing the climate impact of their dietary choices. In this pictorial, we elaborate on the design process of Edo and reflect on the findings of a three-week deployment of different layouts of Edo. Fabrication instructions and data are available under CC-BY 4.0 at osf.io/q5fr6.
Published: 2023
Full Text: View/download PDF

9. Deimos: A Grammar of Dynamic Embodied Immersive Visualisation Morphs and Transitions

Author: Benjamin Lee, Arvind Satyanarayan, Maxime Cordeil, Arnaud Prouzeau, Bernhard Jenny, Tim Dwyer, Monash university, MIT Computer Science & Artificial Intelligence Lab (MIT CSAIL), Massachusetts Institute of Technology (MIT), University of Queensland [Brisbane], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: FOS: Computer and information sciences, Grammar, User study, Immersive Analytics, Animated transitions, Computer Science - Human-Computer Interaction, [INFO]Computer Science [cs], Embodied interaction, Data visualisation, Human-Computer Interaction (cs.HC)
Abstract: We present Deimos, a grammar for specifying dynamic embodied immersive visualisation morphs and transitions. A morph is a collection of animated transitions that are dynamically applied to immersive visualisations at runtime and is conceptually modelled as a state machine. It is comprised of state, transition, and signal specifications. States in a morph are used to generate animation keyframes, with transitions connecting two states together. A transition is controlled by signals, which are composable data streams that can be used to enable embodied interaction techniques. Morphs allow immersive representations of data to transform and change shape through user interaction, facilitating the embodied cognition process. We demonstrate the expressivity of Deimos in an example gallery and evaluate its usability in an expert user study of six immersive analytics researchers. Participants found the grammar to be powerful and expressive, and showed interest in drawing upon Deimos' concepts and ideas in their own research., Comment: CHI 2023
Published: 2023
Full Text: View/download PDF

10. Studying 'Avatar Transitions' in Augmented Reality: Influence on Sense of Embodiment and Physiological Activity

Author: Otono, Riku, Genay, Adélaïde, Perusquía-Hernández, Monica, Isoyama, Naoya, Uchiyama, Hideaki, Hachet, Martin, Lécuyer, Anatole, Kiyokawa, Kiyoshi, Nara Institute of Science and Technology - Graduate School of Information Science (NAIST), Nara Institute of Science and Technology, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-RÉALITÉ VIRTUELLE, HUMAINS VIRTUELS, INTERACTIONS ET ROBOTIQUE (IRISA-D5), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), and This research was supported in part by a Grant in aid for KAKENHI 22K12109 and the Start Up Fund for female researchers at NAIST.
Subjects: Avatars, Augmented Reality, User study, Proteus effect, Sense of Embodiment, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]
Abstract: International audience; The impact of avatar transitions, in which an avatar's appearance is changed, has been little studied. We implemented an avatar transition system that is decomposed into two parts: an active one and a passive one. In the active transition, the avatar's appearance is transformed according to the user's physical action. In the passive transition, users automatically experience the same transition without physical action. The influence of transitions on the user's physical performance and the sense of embodiment was explored. Our results show that active transitions increase the sense of agency and magnitude of surface electromyography (sEMG) compared to passive transitions, and both transitions increase the sEMG magnitude following the virtual Reality embodiment.
Published: 2022
Full Text: View/download PDF

11. Envisioning Situated Visualizations of Environmental Footprints in an Urban Environment

Author: Jansen, Yvonne, Bucchieri, Federica, Dragicevic, Pierre, Hachet, Martin, Koval, Morgane, Petiot, Léana, Prouzeau, Arnaud, Schmalstieg, Dieter, Yao, Lijie, Isenberg, Petra, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Analysis and Visualization (AVIZ), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Graz University of Technology [Graz] (TU Graz), and ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019)
Subjects: workshop, Situated visualization, environmental footprint, workshop, ideation exercise, Situated visualization, ideation exercise, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], environmental footprint
Abstract: International audience; We present the results of a brainstorming exercise focused on how situated visualizations could be used to better understand the state of the environment and our personal behavioral impact on it. Specifically, we conducted a day long workshop in the French city of Bordeaux where we envisioned situated visualizations of urban environmental footprints. We explored the city and took photos and notes about possible situated visualizations of environmental footprints that could be embedded near places, people, or objects of interest. We found that our designs targeted four purposes and used four different methods that could be further explored to test situated visualizations for the protection of the environment.
Published: 2022
Full Text: View/download PDF

12. Do You See What You Mean? Using Predictive Visualizations to Reduce Optimism in Duration Estimates

Author: Jansen, Yvonne, Koval, Morgane, Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and ANR-19-CE33-0012,EMBER,Visualisations situées pour l'analyse de données personnelles(2019)
Subjects: Planning fallacy, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], predictive visualization
Abstract: International audience; Making time estimates, such as how long a given task might take, frequently leads to inaccurate predictions because of an optimistic bias. Previous attempts to alleviate this bias, including decomposing the task into smaller components and listing potential surprises, have not shown any major improvement. This article builds on the premise that these procedures may have failed because they involve compound probabilities and mixture distributions which are difficult to compute in one's head. We hypothesize that predictive visualizations of such distributions would facilitate the estimation of task durations. We conducted a crowdsourced study in which 145 participants provided different estimates of overall and sub-task durations and we used these to generate predictive visualizations of the resulting mixture distributions. We compared participants' initial estimates with their updated ones and found compelling evidence that predictive visualizations encourage less optimistic estimates.
Published: 2022
Full Text: View/download PDF

13. X-Road

Author: Lauren Thévin, Carine Briant, Anke Brock, Ludwig Maximilian University [Munich] (LMU), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institution Régionale des Sourds et des Aveugles (IRSA), ENAC - Equipe Informatique Interactive (LII), Ecole Nationale de l'Aviation Civile (ENAC), This project was conducted with the support of the Erasmus+ Program of the European Union Pr. no 2016-1-EL01-KA201-023731., and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Computer science, Visual impairment, Augmented reality, 02 engineering and technology, Space (commercial competition), Virtual reality, Training (civil), Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, medicine, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Bespoke, 05 social sciences, Orientation and Mobility, 020207 software engineering, Accessibility, Computer Science Applications, Human-Computer Interaction, Mobility training, Audio feedback, medicine.symptom
Abstract: International audience; Orientation and Mobility (O&M) classes teach people with visual impairments how to navigate the world, for instance how to cross a road. Yet, this training can be difficult and dangerous due to conditions such as traffic and weather. Virtual Reality (VR) can overcome these challenges by providing interactive controlled environments. However, most existing VR tools rely on visual feedback, which limits their use with students with visual impairment. In a collaborative design approach with O&M instructors, we designed an affordable and accessible VR system for O&M classes, called X-Road. Using a smartphone and a bespoke headmount, X-Road provides both visual and audio feedback and allows users to move in space, as in the real world. In a study with 13 students with visual impairments, X-Road proved to be an effective alternative to teaching and learning classical O&M tasks, and both students and instructors were enthusiastic about this technology. We conclude with design recommendations for inclusive VR systems.
Published: 2020
Full Text: View/download PDF

14. Gesture Elicitation as a Computational Optimization Problem

Author: Theophanis Tsandilas, Pierre Dragicevic, Extreme Situated Interaction (EX-SITU), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: Gesture elicitation, optimization uncertainty, learning curves, [INFO]Computer Science [cs], design optimization, assignment problems, bootstrap
Abstract: International audience; Gesture elicitation studies are commonly used for designing novel gesture-based interfaces. There is a rich methodology literature on metrics and analysis methods that helps researchers understand and characterize data arising from such studies. However, deriving concrete gesture vocabularies from this data, which is often the ultimate goal, remains largely based on heuristics and ad hoc methods. In this paper, we treat the problem of deriving a gesture vocabulary from gesture elicitation data as a computational optimization problem. We show how to formalize it as an optimal assignment problem and discuss how to express objective functions and custom design constraints through integer programs. In addition, we introduce a set of tools for assessing the uncertainty of optimization outcomes due to random sampling, and for supporting researchers' decisions on when to stop collecting data from a gesture elicitation study. We evaluate our methods on a large number of simulated studies.
Published: 2022
Full Text: View/download PDF

15. Riemannian Channel Selection for BCI With Between-Session Non-Stationarity Reduction Capabilities

Author: Fabien Lotte, Khadijeh Sadatnejad, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017)
Subjects: General Neuroscience, MESH: channel selection, Rehabilitation, Biomedical Engineering, Electroencephalography, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, MESH: non-stationarity, Brain-Computer Interfaces, MESH: EEG, MESH: Brain-computer interfaces, Internal Medicine, MESH: Riemannian manifold, Humans, [MATH.MATH-AG]Mathematics [math]/Algebraic Geometry [math.AG], [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Algorithms
Abstract: L'institution a financé les frais de publication pour que cet article soit en libre accès; International audience; Objective: Between-session non-stationarity is a major challenge of current Brain-Computer Interfaces (BCIs) that affects system performance. In this paper, we investigate the use of channel selection for reducing between-session non-stationarity with Riemannian BCI classifiers. We use the Riemannian geometry framework of covariance matrices due to its robustness and promising performances. Current Riemannian channel selection methods do not consider between-session non-stationarity and are usually tested on a single session. Here, we propose a new channel selection approach that specifically considers non-stationarity effects and is assessed on multi-session BCI data sets. Methods: We remove the least significant channels using a sequential floating backward selection search strategy. Our contributions include: 1) quantifying the non-stationarity effects on brain activity in multi-class problems by different criteria in a Riemannian framework and 2) a method to predict whether BCI performance can improve using channel selection. Results: We evaluate the proposed approaches on three multi-session and multi-class mental tasks (MT)-based BCI datasets. They could lead to significant improvements in performance as compared to using all channels for datasets affected by between-session non-stationarity and to significant superiority to the state-of-the-art Riemannian channel selection methods over all datasets, notably when selecting small channel set sizes. Conclusion: Reducing non-stationarity by channel selection could significantly improve Riemannian BCI classification accuracy. Significance: Our proposed channel selection approach contributes to make Riemannian BCI classifiers more robust to between-session non-stationarities.
Published: 2022
Full Text: View/download PDF

16. TimeTables: Embodied Exploration of Immersive Spatio-Temporal Data

Author: Yidan Zhang, Barrett Ens, Kadek Ananta Satriadi, Arnaud Prouzeau, Sarah Goodwin, Zhang, Yidan, Ens, Barrett, Satriadi, Kadek Ananta, Prouzeau, Armaud, Goodwin, Sarah, 29th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2022 Virtual, Online 12-16 March 2022, Monash university, University of South Australia [Adelaide], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: Visualization application domains, 3D displays, Data analysis, human computer interaction (HCI), Interaction techniques, Virtual reality, Energy consumption, Information visualization, Human-centered computing, [INFO]Computer Science [cs], Buildings, Interaction paradigms, Data visualisation, Visualization
Abstract: International audience; We propose TimeTables, a novel prototype system that aims to support data exploration, using embodiment with space-time cubes in virtual reality. TimeTables uses multiple space-time cubes on virtual tabletops, which users can manipulate by extracting time layers or individual buildings to create new tabletop views. The surrounding environment includes a large space for multiple linked tabletops and a storage wall. TimeTables presents information at different time scales by stretching layers to drill down in time. Users can also jump into tabletops to inspect data from an egocentric perspective. We present a use case scenario of energy consumption displayed on a university campus to demonstrate how our system could support data exploration and analysis over space and time. From our experience and analysis we believe the system has a high potential in assisting spatio-temporal data exploration and analysis.
Published: 2022
Full Text: View/download PDF

17. Detection of Motor Cerebral Activity After Median Nerve Stimulation During General Anesthesia (STIM-MOTANA): Protocol for a Prospective Interventional Study

Author: Sébastien Rimbert, Julien Lelarge, Philippe Guerci, Seyed Javad Bidgoli, Claude Meistelman, Guy Cheron, Ana Maria Cebolla Alvarez, Denis Schmartz, Centre Hospitalier Universitaire Brugmann [Bruxelles] (CHU), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université libre de Bruxelles (ULB), Centre Hospitalier Régional Universitaire de Nancy (CHRU Nancy), and Fondation BrugmannFNRS (Belgique)
Subjects: brain-computer interfaces, median nerve stimulation, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], [SCCO.NEUR]Cognitive science/Neuroscience, General Medicine, general anesthesia, intraoperative awareness, electroencephalography, [SDV.MHEP]Life Sciences [q-bio]/Human health and pathology
Abstract: Background Accidental awareness during general anesthesia (AAGA) is defined as an unexpected awareness of the patient during general anesthesia. This phenomenon occurs in 1%-2% of high-risk practice patients and can cause physical suffering and psychological after-effects, called posttraumatic stress disorder. In fact, no monitoring techniques are satisfactory enough to effectively prevent AAGA; therefore, new alternatives are needed. Because the first reflex for a patient during an AAGA is to move, but cannot do so because of the neuromuscular blockers, we believe that it is possible to design a brain-computer interface (BCI) based on the detection of movement intention to warn the anesthetist. To do this, we propose to describe and detect the changes in terms of motor cortex oscillations during general anesthesia with propofol, while a median nerve stimulation is performed. We believe that our results could enable the design of a BCI based on median nerve stimulation, which could prevent AAGA. Objective To our knowledge, no published studies have investigated the detection of electroencephalographic (EEG) patterns in relation to peripheral nerve stimulation over the sensorimotor cortex during general anesthesia. The main objective of this study is to describe the changes in terms of event-related desynchronization and event-related synchronization modulations, in the EEG signal over the motor cortex during general anesthesia with propofol while a median nerve stimulation is performed. Methods STIM-MOTANA is an interventional and prospective study conducted with patients scheduled for surgery under general anesthesia, involving EEG measurements and median nerve stimulation at two different times: (1) when the patient is awake before surgery (2) and under general anesthesia. A total of 30 patients will receive surgery under complete intravenous anesthesia with a target-controlled infusion pump of propofol. Results The changes in event-related desynchronization and event-related synchronization during median nerve stimulation according to the various propofol concentrations for 30 patients will be analyzed. In addition, we will apply 4 different offline machine learning algorithms to detect the median nerve stimulation at the cerebral level. Recruitment began in December 2022. Data collection is expected to conclude in June 2024. Conclusions STIM-MOTANA will be the first protocol to investigate median nerve stimulation cerebral motor effect during general anesthesia for the detection of intraoperative awareness. Based on strong practical and theoretical scientific reasoning from our previous studies, our innovative median nerve stimulation–based BCI would provide a way to detect intraoperative awareness during general anesthesia. Trial Registration Clinicaltrials.gov NCT05272202; https://clinicaltrials.gov/ct2/show/NCT05272202 International Registered Report Identifier (IRRID) PRR1-10.2196/43870
Published: 2023
Full Text: View/download PDF

18. Towards Immersive Humanitarian Visualizations

Author: Pierre Dragicevic, Dragicevic, Pierre, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: FOS: Computer and information sciences, Computer Science - Human-Computer Interaction, ComputerApplications_COMPUTERSINOTHERSYSTEMS, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Human-Computer Interaction (cs.HC)
Abstract: This paper introduces immersive humanitarian visualization as a promising research area in information visualization. Humanitarian visualizations are data visualizations designed to promote human welfare. This paper explains why immersive display technologies taken broadly (e.g, virtual reality, augmented reality, ambient displays and physical representations) open up a range of opportunities for humanitarian visualization. In particular, immersive displays offer ways to make remote and hidden human suffering more salient. They also offer ways to communicate quantitative facts together with qualitative information and visceral experiences, in order to provide a holistic understanding of humanitarian issues that could support more informed humanitarian decisions. But despite some promising preliminary work, immersive humanitarian visualization has not taken off as a research topic yet. The goal of this paper is to encourage, motivate, and inspire future research in this area.
Published: 2022

19. Visualisation d'information pour l'altruisme efficace

Author: Dragicevic, Pierre, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: FOS: Computer and information sciences, Information visualization, human-computer interaction, Effective altruism, Computer Science - Human-Computer Interaction, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Human-Computer Interaction (cs.HC)
Abstract: Effective altruism is a movement whose goal it to use evidence and reason to figure out how to benefit others as much as possible. This movement is becoming influential, but effective altruists still lack tools to help them understand complex humanitarian trade-offs and make good decisions based on data. Visualization-the study of computer-supported, visual representations of data meant to support understanding, communication, and decision makingcan help alleviate this issue. Conversely, effective altruism provides a powerful thinking framework for visualization research that focuses on humanitarian applications.
Published: 2022
Full Text: View/download PDF

20. Non-isomorphic Interaction Techniques for Controlling Avatar Facial Expressions in VR

Author: Thomas Pietrzak, Martin Hachet, Géry Casiez, Marc Baloup, Technology and knowledge for interaction (LOKI), Inria Lille - Nord Europe, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS)-Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Université de Lille, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut Universitaire de France (IUF), Ministère de l'Education nationale, de l’Enseignement supérieur et de la Recherche (M.E.N.E.S.R.), Inria challenge Avatar, ACM, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: VR, Facial expression, Computer science, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.2: User Interfaces, Input device, 02 engineering and technology, Virtual reality, Emoji, Control theory, Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, [INFO]Computer Science [cs], 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Set (psychology), 050107 human factors, Avatar, Emotion, Emoticons, 05 social sciences, 020207 software engineering, Interaction technique, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems/H.5.1.1: Artificial, augmented, and virtual realities, [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Expression (mathematics)
Abstract: International audience; The control of an avatar’s facial expressions in virtual reality is mainly based on the automated recognition and transposition of the user’s facial expressions. These isomorphic techniques are limited to what users can convey with their own face and have recognition issues. To overcome these limitations, non-isomorphic techniques rely on interaction techniques using input devices to control the avatar’s facial expressions. Such techniques need to be designed to quickly and easily select and control an expression, and not disrupt a main task such as talking. We present the design of a set of new non- isomorphic interaction techniques for controlling an avatar facial expression in VR using a standard VR controller. These techniques have been evaluated through two controlled experiments to help designing an interaction technique combining the strengths of each approach. This technique was evaluated in a final ecological study showing it can be used in contexts such as social applications.
Published: 2021
Full Text: View/download PDF

21. Investigating Cognitive Load in Energy Network Control Rooms: Recommendations for Future Designs

Author: Umair Afzal, Arnaud Prouzeau, Lee Lawrence, Tim Dwyer, Saikiranrao Bichinepally, Ariel Liebman, Sarah Goodwin, Monash University [Melbourne], Swinburne University of Technology [Melbourne], Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Subjects: energy market operators, situational awareness, cognitive load, control room, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], eye tracking, General Psychology
Abstract: International audience; This study analyzed and explored the cognitive load of Australian energy market operators managing one of the longest inter-connected electrical networks in the world. Each operator uses a workstation with seven screens in an active control room environment, with a large coordination screen to show information and enable collaboration between different control centers. Cognitive load was assessed during both training scenarios and regular control room operations via the integration of subjective and physiological measures. Eye-tracking glasses were also used to analyze the operators gaze behavior. Our results indicate that different events (normal or unexpected), different participants for the same session, and different periods of one session all have varying degrees of cognitive load. The system design was observed to be inefficient in some situations and to have an adverse affect on cognitive load. In critical situations for instance, operator collaboration was high and the coordination screen was used heavily when collaborating between two control centers, yet integration with the system could be improved. Eye tracking data analysis showed that the layout of applications across the seven screens was not optimal for many tasks. Improved layout strategies, potential combination of applications, redesigning of certain applications, and linked views are all recommended for further exploration in addition to improved integration of procedures and linking alarms to visual cues.
Published: 2021
Full Text: View/download PDF

22. Standardization of protocol design for user training in EEG-based brain-computer interface

Author: Jelena Mladenović, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Mladenovic, Jelena, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Standardization, [INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing, InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.,HCI), Computer science, Interface (computing), media_common.quotation_subject, Biomedical Engineering, [SCCO.COMP]Cognitive science/Computer science, Context (language use), 050105 experimental psychology, 03 medical and health sciences, Cellular and Molecular Neuroscience, User-Computer Interface, InformationSystems_MODELSANDPRINCIPLES, 0302 clinical medicine, [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [SCCO.COMP] Cognitive science/Computer science, Perceptual affordance, Human–computer interaction, Perception, Human-computer interaction (HCI), Standadization, Humans, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Electroencephalography (EEG), Affordance, User training, Brain–computer interface, media_common, Haptic technology, Brain-computer interfaces (BCI), SIMPLE (military communications protocol), 05 social sciences, Electroencephalography, Reference Standards, Protocal design, [INFO.INFO-MO]Computer Science [cs]/Modeling and Simulation, Brain-Computer Interfaces, [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-MO] Computer Science [cs]/Modeling and Simulation, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], 030217 neurology & neurosurgery
Abstract: Brain-computer interfaces (BCIs) are systems that enable a person to interact with a machine using only neural activity. Such interaction can be non-intuitive for the user hence user trainings are developed to increase one's understanding, confidence and motivation, which would in parallel increase system performance. To clearly address the current issues in the BCI user training protocol design, here it is divided into introductory period and BCI interaction period. First, the introductory period (before BCI interaction) must be considered as equally important as the BCI interaction for user training. To support this claim, a review of papers show that BCI performance can depend on the methodologies presented in such introductory period. To standardize its design, the literature from human-computer interaction (HCI) is adjusted to the BCI context. Second, during the user-BCI interaction, the interface can take a large spectrum of forms (2D, 3D, size, color etc.) and modalities (visual, auditory or haptic etc.) without following any design standard or guidelines. Namely, studies that explore perceptual affordance on neural activity, show that motor neurons can be triggered from a simple observation of certain objects, and depending on objects' properties (size, location etc.) neural reactions can vary greatly. Surprisingly, the effects of perceptual affordance were not investigated in the BCI context. Both inconsistent introductions to BCI as well as variable interface designs make it difficult to reproduce experiments, predict their outcomes and compare results between them. To address these issues, a protocol design standardization for user training is proposed.
Published: 2020

23. EEG-based neuroergonomics for 3d user interfaces: opportunities and challenges

Author: Fabien Lotte, Jérémy Frey, Martin Hachet, Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Lotte, Fabien
Subjects: media_common.quotation_subject, Human Factors and Ergonomics, 02 engineering and technology, [SCCO]Cognitive science, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], Human–computer interaction, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], 0202 electrical engineering, electronic engineering, information engineering, Neuroergonomics, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-BT]Computer Science [cs]/Biotechnology, 050107 human factors, General Psychology, Applied Psychology, media_common, [INFO.INFO-MM] Computer Science [cs]/Multimedia [cs.MM], 05 social sciences, [INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM], 020207 software engineering, [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], [SCCO] Cognitive science, Art, [INFO.INFO-BT] Computer Science [cs]/Biotechnology, Industrial relations, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Humanities
Abstract: Les interfaces utilisateurs 3D sont utilisees dans un nombre croissant d’applications, qui vont du divertissement au design industriel. Cependant, les tâches d’interaction 3D sont en general plus complexes pour les utilisateurs etant-donne qu’il est plus demandeur au niveau cognitif d’interagir avec un environnement en 3D que de percevoir et d’interagir avec un environnement en 2D. Ainsi, il est essentiel que nous puissions finement evaluer l’experience utilisateur, afin de proposer des interfaces faciles d’utilisation. Pour ce faire, une direction de recherche prometteuse est de mesurer l’etat interne des utilisateurs via l’acquisition de signaux cerebraux pendant l’interaction, en suivant une approche neuroergonomique. Combine a des methodes existantes, un tel outil peut etre utilise pour ameliorer la comprehension de l’experience utilisateur. Dans cet article, nous passons en revue le travail qui est mene dans ce domaine ; ce qui a deja ete accompli et les challenges qui se font jour. Nous decrivons comment une technique d’imagerie cerebrale mobile telle que l’electroencephalographie (EEG) permet des mesures continues qui ne perturbent pas l’interaction. Une evaluation des utilisateurs centree sur l’EEG peut donner un apercu de multiples dimensions de l’experience utilisateur, avec des taches d’interaction realistes ou des interfaces novatrices. Nous etudions quatre construits : la charge mentale, l’attention, la reconnaissance d’erreur et le confort visuel. A terme, ces metriques pourraient aider a soulager les utilisateurs lorsqu’ils interagissent avec des ordinateurs.
Published: 2017
Full Text: View/download PDF

24. A physical learning companion for Mental-Imagery BCI User Training

Author: Bernard N'Kaoua, Roger Nkambou, Léa Pillette, Boris Mansencal, Camille Jeunet, Fabien Lotte, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Cognition, Langues, Langage, Ergonomie (CLLE), Centre National de la Recherche Scientifique (CNRS)-École pratique des hautes études (EPHE), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université Toulouse - Jean Jaurès (UT2J), Laboratoire de recherche en Gestion, Diffusion et Acquisition des Connaissances (Laboratoire GDAC), Université du Québec à Montréal = University of Québec in Montréal (UQAM), Handicap Activité Cognition Santé [Bordeaux] (HACS), Université de Bordeaux (UB)-Institut National de Recherche en Informatique et en Automatique (Inria)-CHU Bordeaux [Bordeaux]-Institut National de la Santé et de la Recherche Médicale (INSERM), This work was supported by the French National Research Agency (project REBEL, grant ANR-15-CE23-0013-01), the European Research Council with the Brain-Conquest project (grant ERC-2016-STG-714567) and the Initiative of Excellence (IdEx) from the University of Bordeaux, France, ANR-15-CE23-0013,REBEL,Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle(2015), European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), École Pratique des Hautes Études (EPHE), Université de Toulouse (UT)-Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), and Université de Toulouse (UT)
Subjects: Social feedback, Computer science, Learning Companion, Psychological intervention, Human Factors and Ergonomics, Context (language use), Memorization, Education, Task (project management), [SCCO]Cognitive science, 03 medical and health sciences, 0302 clinical medicine, User experience design, Human–computer interaction, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Mental-Imagery based Brain-Computer Interface, 030304 developmental biology, 0303 health sciences, Facial expression, User experience, business.industry, Emotional feedback, General Engineering, Human-Computer Interaction, Hardware and Architecture, business, 030217 neurology & neurosurgery, Software, Mental image
Abstract: International audience; Mental-Imagery based Brain-Computer Interfaces (MI-BCI) present new opportunities to interact with digital technologies, such as wheelchairs or neuroprostheses, only by performing mental imagery tasks (e.g., imagining an object rotating or imagining hand movements). MI-BCIs can also be used for several applications such as communication or post-stroke rehabilitation. Though, their lack of reliability remains a barrier to a larger scale development of the technology. For example, one task between two is recognized on average 75% of the time. It has been shown that users are more likely to struggle using MI-BCIs if they are non-autonomous or tensed. This might, at least in part, result from a lack of social presence and emotional support, which have yet very little been tested in MI-BCI, despite recommendations from the educational literature. One way to provide such social and emotional context is by using a learning companion. Therefore, we designed, implemented and evaluated the first learning companion dedicated to the improvement of MI-BCI user training. We called this companion PEANUT for Personalized Emotional Agent for Neurotechnology User Training. PEANUT provided social presence and emotional support, depending on the performance and progress of the user, through interventions combining both pronounced sentences and facial expressions. It was designed based on the literature, data analyses and user-studies. We notably conducted various online user surveys to identify the desired characteristics of our learning companion in terms of appearance and supporting speech content. From the results of these surveys we notably deduced which should be the characteristics (personal/non-personal, exclamatory/declarative) of the sentences to be used depending on the performance and progression of a learner. We also found that eyebrows could increase expressiveness of cartoon-like faces. Then, once this companion was implemented, we evaluated it during real online MI-BCI use. We found that non-autonomous people, i.e., who are more inclined to work in a group, that are usually disadvantaged when using MI-BCI were advantaged compared to autonomous people when PEANUT was present with an increase of 3.9% of peak performances. Furthermore, in terms of user experience, PEANUT seems to have improved how people felt about their ability to learn and memorize how to use an MI-BCI by 7.4%, which is a dimension of the user experience we assessed.
Published: 2020
Full Text: View/download PDF

25. CARDS : Un système de réalité mixte pour l'apprentissage collaboratif à l'école

Author: David Bertolo, Joan Sol Roo, Philippe Giraudeau, Robin Vivian, Martin Hachet, Stéphanie Fleck, Alexis Olry, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Psychologie Ergonomique et Sociale pour l'Expérience utilisateurs (PErSEUs), Université de Lorraine (UL), Laboratoire de Conception, Optimisation et Modélisation des Systèmes (LCOMS), This work is part of the e-TAC project financially supported by the Caisse des Dépôts et Consignations as part of the e- FRAN projects., Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)
Subjects: Iterative design, Computer science, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, Workspace, Education, CCS Concepts•Human-centered computing → Field studies, Human–computer interaction, Children-Computer Interaction, 0202 electrical engineering, electronic engineering, information engineering, Tangible Interaction, 0501 psychology and cognitive sciences, Web navigation, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Augmented Reality, 4. Education, Iterative Design, 05 social sciences, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, Window (computing), 020207 software engineering, Collaborative learning, Spatial Augmented Reality, Mixed reality, Pointer (computer programming), Augmented reality, CCS Concepts •Human-Centered Computing → HCI design and evaluation methods
Abstract: International audience; Traditional computer systems based on the WIMP paradigm (Window, Icon, Menu, Pointer) have shown potential benefits at school (e.g. for web browsing). On the other hand, they are not well suited as soon as hands-on and collaborative activities are targeted. We present CARDS, a Mixed-Reality system that combines together physical and digital objects in a seamless workspace to foster active and collaborative learning. We describe the design process based on a participatory approach with researchers, teachers, and pupils. We then present and discuss the results of a user study that tends to show that CARDS has a good educational potential for the targeted activities.
Published: 2019
Full Text: View/download PDF

26. Accessibility of Immersive Serious Games for Persons with Cognitive Disabilities

Author: Pierre-Antoine Cinquin, Hélène Sauzéon, Pascal Guitton, Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Laboratoire Handicap Activité Cognition et Système Nerveux (HACS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Guitton, Pascal
Subjects: Research program, business.industry, Computer science, Internet privacy, [INFO.INFO-GR] Computer Science [cs]/Graphics [cs.GR], Cognition, [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Mixed reality, Wonder, Cognitive disabilities, Immersion (virtual reality), Augmented reality, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], User interface, business, ComputingMilieux_MISCELLANEOUS
Abstract: E-learning systems are still not very accessible for persons with disabilities, particularly those with cognitive impairments. It's well known that the training deficit is one of the cause of lower employment rates. In the past, we have addressed this issue by working on the accessibility of MOOCs. We have developed Aiana, a MOOC player with accessibility features based on the fragmentation of information streams and enabling user interface self-configuration. We are starting a new research program focused on the accessibility of immersive Serious Games for persons with cognitive impairments by first transposing some of Aiana's design principles. We believe that immersive Serious Games can provide effective assistance to learning for PWDs and we want to demonstrate this rigorously through large field studies. More generally, we wonder about the questions raised by the accessibility of Mixed Reality tools in immersive e-learning systems.
Published: 2019
Full Text: View/download PDF

27. A review of user training methods in brain computer interfaces based on mental tasks

Author: Léa Pillette, Fabien Lotte, Jelena Mladenović, Camille Benaroch, Camille Jeunet, Bernard N'Kaoua, Aline Roc, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Handicap Activité Cognition Santé [Bordeaux] (HACS), Université de Bordeaux (UB)-Institut National de Recherche en Informatique et en Automatique (Inria)-CHU Bordeaux [Bordeaux]-Institut National de la Santé et de la Recherche Médicale (INSERM), Cognition, Langues, Langage, Ergonomie (CLLE), Centre National de la Recherche Scientifique (CNRS)-École pratique des hautes études (EPHE), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université Toulouse - Jean Jaurès (UT2J), This work was supported by the European ResearchCouncil with project BrainConquest (grant ERC-2016-STG-714567)., Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, École Pratique des Hautes Études (EPHE), Université de Toulouse (UT)-Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), and Université de Toulouse (UT)
Subjects: Computer science, Process (engineering), Reliability (computer networking), 0206 medical engineering, Control (management), Biomedical Engineering, [SCCO.COMP]Cognitive science/Computer science, Mental imagery, 02 engineering and technology, Instructions, Training tasks, Training (civil), User, Feedback, [SCCO]Cognitive science, 03 medical and health sciences, Cellular and Molecular Neuroscience, 0302 clinical medicine, Human–computer interaction, Taxonomy (general), Humans, Learning, Mental task, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Electroencephalography (EEG), Brain–computer interface, [SCCO.NEUR]Cognitive science/Neuroscience, Brain, Reproducibility of Results, Electroencephalography, Brain-Computer Interfaces (BCI), 020601 biomedical engineering, Categorization, Brain-Computer Interfaces, [SCCO.PSYC]Cognitive science/Psychology, 030217 neurology & neurosurgery, Mental image
Abstract: Mental-tasks based brain–computer interfaces (MT-BCIs) allow their users to interact with an external device solely by using brain signals produced through mental tasks. While MT-BCIs are promising for many applications, they are still barely used outside laboratories due to their lack of reliability. MT-BCIs require their users to develop the ability to self-regulate specific brain signals. However, the human learning process to control a BCI is still relatively poorly understood and how to optimally train this ability is currently under investigation. Despite their promises and achievements, traditional training programs have been shown to be sub-optimal and could be further improved. In order to optimize user training and improve BCI performance, human factors should be taken into account. An interdisciplinary approach should be adopted to provide learners with appropriate and/or adaptive training. In this article, we provide an overview of existing methods for MT-BCI user training—notably in terms of environment, instructions, feedback and exercises. We present a categorization and taxonomy of these training approaches, provide guidelines on how to choose the best methods and identify open challenges and perspectives to further improve MT-BCI user training.
Published: 2021
Full Text: View/download PDF

28. Inria: From Cold-War Computing to Digital Sciences

Author: François X. Sillion, Philippe Nain, Pascal Guitton, Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Dynamic Networks : Temporal and Structural Capture Approach (DANTE), Inria Grenoble - Rhône-Alpes, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire de l'Informatique du Parallélisme (LIP), École normale supérieure de Lyon (ENS de Lyon)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-École normale supérieure de Lyon (ENS de Lyon)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Centre National de la Recherche Scientifique (CNRS)-Institut Rhône-Alpin des systèmes complexes (IXXI), École normale supérieure de Lyon (ENS de Lyon)-Université Lumière - Lyon 2 (UL2)-Université Jean Moulin - Lyon 3 (UJML), Université de Lyon-Université de Lyon-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Institut National des Sciences Appliquées de Lyon (INSA Lyon), Université de Lyon-Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Université Lumière - Lyon 2 (UL2)-Université Jean Moulin - Lyon 3 (UJML), Université de Lyon-Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Inria Siège, Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, École normale supérieure - Lyon (ENS Lyon)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-École normale supérieure - Lyon (ENS Lyon)-Université Claude Bernard Lyon 1 (UCBL), École normale supérieure - Lyon (ENS Lyon)-Université Lumière - Lyon 2 (UL2)-Université Jean Moulin - Lyon 3 (UJML), Institut National des Sciences Appliquées (INSA)-Université de Lyon-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Université Lumière - Lyon 2 (UL2)-Université Jean Moulin - Lyon 3 (UJML), Institut National des Sciences Appliquées (INSA)-Université de Lyon-Institut National des Sciences Appliquées (INSA)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Centre National de la Recherche Scientifique (CNRS)-Université de Lyon-Institut National de Recherche en Informatique et en Automatique (Inria)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-École normale supérieure - Lyon (ENS Lyon)-Centre National de la Recherche Scientifique (CNRS)-Université de Lyon-Université Claude Bernard Lyon 1 (UCBL), and Université de Lyon-École normale supérieure - Lyon (ENS Lyon)-Institut Rhône-Alpin des systèmes complexes (IXXI)
Subjects: history of computing, General Computer Science, Computer science, Cold War, Cold war, 0202 electrical engineering, electronic engineering, information engineering, Art history, [INFO]Computer Science [cs], 020207 software engineering, Inria, 02 engineering and technology
Abstract: International audience; Inria, the French institute for research in digital sciences, celebrates its 50th anniversary this year. The authors reflect on Inria's evolution through the decades and present its vision for the future.
Published: 2017
Full Text: View/download PDF

29. Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances

Author: Florent Berthaut, Martin Hachet, Méthodes et outils pour l'Interaction à gestes (MINT2), Inria Lille - Nord Europe, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS)-Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Computer science, media_common.quotation_subject, Emotions, Interactive 3d, Entertainment industry, Musical, Virtual reality, computer.software_genre, 050105 experimental psychology, 060404 music, Creativity, Computer graphics, Imaging, Three-Dimensional, Human–computer interaction, Immersion (virtual reality), Humans, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Graphics, Set (psychology), media_common, Multimedia, 05 social sciences, 06 humanities and the arts, Computer Graphics and Computer-Aided Design, computer, Music, 0604 arts, Software
Abstract: International audience; The power of interactive 3D graphics, immersive displays, and spatial interfaces is still under-explored in domains where the main target is to enhance creativity and emotional experiences. This article presents a set of work the attempts to extent the frontiers of music creation as well as the experience of audiences attending to digital performances. The goal is to connect sounds to interactive 3D graphics that musicians can interact with and the audience can observe.
Published: 2016
Full Text: View/download PDF

30. Brain Training with Neurofeedback

Author: Lorraine Perronnet, Fabien Lotte, Maureen Clerc, Anatole Lécuyer, Christian Barillot, 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), CentraleSupélec-Télécom Bretagne-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Université de Bretagne Sud (UBS)-Centre National de la Recherche Scientifique (CNRS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-CentraleSupélec-Télécom Bretagne-Université de Rennes 1 (UR1), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-École normale supérieure - Rennes (ENS Rennes)-Université de Bretagne Sud (UBS)-Centre National de la Recherche Scientifique (CNRS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), COMUE Université Côte d'Azur (2015-2019) (COMUE UCA), Computational Imaging of the Central Nervous System (ATHENA), Inria Sophia Antipolis - Méditerranée (CRISAM), Vision, Action et Gestion d'informations en Santé (VisAGeS), Institut National de la Santé et de la Recherche Médicale (INSERM)-Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE (IRISA-D5), IPL BCI-LIFT, Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-Télécom Bretagne-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-Télécom Bretagne-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Télécom Bretagne-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Clerc, Maureen
Subjects: medicine.diagnostic_test, Hemoencephalography, [SDV.IB.IMA]Life Sciences [q-bio]/Bioengineering/Imaging, 05 social sciences, Central nervous system, Magnetoencephalography, Electroencephalography, medicine.disease, 050105 experimental psychology, 03 medical and health sciences, [SDV.IB.IMA] Life Sciences [q-bio]/Bioengineering/Imaging, 0302 clinical medicine, medicine.anatomical_structure, Cerebral activity, medicine, Attention deficit hyperactivity disorder, 0501 psychology and cognitive sciences, Neurofeedback, Functional magnetic resonance imaging, Psychology, Neuroscience, ComputingMilieux_MISCELLANEOUS, 030217 neurology & neurosurgery
Abstract: International audience
Published: 2016
Full Text: View/download PDF

31. Neurophysiological Markers for Passive Brain–Computer Interfaces

Author: Jérémy Frey, Raphaëlle N. Roy, Commissariat à l'énergie atomique et aux énergies alternatives - Laboratoire d'Electronique et de Technologie de l'Information (CEA-LETI), Direction de Recherche Technologique (CEA) (DRT (CEA)), Commissariat à l'énergie atomique et aux énergies alternatives (CEA)-Commissariat à l'énergie atomique et aux énergies alternatives (CEA), GIPSA - Signal et Automatique pour la surveillance, le diagnostic et la biomécanique (GIPSA-SAIGA), Département Automatique (GIPSA-DA), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Département Images et Signal (GIPSA-DIS), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Maureen Clerc, Laurent Bougrain, Fabien Lotte, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest
Subjects: [SDV.IB.IMA]Life Sciences [q-bio]/Bioengineering/Imaging, Brain activity and meditation, Process (engineering), Entertainment industry, Electroencephalography, 03 medical and health sciences, 0302 clinical medicine, [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, Neuroimaging, Human–computer interaction, medicine, 0501 psychology and cognitive sciences, EEG, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Brain–computer interface, passive BCI, medicine.diagnostic_test, business.industry, 05 social sciences, Workload, Neurophysiology, Artificial intelligence, neurophysiology, Psychology, business, 030217 neurology & neurosurgery
Abstract: International audience; "Passive" BCIs use brain signals involuntarily generated by individuals. Those signals can be used for mental state monitoring in divers work situations such as hazardous ones (e.g. driving, plant monitoring, etc.), or more generally in order to improve human-computer interaction, notably in the entertainment industry. Through several neuroimaging techniques, the present chapter will detail what the common cerebral markers used by passive BCIs are, and which associated mental states are currently assessed. Thanks to their ease-of-use outside the laboratory, electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) are the two techniques that are mainly used to build passive BCI systems. EEG is a direct measure of brain activity that allows us to record onto the scalp the fluctuations of neuronal electrical activity. On the other hand, fNIRS is an indirect brain activity recording method that measures neuronal metabolic activity as it probes blood oxygenation. Passive BCIs aim to monitor various mental states, such as attention, mental fatigue, workload, error detection and emotions to name a few. For that purpose, BCIs make use of signal characteristics of different kinds. For example, there are spectral makers (e.g. power in a frequency band), or temporal ones (e.g. potentials triggered by certain events), and even spatial ones (e.g. relative activation of specific brain areas). There are different ways to put passive BCIs into practice depending on the assessed mental state. For instance, the recording of drivers' lapses of attention can help to prevent accidents, while measuring workload - which increases with the amount of data to process will allow to adjust the difficulty of a task. Error-related potentials, generated when we realize that a mistake was made, could be used by machines to get to know when they acted wrong. Using passive BCIs, it is also possible to characterize the emotions that are produced by media, and their intensity. Whether it be to prevent hazard or facilitate communication, the growing use of passive BCIs promises significant technological progress.
Published: 2016
Full Text: View/download PDF

32. SEREEGA: Simulating event-related EEG activity

Author: Juliane Pawlitzki, Laurens R. Krol, Fabien Lotte, Klaus Gramann, Thorsten O. Zander, Technische Universität Berlin (TU), Zander Laboratories, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), University of Technology Sydney (UTS), University of California [San Diego] (UC San Diego), University of California, Part of this work was supported by the Deutsche Forschungsgemeinschaft (grant number ZA 821/3-1), Idex Bordeaux and LabEX CPU/SysNum, and the European Research Council with the BrainConquest project (grant number ERC-2016-STG-714567), Technical University of Berlin / Technische Universität Berlin (TU), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and University of California (UC)
Subjects: Brain-Computer Interface, Sound Spectrography, Computer science, Event-Related, Ground Trut, [INFO.INFO-SE]Computer Science [cs]/Software Engineering [cs.SE], Electroencephalography, 050105 experimental psychology, Set (abstract data type), 03 medical and health sciences, 0302 clinical medicine, [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, ddc:153, [INFO.INFO-IM]Computer Science [cs]/Medical Imaging, medicine, Humans, 0501 psychology and cognitive sciences, Computer Simulation, Evaluation, MATLAB, Set (psychology), Evoked Potentials, Brain–computer interface, computer.programming_language, Signal processing, Neurology & Neurosurgery, medicine.diagnostic_test, business.industry, Event (computing), [SCCO.NEUR]Cognitive science/Neuroscience, General Neuroscience, SIGNAL (programming language), 05 social sciences, Reproducibility of Results, Pattern recognition, Signal Processing, Computer-Assisted, Classification, [INFO.INFO-MO]Computer Science [cs]/Modeling and Simulation, Toolbox, Artificial intelligence, ddc:004, [INFO.INFO-BI]Computer Science [cs]/Bioinformatics [q-bio.QM], business, computer, Simulation, 030217 neurology & neurosurgery, Software
Abstract: Electroencephalography (EEG) is a popular method to monitor brain activity, but it can be difficult to evaluate EEG-based analysis methods because no ground-truth brain activity is available for comparison. Therefore, in order to test and evaluate such methods, researchers often use simulated EEG data instead of actual EEG recordings, ensuring that it is known beforehand which e ects are present in the data. As such, simulated data can be used, among other things, to assess or compare signal processing and machine learn-ing algorithms, to model EEG variabilities, and to design source reconstruction methods. In this paper, we present SEREEGA, short for Simulating Event-Related EEG Activity. SEREEGA is a MATLAB-based open-source toolbox dedicated to the generation of sim-ulated epochs of EEG data. It is modular and extensible, at initial release supporting ve different publicly available head models and capable of simulating multiple different types of signals mimicking brain activity. This paper presents the architecture and general work ow of this toolbox, as well as a simulated data set demonstrating some of its functions.HighlightsSimulated EEG data has a known ground truth, which can be used to validate methods.We present a general-purpose open-source toolbox to simulate EEG data.It provides a single framework to simulate many different types of EEG recordings.It is modular, extensible, and already includes a number of head models and signals.It supports noise, oscillations, event-related potentials, connectivity, and more.
Published: 2018

33. Neural Mechanisms of Social Emotion Perception: An EEG Hyper-Scanning Study

Author: Gaochao Cui, Andrzej Cichocki, Changle Zhou, Fabien Lotte, Li Zhu, Junhua Li, Xiamen University, RIKEN Center for Brain Science [Wako] (RIKEN CBS), RIKEN - Institute of Physical and Chemical Research [Japon] (RIKEN), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Saitama Institute of Technology, National University of Singapore (NUS), Skolkovo Institute of Science and Technology [Moscow] (Skoltech), Nicolaus Copernicus University [Toruń], Hangzhou Dianzi University (HDU), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: genetic structures, medicine.diagnostic_test, [SCCO.NEUR]Cognitive science/Neuroscience, 05 social sciences, Significant difference, [INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM], Neurophysiology, Electroencephalography, Stimulus (physiology), 050105 experimental psychology, Phase locking, N400, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], 03 medical and health sciences, 0302 clinical medicine, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, Event-related potential, Emotion perception, medicine, 0501 psychology and cognitive sciences, Psychology, psychological phenomena and processes, 030217 neurology & neurosurgery, Cognitive psychology
Abstract: International audience; EEG-based hyper-scanning refers to two or more subjects engaged in a task together or performing the same action together while neurophysiological signals are simultaneously recorded from them. This is one of the manners for investigating between-subject neural activities involved in social interactions. Emotion perception plays an important role in human social interactions. Interaction and emotional state influence each other. In this study, we aim to investigate how between-subject interaction modulates emotion perception based on event related potentials (ERPs), connectivity analysis and classification analysis. We found that there are distinct differences appearing between paired subjects who performed the task together, which are early ERP components (N250 and N400), late ERP components (P1500 and N1500), and the greater amplitude in N250 for the seconding responding subject compared to the first one. In the exploration of connectivity using phase locking value (PLV), we found that there are significant differences among different frequency bands for each subject under positive and negative stimuli and the significant difference of hyper-connectivity existed in the gamma frequency band between positive and negative stimulus trials. In the classification analysis, we compared the hyper-features for two individual subjects separately, the performance was improved when hyper-features of the PLV was employed compared to the features of power spectrum density.
Published: 2018
Full Text: View/download PDF

34. 'Teegi's so cute!'

Author: Stéphanie Fleck, Martin Hachet, Thibault Lainé, Charlotte Baraudon, Jérémy Frey, Psychologie Ergonomique et Sociale pour l'Expérience utilisateurs (PErSEUs), Université de Lorraine (UL), Canopé académie de Metz, Ullo, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Service Expérimentation et Développement [Bordeaux] (SED), Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest
Subjects: Process (engineering), Computer science, Interface (Java), [SHS.EDU]Humanities and Social Sciences/Education, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.2: User Interfaces, Context (language use), Child- Computer Interaction, Education, Child computer interaction, Usability testing, Educational support, Human–computer interaction, Evaluation methods, Pedagogical potential assessment, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, School context, business.industry, 4. Education, 05 social sciences, 050301 education, Usability, Collaboration, Brain functions, ACM: K.: Computing Milieux/K.3: COMPUTERS AND EDUCATION/K.3.1: Computer Uses in Education, Cerebral activity, Tangible User Interface (TUI), business, 0503 education
Abstract: International audience; Cerebral activity is an intangible physiological process that is difficult to apprehend, especially for children. To overcome this difficulty, Teegi was designed as a new type of educational support. This tangible interface enables children to discover the relationship between brain activity and the functions of the human body. We developed a multi-methods research approach to estimate the pedagogical potential of Teegi used in a real-life educational context. Using this interdisciplinary methodology, we conducted a user study (N=29) that highlighted the strengths of this interface, both in terms of its usability and its impact on learning. Moreover, results revealed possible improvements to further increase pedagogical effectiveness. This type of interface, as well as the evaluation method that we propose, contribute to extending our knowledge concerning the pedagogical use of new interactive tools at school.
Published: 2018
Full Text: View/download PDF

35. Defining and quantifying users' mental imagery-based BCI skills: a first step

Author: Camille Jeunet, Fabien Lotte, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Chair in Brain-Machine Interface [Geneva] (CNBI), Ecole Polytechnique Fédérale de Lausanne (EPFL), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), and Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique)
Subjects: Imagery, Psychotherapy, Computer science, 0206 medical engineering, Biomedical Engineering, 02 engineering and technology, Matlab code, Electroencephalography, Machine learning, computer.software_genre, [INFO.INFO-CG]Computer Science [cs]/Computational Geometry [cs.CG], Eeg patterns, 03 medical and health sciences, Cellular and Molecular Neuroscience, [SCCO]Cognitive science, 0302 clinical medicine, InformationSystems_MODELSANDPRINCIPLES, Eeg data, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, medicine, Humans, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Brain–computer interface, Training set, medicine.diagnostic_test, business.industry, 020601 biomedical engineering, Brain-Computer Interfaces, Imagination, [INFO.EIAH]Computer Science [cs]/Technology for Human Learning, Artificial intelligence, business, computer, Classifier (UML), 030217 neurology & neurosurgery, Psychomotor Performance, Mental image
Abstract: International audience; Objective: While promising for many applications, Electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs) are still scarcely used outside laboratories , due to a poor reliability. It is thus necessary to study and fix this reliability issue. Doing so requires the use of appropriate reliability metrics to quantify both the classification algorithm and the BCI user's performances. So far, Classification Accuracy (CA) is the typical metric used for both aspects. However, we argue in this paper that CA is a poor metric to study BCI users' skills. Here, we propose a definition and new metrics to quantify such BCI skills for Mental Imagery (MI) BCIs, independently of any classification algorithm. Approach: We first show in this paper that CA is notably unspecific, discrete, training data and classifier dependent, and as such may not always reflect successful self-modulation of EEG patterns by the user. We then propose a definition of MI-BCI skills that reflects how well the user can self-modulate EEG patterns, and thus how well he could control an MI-BCI. Finally, we propose new performance metrics, classDis, restDist and classStab that specifically measure how distinct and stable the EEG patterns produced by the user are, independently of any classifier. Main results: By re-analyzing EEG data sets with such new metrics, we indeed confirmed that CA may hide some increase in MI-BCI skills or hide the user inability to self-modulate a given EEG pattern. On the other hand, our new met-rics could reveal such skill improvements as well as identify when a mental task performed by a user was no different than rest EEG. Significance: Our results showed that when studying MI-BCI users' skills, CA should be used with care, and complemented with metrics such as the new ones proposed. Our results also stressed the need to redefine BCI user training by considering the different BCI subskills and their measures. To promote the complementary use of our new metrics, we provide the Matlab code to compute them for free and open-source.
Published: 2018
Full Text: View/download PDF

36. Towards Robust Neuroadaptive HCI

Author: Andrzej Cichocki, Fabien Lotte, Aurélien Appriou, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), RIKEN Center for Brain Science [Wako] (RIKEN CBS), RIKEN - Institute of Physical and Chemical Research [Japon] (RIKEN), Skolkovo Institute of Science and Technology [Moscow] (Skoltech), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Computer science, Calibration (statistics), Interface (computing), 0206 medical engineering, 02 engineering and technology, Electroencephalography, Machine learning, computer.software_genre, Convolutional neural network, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], Machine Learning, Deep Learning, neuroergonomics, medicine, Neuroergonomics, 0501 psychology and cognitive sciences, EEG, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Mental Workload, medicine.diagnostic_test, business.industry, Deep learning, 05 social sciences, Neuroadaptive technology, Workload, 020601 biomedical engineering, Brain-Computer Interfaces, [INFO.EIAH]Computer Science [cs]/Technology for Human Learning, Artificial intelligence, business, computer
Abstract: International audience; Estimating mental workload from brain signals such as Electroencephalography (EEG) has proven very promising in multiple Human-Computer Interaction (HCI) applications , e.g., to design games or educational applications with adaptive difficulty, or to assess how cognitively difficult to use an interface can be. However, current EEG-based workload estimation may not be robust enough for some practical applications. Indeed, the currently obtained work-load classification accuracies are relatively low, making the resulting estimations not fully trustable. This paper thus studies promising modern machine learning algorithms, including Riemannian geometry-based methods and Deep Learning, to estimate workload from EEG signals. We study them with both user-specific and user-independent calibration , to go towards calibration-free systems. Our results suggested that a shallow Convolutional Neural Network obtained the best performance in both conditions, outperform-ing state-of-the-art methods on the used data sets. This suggests that Deep Learning can bring new possibilities in HCI.
Published: 2018
Full Text: View/download PDF

37. Nectar

Author: Anke Brock, Jeremy Laviole, Lauren Thévin, Jérémy Albouys-Perrois, RealityTech, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Ecole Nationale de l'Aviation Civile (ENAC), 2016-1-EL01-KA201-023731, Erasmus MC Vriendenfonds, RealityTech is supported by Region Aquitaine, Pole Aquinetic and Unitec. The Interactive Map Application for Visually Impaired People is conducted with the support of the Erasmus+ Program of the European Union Pr. no 2016-1-EL01-KA201-023731., and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: tabletop, Computer science, visual impairment, 02 engineering and technology, Multi-user, tangible interaction, Exhibition, Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], mapping, object tracking, open-source, scientific visualization, 050107 human factors, multi-user, education, Subtractive color, business.industry, 05 social sciences, Scientific visualization, Software development, Spatial Augmented Reality, Braille, [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], machine learning, child-computer interaction, [INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV], Video tracking, 020201 artificial intelligence & image processing, Augmented reality, business
Abstract: International audience; In this demonstration we showcase a new spatial augmented reality device (interactive projection) with three applications: education and experimentation of color models, map exploration for visually impaired people and scientific vulgarization of machine learning. The first exhibition is an interactive exploration about the nature of light. Visitors can experiment with additive subtractive color models. We engage them with questions, and they have to reply using cards to find out answers. This exhibit is suitable for children. The second exhibition is about map exploration and creation for Visually Impaired Persons (VIP). VIP generally use tactile maps with braille to learn about an unknown environment. However, these maps are not accessible to the 80% of VIP who don't read braille. Our prototype augments raised-line maps with audio output. The third exhibition is destined to be used for scientific outreach. It enables the creation of artificial neural networks (ANN) using tangible interfaces. Neurons are represented by laser-cut diamond shaped tokens, and the data to learn is printed on cards. The ANN learns to differentiate shapes, and the whole learning process is made visible and interactive. These three applications demonstrate the capabilities of our hardware and software development kit in different scenarios. At ReVo, each demonstration will have its own setup and interactive space.
Published: 2018
Full Text: View/download PDF

38. Émersions sensorielles

Author: Jérémy Frey, Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Frey, Jérémy, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: 05 social sciences, 0202 electrical engineering, electronic engineering, information engineering, 020207 software engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 02 engineering and technology, General Medicine, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors
Abstract: National audience; Nous avons pris l’habitude d’interagir avec les outils numériques via un clavier, une souris, ou bien encore une surface tactile. Notre corps peut pourtant s’exprimer sur une gamme autrement plus large. Dernièrement de nouveaux types d’interfaces ont vu le jour, qui utilisent l’activité cérébrale. Si cette technologie ne permet pas de miracles – comme nous le comprendrons après en avoir parcouru les arcanes – elle offre une autre façon de communiquer, avec la machine ou entre nous.
Published: 2016
Full Text: View/download PDF

39. Signal Processing Approaches to Minimize or Suppress Calibration Time in Oscillatory Activity-Based Brain–Computer Interfaces

Author: Fabien Lotte, Lotte, Fabien, Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: [INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing, Computer science, Calibration (statistics), 02 engineering and technology, Electroencephalography, Machine learning, computer.software_genre, Index Terms—Brain-Computer Interfaces (BCI), Regularization (mathematics), 03 medical and health sciences, 0302 clinical medicine, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [STAT.ML]Statistics [stat]/Machine Learning [stat.ML], 0202 electrical engineering, electronic engineering, information engineering, medicine, [INFO.INFO-BT]Computer Science [cs]/Biotechnology, Electrical and Electronic Engineering, signal processing, Brain–computer interface, Signal processing, Training set, medicine.diagnostic_test, business.industry, ElectroEncephaloGraphy (EEG), [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], calibration, [STAT.ML] Statistics [stat]/Machine Learning [stat.ML], small sample settings, machine learning, [INFO.INFO-BT] Computer Science [cs]/Biotechnology, A priori and a posteriori, Signal processing algorithms, 020201 artificial intelligence & image processing, Artificial intelligence, business, computer, 030217 neurology & neurosurgery
Abstract: International audience; One of the major limitations of Brain-Computer Interfaces (BCI) is their long calibration time, which limits their use in practice, both by patients and healthy users alike. Such long calibration times are due to the large between-user variability and thus to the need to collect numerous training electroencephalography (EEG) trials for the machine learning algorithms used in BCI design. In this paper, we first survey existing approaches to reduce or suppress calibration time, these approaches being notably based on regularization, user-to-user transfer, semi-supervised learning and a-priori physiological information. We then propose new tools to reduce BCI calibration time. In particular, we propose to generate artificial EEG trials from the few EEG trials initially available, in order to augment the training set size. These artificial EEG trials are obtained by relevant combinations and distortions of the original trials available. We propose 3 different methods to do so. We also propose a new, fast and simple approach to perform user-to-user transfer for BCI. Finally, we study and compare offline different approaches, both old and new ones, on the data of 50 users from 3 different BCI data sets. This enables us to identify guidelines about how to reduce or suppress calibration time for BCI.
Published: 2015
Full Text: View/download PDF

40. Using Recent BCI Literature to Deepen our Understanding of Clinical Neurofeedback: A Short Review

Author: Jean-Marie Batail, Pierre Philip, Fabien Lotte, Jean-Arthur Micoulaud Franchi, Camille Jeunet, Chair in Brain-Machine Interface [Geneva] (CNBI), Ecole Polytechnique Fédérale de Lausanne (EPFL), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Comportement et noyaux gris centraux = Behavior and Basal Ganglia [Rennes], Université de Rennes (UR)-Université européenne de Bretagne - European University of Brittany (UEB)-CHU Pontchaillou [Rennes]-Institut des Neurosciences Cliniques de Rennes = Institute of Clinical Neurosciences of Rennes (INCR), Sommeil, Addiction et Neuropsychiatrie [Bordeaux] (SANPSY), Université de Bordeaux (UB)-CHU de Bordeaux Pellegrin [Bordeaux]-Centre National de la Recherche Scientifique (CNRS), ANR-15-CE23-0013-01, Agence Nationale de la Recherche, ERC-2016-STG-714567, H2020 European Research Council, Swiss National Foundation, ANR-15-CE23-0013,REBEL,Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle(2015), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Université européenne de Bretagne - European University of Brittany (UEB)-CHU Pontchaillou [Rennes]-Institut des Neurosciences Cliniques de Rennes (INCR), and Sommeil, Attention et Neuropsychiatrie [Bordeaux] (SANPSY)
Subjects: Process (engineering), adaptation, 050105 experimental psychology, 03 medical and health sciences, 0302 clinical medicine, brain–computer interfaces, Humans, 0501 psychology and cognitive sciences, Relevance (information retrieval), EEG, Clinical efficacy, Adaptation (computer science), Brain–computer interface, training, Mental Disorders, General Neuroscience, 05 social sciences, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, Cognition, neurofeedback efficacy, Neurofeedback, cognitive profile, personality, Brain-Computer Interfaces, Psychology, 030217 neurology & neurosurgery, Cognitive psychology
Abstract: International audience; In their recent paper, Alkoby et al. (2017) provide the readership with an extensive and very insightful review of the factors influencing NeuroFeedback (NF) performance. These factors are drawn from both the NF literature and the Brain-Computer Interface (BCI) literature. Our short review aims to complement Alkoby et al.'s review by reporting recent additions to the BCI literature. The object of this paper is to highlight this literature and discuss its potential relevance and usefulness to better understand the processes underlying NF and further improve the design of clinical trials assessing NF efficacy. Indeed, we are convinced that while NF and BCI are fundamentally different in many ways, both the BCI and NF communities could reach compelling achievements by building upon one another. By reviewing the recent BCI literature, we identified three types of factors that influence BCI performance: task-specific, cognitive/motivational and technology-acceptance-related factors. Since BCIs and NF share a common goal (i.e., learning to modulate specific neurophysiological patterns), similar cognitive and neurophysiological processes are likely to be involved during the training process. Thus, the literature on BCI training may help (1) to deepen our understanding of neurofeedback training processes and (2) to understand the variables that influence the clinical efficacy of NF. This may help to properly assess and/or control the influence of these variables during randomized controlled trials.
Published: 2018
Full Text: View/download PDF

41. EEG neurofeedback research: A fertile ground for psychiatry?

Author: Lorraine Perronet, Thomas Fovet, Aurore Hakoun, François Cabestaing, C. Daudet, Jean-Arthur Micoulaud-Franchi, François Vialatte, Léa Pillette, Tomas Ros, Emmanuel Maby, Camille Jeunet, Mélanie Fouillen, Dominique Drapier, Jelena Mladenović, Jean-Marie Batail, Renaud Jardri, Stéphanie Bioulac, Jérémie Mattout, Fabien Lotte, Takfarinas Medani, Comportement et noyaux gris centraux = Behavior and Basal Ganglia [Rennes], Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Université européenne de Bretagne - European University of Brittany (UEB)-CHU Pontchaillou [Rennes]-Institut des Neurosciences Cliniques de Rennes (INCR), Sommeil, Attention et Neuropsychiatrie [Bordeaux] (SANPSY), Université de Bordeaux (UB)-CHU de Bordeaux Pellegrin [Bordeaux]-Centre National de la Recherche Scientifique (CNRS), Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189 (CRIStAL), Centrale Lille-Université de Lille-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Centre de recherche en neurosciences de Lyon (CRNL), Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Université Jean Monnet [Saint-Étienne] (UJM)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS), Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193 (SCALab), Université de Lille-Centre National de la Recherche Scientifique (CNRS), Laboratoire Plasticité du Cerveau Brain Plasticity (UMR 8249) (PdC), Ecole Superieure de Physique et de Chimie Industrielles de la Ville de Paris (ESPCI Paris), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Centre National de la Recherche Scientifique (CNRS), Ecole Polytechnique Fédérale de Lausanne (EPFL), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), 3D interaction with virtual environments using body and mind (Hybrid), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), University medical center and campus biotech Geneva, This work was supported by the French National Research Agency within the REBEL project (grant ANR-15-CE23-0013-01), the European Research Council with the Brain Conquest project (grant ERC-2016-STG-714567), the Inria Project-Lab BCI-Lift and the EPFL/Inria International Lab, BCI-Lift, EPFL-INRIA, ANR-15-CE23-0013,REBEL,Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle(2015), European Project: 714567 ,H2020 Pilier ERC,BrainConquest(2017), Université de Rennes (UR)-Université européenne de Bretagne - European University of Brittany (UEB)-CHU Pontchaillou [Rennes]-Institut des Neurosciences Cliniques de Rennes = Institute of Clinical Neurosciences of Rennes (INCR), Sommeil, Addiction et Neuropsychiatrie [Bordeaux] (SANPSY), Centre de recherche en neurosciences de Lyon - Lyon Neuroscience Research Center (CRNL), Université de Lyon-Université de Lyon-Université Jean Monnet - Saint-Étienne (UJM)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS), Laboratoire Sciences Cognitives et Sciences Affectives - UMR 9193 (SCALab), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), and Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique)
Subjects: medicine.medical_specialty, Neurophysiology, Electroencephalography, 03 medical and health sciences, 0302 clinical medicine, Arts and Humanities (miscellaneous), Neuroplasticity, medicine, Learning, Training, Humans, EEG, Psychiatry, Brain–computer interface, medicine.diagnostic_test, Cognitive Behavioral Therapy, Mental Disorders, Cognition, Neurofeedback, 3. Good health, 030227 psychiatry, ddc:616.8, Psychiatry and Mental health, Hebbian theory, Psychophysiology, [SDV.MHEP.PSM]Life Sciences [q-bio]/Human health and pathology/Psychiatrics and mental health, [SDV.NEU]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC], Psychology, Neurocognitive
Abstract: International audience; The clinical efficacy of neurofeedback is still a matter of debate. This paper analyzes the factors that should be taken into account in a transdisciplinary approach to evaluate the use of EEG NFB as a therapeutic tool in psychiatry. Neurofeedback is a neurocognitive therapy based on human–computer interaction that enables subjects to train voluntarily and modify functional biomarkers that are related to a defined mental disorder. We investigate three kinds of factors related to this definition of neurofeedback. We focus this article on EEG NFB. The first part of the paper investigates neurophysiological factors underlying the brain mechanisms driving NFB training and learning to modify a functional biomarker voluntarily. Two kinds of neuroplasticity involved in neurofeedback are analyzed Hebbian neuroplasticity, i.e. long-term modification of neural membrane excitability and/or synaptic potentiation, and homeostatic neuroplasticity, i.e. homeostasis attempts to stabilize network activity. The second part investigates psychophysiological factors related to the targeted biomarker. It is demonstrated that neurofeedback involves clearly defining which kind of relationship between EEG biomarkers and clinical dimensions (symptoms or cognitive processes) is to be targeted. A nomenclature of accurate EEG biomarkers is proposed in the form of a short EEG encyclopedia (EEGcopia). The third part investigates human–computer interaction factors for optimizing NFB training and learning during the closed loop interaction. A model is proposed to summarize the different features that should be controlled to optimize learning. The need for accurate and reliable metrics of training and learning in line with human–computer interaction is also emphasized, including targeted biomarkers and neuroplasticity. All these factors related to neurofeedback show that it can be considered as a fertile ground for innovative research in psychiatry.
Published: 2017
Full Text: View/download PDF

42. « Teegi, il est trop beau »: Exemple d'évaluation du potentiel pédagogique d'une interface tangible interactive pour enfants en contexte scolaire

Author: Thibault Lainé, Charlotte Baraudon, Stéphanie Fleck, Jérémy Frey, Martin Hachet, Psychologie Ergonomique et Sociale pour l'Expérience utilisateurs (PErSEUs), Université de Lorraine (UL), Canopé académie de Metz, Ullo, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), AFIHM, and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Relation (database), Process (engineering), Interface (Java), Computer science, Context (language use), Contexte scolaire, 02 engineering and technology, Evaluation de l’utilisabilité, Education, Child-Computer Interaction, Usability testing, Educational support, Human–computer interaction, Evaluation methods, ComputingMilieux_COMPUTERSANDEDUCATION, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Interaction enfant-machine, Tangible interface, School context, business.industry, 4. Education, 05 social sciences, 020207 software engineering, Usability, Educative potential, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI), Cerebral activity, Interface tangible, business, Potentiel pédagogique
Abstract: International audience; The cerebral activity is an intangible physiological process difficult to apprehend, especially for children. With the aim of providing a new type of educational support, we studied the pedagogical potential of an interactive tangible interface (Teegi) designed to be used in educational context. This interface aims at enabling children to discover the relation between the brain activity and the human body functions. We propose in this study a methodology to evaluate its pedagogical potential in real context of use, considering the specificities of the children. This study, carried out with 29 pupils, highlights the strengths of this system, both in terms of its usability and its impact on learning. Moreover, the results provided by this methodology revealed possible improvements for a greater pedagogical effectiveness. This type of interactive interface, as well as the evaluation method proposed, paves the way for the pedagogical use of new interactive and tangible devices at school.; L’activité cérébrale est un processus physiologique intangible qui peut être difficile à appréhender, notamment pour des enfants. Pour répondre aux besoins en supports pédagogiques et favoriser les apprentissages liés à ce type de concepts, nous étudions le potentiel d’une interface tangible interactive dédiée à la visualisation d’activités cérébrales (Teegi) en contexte éducatif. Nous proposons une méthodologie d’évaluation du potentiel pédagogique en contexte réel d’utilisation par des enfants. Cette étude réalisée avec 29 enfants, met en évidence les forces de ce système, tant au niveau de son utilisabilité que de ses impacts sur les apprentissages visés. Les résultats obtenus mettent en lumière des axes d’améliorations possibles pour une plus grande efficacité pédagogique. Ce type d’interface, ainsi que la méthode d’évaluation que nous proposons, ouvrent la voie de l’utilisation pédagogique de nouveaux dispositifs interactifs et tangibles en milieu scolaire.
Published: 2017
Full Text: View/download PDF

43. Inner Garden

Author: Joan Sol Roo, Martin Hachet, Renaud Gervais, Jérémy Frey, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB), ACM, ANR-14-CE24-0013,ISAR,Interaction en Réalité Augmentée Spatiale(2014), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: Mindfulness, media_common.quotation_subject, 02 engineering and technology, Virtual reality, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems, Calm Technologies, GeneralLiterature_MISCELLANEOUS, Session (web analytics), Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, Tangible Interaction, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Meditation, 050107 human factors, media_common, 05 social sciences, Virtual Reality, 020207 software engineering, Spatial Augmented Reality, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems/H.5.1.1: Artificial, augmented, and virtual realities, Mixed reality, Mixed Reality, Happiness, Curiosity, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Sandbox (software development), Psychology
Abstract: International audience; Digital technology has been completely integrated into our daily lives, yet the potential of technology to improve its users’ life satisfaction is still largely untapped. Mindfulness, the act of paying a deliberate and non-judgmental attention to the present moment, has been shown to have a positive impact on a person’s health and subjective well-being – commonly called “happiness”. Based on an iterative process with meditation teachers and practitioners, we designed a new tool to support mindfulness practices. This tool takes the shape of an augmented sandbox, designed to inspire the user’s self-motivation and curiosity. By shaping the sand, the user creates a living miniature world that is projected back onto the sand. The natural elements of the garden are connected to real-time physiological measurements, such as breathing, helping the user to stay focused on the body. Moreover, using a Virtual Reality headset, they can travel inside their garden for a dedicated meditation session. Preliminary results seem to indicate that the system is well suited for mindfulness and induces a calm and mindful state on the user. The meditation teachers envisioned the use of Inner Garden in their practice.
Published: 2017
Full Text: View/download PDF

44. Towards A Cognitive Model Of Mi-Bci User Training

Author: Camille Jeunet, Kaoua, Bernard N., Fabien Lotte, Jeunet, Camille, Interactions humain-machine, objets connectés, contenus numériques, données massives et connaissance - Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle - - REBEL2015 - ANR-15-CE23-0013 - AAPG2015 - VALID, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Handicap Activité Cognition Santé [Bordeaux] (HACS), Université de Bordeaux (UB)-Institut National de Recherche en Informatique et en Automatique (Inria)-CHU Bordeaux [Bordeaux]-Institut National de la Santé et de la Recherche Médicale (INSERM), Programming Language Technology For Communication Services (Phoenix), Handicap et système nerveux :Action, communication, interaction: rétablissement de la fonction et de la participation [Bordeaux] (EA4136), UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2]-UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2]-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), ANR-15-CE23-0013,REBEL,Redéfinir les Interfaces Cerveau-Ordinateur pour permettre à leurs utilisateurs d'en maitriser le contrôle(2015), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Handicap et système nerveux :Action, communication, interaction: rétablissement de la fonction et de la participation [Bordeaux] (EA4136), and UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2]-UFR Sciences médicales 3 [Bordeaux]-Université de Bordeaux Ségalen [Bordeaux 2]
Subjects: training, Brain-Computer Interfaces, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, cognitive model, [SDV.NEU.SC] Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences
Abstract: International audience; Mental-Imagery based Brain-Computer Interfaces (MI-BCIs) enable users to control applications using their brain activity alone, by realising mental-imagery tasks. Although promising, MI-BCIs remain barely used outside laboratories, notably due to the difficulties users encounter when attempting to control them. We claim that understanding and improving the user-training process could greatly improve users' MI-BCI control abilities. Yet, to better understand the training process, we need a model of the factors impacting MI-BCI performance. In other words, we need to understand which traits and states impact MI-BCI performance, how these factors interact and how to influence them to improve this performance. Such a model would enable us to design adapted and adaptive training protocols, to guide neurophysiological analyses or design informed classi-fiers, among others. In this paper we propose a theoretical model of MI-BCI tasks, which is the first step towards the design of this full cognitive and computational model.
Published: 2017
Full Text: View/download PDF

45. The Impact of Flow in an EEG-based Brain Computer Interface

Author: Jelena Mladenović, Jérémy Frey, Manon Bonnet-Save, Jérémie Mattout, Fabien Lotte, Centre de recherche en neurosciences de Lyon (CRNL), Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-Université de Lyon-Université Jean Monnet [Saint-Étienne] (UJM)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Ullo, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Centre de recherche en neurosciences de Lyon - Lyon Neuroscience Research Center (CRNL), Université de Lyon-Université de Lyon-Université Jean Monnet - Saint-Étienne (UJM)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), and Mladenovic, Jelena
Subjects: FOS: Computer and information sciences, Flow, Computer Science - Human-Computer Interaction, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, [SCCO.COMP]Cognitive science/Computer science, [INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG], Brain - Computer Interfaces, Human-Computer Interaction (cs.HC), [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [SCCO.COMP] Cognitive science/Computer science, Quantitative Biology - Neurons and Cognition, FOS: Biological sciences, Adaptive Methods, [SDV.NEU]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC], Neurons and Cognition (q-bio.NC), [SDV.NEU] Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC], Motor Imagery, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], [SDV.NEU.SC] Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, Music
Abstract: International audience; Major issues in Brain Computer Interfaces (BCIs) include low usability and poor user performance. This paper tackles them by ensuring the users to be in a state of immersion, control and motivation, called state of flow. Indeed, in various disciplines, being in the state of flow was shown to improve performances and learning. Hence, we intended to draw BCI users in a flow state to improve both their subjective experience and their performances. In a Motor Imagery BCI game, we manipulated flow in two ways: 1) by adapting the task difficulty and 2) by using background music. Results showed that the difficulty adaptation induced a higher flow state, however music had no effect. There was a positive correlation between subjective flow scores and offline performance, although the flow factors had no effect (adaptation) or negative effect (music) on online performance. Overall, favouring the flow state seems a promising approach for enhancing users’ satisfaction, although its complexity requires more thorough investigations.
Published: 2017
Full Text: View/download PDF

46. Recreational Applications of OpenViBE: Brain Invaders and Use-the-Force

Author: Alexandre Barachant, Anton Andreev, Fabien Lotte, Marco Congedo, GIPSA - Vision and Brain Signal Processing (GIPSA-VIBS), Département Images et Signal (GIPSA-DIS), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), GIPSA-Services (GIPSA-Services), Weill Medical College of Cornell University [New York], Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Maureen Clerc, Laurent Bougrai, Fabien Lotte, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), and Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest
Subjects: OpenVibe, business.industry, Computer science, [SCCO.NEUR]Cognitive science/Neuroscience, 0206 medical engineering, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, Use-The-Force, 020601 biomedical engineering, 030218 nuclear medicine & medical imaging, OpenViBE, 03 medical and health sciences, Brain Invaders, 0302 clinical medicine, Human–computer interaction, Artificial intelligence, P300, BCI, business, Recreation, ERP, Brain–computer interface
Abstract: International audience; This chapter aims at providing the reader with two examples of open-source BCI-games that work with the OpenViBE platform. These two games are “Brain Invaders” and “Use-The-Force!” and are representative examples of two types of BCI: ERP-based BCI and oscillatory activity-based BCI. This chapter presents the principle, design and evaluation of these games, as well as how they are implemented in practice within OpenViBE. This aims at providing the interested readers with a practical basis to design their own BCI-based games.
Published: 2016
Full Text: View/download PDF

47. Why standard brain-computer interface (BCI) training protocols should be changed: an experimental study

Author: Emilie Jahanpour, Camille Jeunet, Fabien Lotte, Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)
Subjects: Adult, Male, spatial abilities, Computer science, Spatial ability, Biomedical Engineering, training protocols, Context (language use), Spatial memory, 050105 experimental psychology, Mental rotation, 03 medical and health sciences, Cellular and Molecular Neuroscience, Young Adult, 0302 clinical medicine, Human–computer interaction, Humans, Learning, 0501 psychology and cognitive sciences, Motor skill, Reliability (statistics), Brain–computer interface, Protocol (science), business.industry, 05 social sciences, [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences, Reproducibility of Results, Electroencephalography, Signal Processing, Computer-Assisted, Brain Computer Interface BCI, Motor Skills, Brain-Computer Interfaces, Space Perception, Imagination, Female, Artificial intelligence, business, 030217 neurology & neurosurgery, performance, Algorithms, Psychomotor Performance, mental rotation, Spatial Navigation
Abstract: International audience; Objective While promising, ElectroEncephaloGraphy based Brain-Computer Interfaces (BCIs) remain barely used due to their lack of reliability: 15% to 30% of users are unable to control a BCI. Standard training protocols may be partly responsible as they do not satisfy recommendations from psychology. Our main objective was to determine in practice to what extent standard training protocols impact users' Motor-Imagery based BCI (MI-BCI) control performance. Approach We performed two experiments. The first consisted in evaluating a standard BCI training protocol efficiency for the acquisition of non-BCI related skills in a BCI-free context, which enabled to rule out the possible impact of BCIs on the training outcome. Thus, participants (N=54) were asked to perform simple motor-tasks. The second experiment aimed at measuring the correlations between motor-task and MI-BCI performances. The 10 best and 10 worst performers of the first study were recruited for an MI-BCI experiment during which they had to learn to perform 2 MI-tasks. We also assessed users' spatial abilities and pre-training mu rhythm amplitude, as both have been related to MI-BCI performance in the literature. Main Results Around 17% of the participants were unable to learn to perform the motor-tasks, which is close to the BCI-illiteracy rate. It suggests that standard training protocols are suboptimal for skill-teaching. No correlation was found between motor-task and MI-BCI performance. However, spatial abilities played an important role in MI-BCI performance. Besides, once the " spatial ability" covariable had been controlled for, using an ANCOVA, it appeared that participants who faced difficulty during the first experiment improved during the second while the others did not. Significance These studies suggest that 1) standard MI-BCI training protocols are suboptimal for skill-teaching, 2) spatial abilities are confirmed to impact MI-BCI performances and 3) when faced with difficult pre-training, subjects seem to explore more strategies and therefore learn better.
Published: 2016

48. Remote Heart Rate Sensing and Projection to Renew Traditional Board Games and Foster Social Interactions

Author: Jérémy Frey, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, and Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)
Subjects: Mass market, Computer science, Board Games, 05 social sciences, Computer Science - Human-Computer Interaction, ACM: H.: Information Systems/H.1: MODELS AND PRINCIPLES/H.1.2: User/Machine Systems/H.1.2.1: Human information processing, 020207 software engineering, 02 engineering and technology, Spatial Augmented Reality, ACM: H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems/H.5.1.1: Artificial, augmented, and virtual realities, Incentive, Heart Rate, Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Social Presence, Projection (set theory), Physiological Computing, 050107 human factors
Abstract: International audience; While physiological sensors enter the mass market and reach the general public, they are still mainly employed to monitor health – whether it is for medical purpose or sports. We describe an application that uses heart rate feedback as an incentive for social interactions. A traditional board game has been "augmented" through remote physiological sensing, using webcams. Projection helped to conceal the technological aspects from users. We detail how players reacted – stressful situations could emerge when users are deprived from their own signals – and we give directions for game designers to integrate physiological sensors.
Published: 2016
Full Text: View/download PDF

49. 3D collaborative interaction for aerospace industry

Author: François Guillaume, Pascal Guitton, Damien Clergeaud, Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Airbus Group Innovations [Suresnes], Airbus [France], Accord cadre Inria - Airbus Group, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, and Guitton, Pascal
Subjects: Computer science, [INFO.INFO-GR] Computer Science [cs]/Graphics [cs.GR], Collaborative Interaction, 02 engineering and technology, Virtual reality, computer.software_genre, 0203 mechanical engineering, Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, Software system, Aerospace, 020301 aerospace & aeronautics, Measure (data warehouse), business.industry, Virtual Reality, 020207 software engineering, Subject (documents), Awareness, Work in process, [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR], Engineering management, Remote Interaction, Virtual machine, Collaborative interaction, business, computer
Abstract: 3D collaborative interaction raises issues like awareness of the Virtual Environment that have been well known for some time. They have been the subject of research activities that have led to some interesting results described in the literature. Unfortunately, most of these results have not yet been not implemented in the software systems daily used by industry and remains only theoretical concepts. That is why we recently started a project to transfer some of these results in the aerospace industry for the Airbus Group. Beyond this first transfer target, we also intend to measure the real gains (in real industrial conditions) for the users, and then for the company. This second goal is essential because in most publications, user testing is not satisfying (lack of real users, lack of real procedures, non significant number of subjects). In this paper, we describe the first step of this work in progress and more precisely, the basic interaction features we have developed. Currently, we are designing the first user tests.
Published: 2016
Full Text: View/download PDF

50. Exploring two novel features for EEG-based brain–computer interfaces: Multifractal cumulants and predictive complexity

Author: Nicolas Brodu, Anatole Lécuyer, Fabien Lotte, Lotte, Fabien, Laboratoire Traitement du Signal et de l'Image (LTSI), Université de Rennes (UR)-Institut National de la Santé et de la Recherche Médicale (INSERM), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Virtual Reality for Improved Innovative Immersive Interaction (VR4I), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-École normale supérieure - Cachan (ENS Cachan)-Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria), Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National de la Santé et de la Recherche Médicale (INSERM), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), and Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-École normale supérieure - Cachan (ENS Cachan)-Inria Rennes – Bretagne Atlantique
Subjects: [INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing, Computer science, Cognitive Neuroscience, Speech recognition, 0206 medical engineering, Feature extraction, FOS: Physical sciences, 02 engineering and technology, Electroencephalography, Field (computer science), [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, Artificial Intelligence, 0202 electrical engineering, electronic engineering, information engineering, medicine, Cumulant, [SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processing, Brain–computer interface, medicine.diagnostic_test, business.industry, SIGNAL (programming language), Probability and statistics, Pattern recognition, Multifractal system, 020601 biomedical engineering, Computer Science Applications, [NLIN.NLIN-CD] Nonlinear Sciences [physics]/Chaotic Dynamics [nlin.CD], Feature (computer vision), Quantitative Biology - Neurons and Cognition, Physics - Data Analysis, Statistics and Probability, FOS: Biological sciences, [NLIN.NLIN-CD]Nonlinear Sciences [physics]/Chaotic Dynamics [nlin.CD], Neurons and Cognition (q-bio.NC), 020201 artificial intelligence & image processing, Artificial intelligence, business, [SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing, Data Analysis, Statistics and Probability (physics.data-an)
Abstract: In this paper, we introduce two new features for the design of electroencephalography (EEG) based Brain-Computer Interfaces (BCI): one feature based on multifractal cumulants, and one feature based on the predictive complexity of the EEG time series. The multifractal cumulants feature measures the signal regularity, while the predictive complexity measures the difficulty to predict the future of the signal based on its past, hence a degree of how complex it is. We have conducted an evaluation of the performance of these two novel features on EEG data corresponding to motor-imagery. We also compared them to the most successful features used in the BCI field, namely the Band-Power features. We evaluated these three kinds of features and their combinations on EEG signals from 13 subjects. Results obtained show that our novel features can lead to BCI designs with improved classification performance, notably when using and combining the three kinds of feature (band-power, multifractal cumulants, predictive complexity) together., Comment: Updated with more subjects. Separated out the band-power comparisons in a companion article after reviewer feedback. Source code and companion article are available at http://nicolas.brodu.numerimoire.net/en/recherche/publications
Published: 2012
Full Text: View/download PDF

Catalog

Books, media, physical & digital resources

See catalog results

Searchworks

Select search scope, currently: Articles Catalog books, media & more in Jio Institute collections Articles journal articles & other e-resources

Search

Search Constraints

Refine your results

Search Limiters

Topic

Publication Year Range

Journal

Database

Publisher

85 results on '"Popular interaction with 3d content (Potioc)"'

Search Results

Catalog

Select search scope, currently: Articles

Catalog

books, media & more in Jio Institute collections

Articles

journal articles & other e-resources