1. SIGVerse: A Cloud-Based VR Platform for Research on Multimodal Human-Robot Interaction
- Author
-
Tetsunari Inamura and Yoshiaki Mizuchi
- Subjects
Computer science ,dataset of interaction ,Cloud computing ,02 engineering and technology ,Virtual reality ,Human–robot interaction ,Artificial Intelligence ,Human–computer interaction ,0202 electrical engineering, electronic engineering, information engineering ,TJ1-1570 ,Mechanical engineering and machinery ,software platform ,Avatar ,Original Research ,Robotics and AI ,social and embodied intelligence ,business.industry ,Natural user interface ,robot competition ,020207 software engineering ,QA75.5-76.95 ,Computer Science Applications ,Visualization ,Cost reduction ,Electronic computers. Computer science ,Robot ,virtual reality ,020201 artificial intelligence & image processing ,business - Abstract
Research on Human-Robot Interaction (HRI) requires the substantial consideration of an experimental design, as well as a significant amount of time to practice the subject experiment. Recent technology in virtual reality (VR) can potentially address these time and effort challenges. The significant advantages of VR systems for HRI are: 1) cost reduction, as experimental facilities are not required in a real environment; 2) provision of the same environmental and embodied interaction conditions to test subjects; 3) visualization of arbitrary information and situations that cannot occur in reality, such as playback of past experiences, and 4) ease of access to an immersive and natural interface for robot/avatar teleoperations. Although VR tools with their features have been applied and developed in previous HRI research, all-encompassing tools or frameworks remain unavailable. In particular, the benefits of integration with cloud computing have not been comprehensively considered. Hence, the purpose of this study is to propose a research platform that can comprehensively provide the elements required for HRI research by integrating VR and cloud technologies. To realize a flexible and reusable system, we developed a real-time bridging mechanism between the robot operating system (ROS) and Unity. To confirm the feasibility of the system in a practical HRI scenario, we applied the proposed system to three case studies, including a robot competition named RoboCup@Home. via these case studies, we validated the system’s usefulness and its potential for the development and evaluation of social intelligence via multimodal HRI.
- Published
- 2021