Back to Search Start Over

Development of the Lifelike Head Unit for a Humanoid Cybernetic Avatar `Yui' and Its Operation Interface

Authors :
Nakajima, Mizuki
Shinkawa, Kaoruko
Nakata, Yoshihiro
Source :
IEEE Access, vol. 12, pp.23930 -- 23942, 2024
Publication Year :
2023

Abstract

In the context of avatar-mediated communication, it is crucial for the face-to-face interlocutor to sense the operator's presence and emotions via the avatar. Although androids resembling humans have been developed to convey presence through appearance and movement, few studies have prioritized deepening the communication experience for both operator and interlocutor using android robot as an avatar. Addressing this gap, we introduce the ``Cybernetic Avatar `Yui','' featuring a human-like head unit with 28 degrees of freedom, capable of expressing gaze, facial emotions, and speech-related mouth movements. Through an eye-tracking unit in a Head-Mounted Display (HMD) and degrees of freedom on both eyes of Yui, operators can control the avatar's gaze naturally. Additionally, microphones embedded in Yui's ears allow operators to hear surrounding sounds in three dimensions, enabling them to discern the direction of calls based solely on auditory information. An HMD's face-tracking unit synchronizes the avatar's facial movements with those of the operator. This immersive interface, coupled with Yui's human-like appearance, enables real-time emotion transmission and communication, enhancing the sense of presence for both parties. Our experiments demonstrate Yui's facial expression capabilities, and validate the system's efficacy through teleoperation trials, suggesting potential advancements in avatar technology.<br />Comment: 13pages, 19 figures

Subjects

Subjects :
Computer Science - Robotics

Details

Database :
arXiv
Journal :
IEEE Access, vol. 12, pp.23930 -- 23942, 2024
Publication Type :
Report
Accession number :
edsarx.2312.06310
Document Type :
Working Paper
Full Text :
https://doi.org/10.1109/ACCESS.2024.3365723