Search

Music has long been used to strengthen bonds between humans. In our research, we develop musical coplayer robots with the hope that music may improve human-robot symbiosis as well. In this paper, we underline the importance of non-verbal, visual communication for ensemble synchronization at the start, during and end of a piece. We propose three cues for interplayer communication, and present a thereminplaying, singing robot that can detect them and adapt its play to a human flutist. Experiments with two naive flutists suggest that the system can recognize naturally occurring flutist gestures without requiring specialized user training. In addition, we show how the use of audio-visual aggregation can allow a robot to adapt to tempo changes quickly. [ABSTRACT FROM AUTHOR]

SDR-4X II is the latest prototype model of a small biped entertainment robot. It is the improved model of SDR-4X. In this paper we report on the sensing system of this robot, which is important and essential for a small biped entertainment robot which will be used in the home environment. One technology is the design of the motion sensing system, i.e. the inclination sensor system and the force sensor system which obtains the inclination of the trunk and the foot with force. Another technology is the real-world sensing system. One aspect is the touch sensing system. The robot is used in a normal home environment, so we should strongly consider the safety aspects for human. Another is the vision sensor system. The configuration and the distance image acquisition are explained. Next is the audio sensor system which obtains the sound and the voice information. The hardware system and the direction recognition are explained. These sensing systems are the key to making the biped robot walking and dynamic motion highly stable, and understanding the real-world around the robot. [ABSTRACT FROM AUTHOR]