1. Hand Gesture Recognition Based on Active Ultrasonic Sensing of Smartphone: A Survey
- Author
-
Chengming Zhang, Yinjing Guo, Wenwen Dou, Zehua Huang, Yushan Hou, Kangkang Jiang, and Zhengjie Wang
- Subjects
Ubiquitous computing ,General Computer Science ,Computer science ,business.industry ,010401 analytical chemistry ,Feature extraction ,ultrasonic signal ,General Engineering ,020206 networking & telecommunications ,02 engineering and technology ,smartphone ,Doppler effect ,01 natural sciences ,Signal ,hand gesture recognition ,0104 chemical sciences ,Gesture recognition ,0202 electrical engineering, electronic engineering, information engineering ,General Materials Science ,Computer vision ,lcsh:Electrical engineering. Electronics. Nuclear engineering ,Artificial intelligence ,business ,lcsh:TK1-9971 ,Gesture - Abstract
With the rapid development of Internet of Things, hand gesture recognition has drawn wide attention in the field of ubiquitous computing because it provides us with simple and natural human-computer interaction mode. Among these various implementations, hand gesture recognition using ultrasonic signals of smartphone has become a hot research topic due to its various advantages. In this paper, we consider the smartphone as an active sonar sensing system to identify hand movements. Specifically, the speakers emit ultrasonic signal and the microphone on the same phone receives the changed echo affected by hand movements. This paper investigates the state-of-the-art hand gesture applications and presents a comprehensive survey on the characteristics of studies using the active sonar sensing system. Firstly, we review the existing research of hand gesture recognition based on acoustic signals. After that, we introduce the characteristics of ultrasonic signal and describe the fundamental principle of hand gesture recognition. Then, we focus on the typical methods used in these studies and present a detailed analysis on signal generation, feature extraction, preprocessing, and recognition methods. Next, we investigate the state-of-the-art ultrasonic-based applications of hand gesture recognition using smartphone and analyze them in detail from dynamic gesture recognition and hand tracking. Afterwards, we make a discussion about these systems from signal acquisition, signal processing, and performance evaluation to obtain some insight into development of the ultrasonic hand gesture recognition system. Finally, we conclude by discussing the challenges, insight, and open issues involved in hand gesture recognition based on ultrasonic signal of the smartphone.
- Published
- 2019