Back to Search Start Over

A Portable Hong Kong Sign Language Translation Platform with Deep Learning and Jetson Nano.

Authors :
Zhou, Zhenxing
Neo, Yisiang
Lui, King-Shan
Tam, Vincent W.L.
Lam, Edmund Y.
Wong, Ngai
Source :
ACM SIGACCESS Conference on Computers & Accessibility; 2020, Issue 22, p1-4, 4p
Publication Year :
2020

Abstract

As hearing loss is arousing more and more public concern, different researches have been conducted on translating the sign language into spoken language. However, most of these researches remain in a theoretical level and few of them investigate how to realize a real system. In this paper, we introduce an effective and portable Hong Kong sign language recognition platform which can translate the Hong Kong sign language within a few seconds. In this platform, there are mainly two parts: a mobile application and a Jetson Nano. The mobile application accounts for preprocessing the sign video and transferring the videos to Jetson Nano. Then, Jetson Nano will translate sign videos into spoken language with the pretrained deep learning model and return the results to the mobile application. With this platform, non-disabled people can easily translate and understand the sign performed by deaf people through mobile phones quickly. We believe that this platform can significantly facilitate the daily communication between deaf people and the others in Hong Kong. [ABSTRACT FROM AUTHOR]

Details

Language :
English
Issue :
22
Database :
Complementary Index
Journal :
ACM SIGACCESS Conference on Computers & Accessibility
Publication Type :
Conference
Accession number :
152813093
Full Text :
https://doi.org/10.1145/3373625.3418046