Back to Search Start Over

BdSL47: A complete depth-based Bangla sign alphabet and digit dataset

Authors :
S M Rayeed
Sidratul Tamzida Tuba
Hasan Mahmud
Mumtahin Habib Ullah Mazumder, Md.
Saddam Hossain Mukta, Md.
Kamrul Hasan, Md.
Source :
Data in Brief, Vol 51, Iss , Pp 109799- (2023)
Publication Year :
2023
Publisher :
Elsevier, 2023.

Abstract

Sign Language Recognition (SLR) is crucial for enabling communication between the deaf-mute and hearing communities. Nevertheless, the development of a comprehensive sign language dataset is a challenging task due to the complexity and variations in hand gestures. This challenge is particularly evident in the case of Bangla Sign Language (BdSL), where the limited availability of depth datasets impedes accurate recognition. To address this issue, we propose BdSL47, an open-access depth dataset for 47 one-handed static signs (10 digits, from ০ to ৯; and 37 letters, from অ to ँ) of BdSL. The dataset was created using the MediaPipe framework for extracting depth information. To classify the signs, we developed an Artificial Neural Network (ANN) model with a 63-node input layer, a 47-node output layer, and 4 hidden layers that included dropout in the last two hidden layers, an Adam optimizer, and a ReLU activation function. Based on the selected hyperparameters, the proposed ANN model effectively learns the spatial relationships and patterns from the depth-based gestural input features and gives an F1 score of 97.84 %, indicating the effectiveness of the approach compared to the baselines provided. The availability of BdSL47 as a comprehensive dataset can have an impact on improving the accuracy of SLR for BdSL using more advanced deep-learning models.

Details

Language :
English
ISSN :
23523409
Volume :
51
Issue :
109799-
Database :
Directory of Open Access Journals
Journal :
Data in Brief
Publication Type :
Academic Journal
Accession number :
edsdoj.65d70e14e0a743c296c6858a544ff642
Document Type :
article
Full Text :
https://doi.org/10.1016/j.dib.2023.109799