Back to Search Start Over

Tashkeela: Novel corpus of Arabic vocalized texts, data for auto-diacritization systems.

Authors :
Zerrouki T
Balla A
Source :
Data in brief [Data Brief] 2017 Feb 03; Vol. 11, pp. 147-151. Date of Electronic Publication: 2017 Feb 03 (Print Publication: 2017).
Publication Year :
2017

Abstract

Arabic diacritics are often missed in Arabic scripts. This feature is a handicap for new learner to read ŮŽArabic, text to speech conversion systems, reading and semantic analysis of Arabic texts. The automatic diacritization systems are the best solution to handle this issue. But such automation needs resources as diactritized texts to train and evaluate such systems. In this paper, we describe our corpus of Arabic diacritized texts. This corpus is called Tashkeela. It can be used as a linguistic resource tool for natural language processing such as automatic diacritics systems, dis-ambiguity mechanism, features and data extraction. The corpus is freely available, it contains 75 million of fully vocalized words mainly 97 books from classical and modern Arabic language. The corpus is collected from manually vocalized texts using web crawling process.

Details

Language :
English
ISSN :
2352-3409
Volume :
11
Database :
MEDLINE
Journal :
Data in brief
Publication Type :
Academic Journal
Accession number :
28224131
Full Text :
https://doi.org/10.1016/j.dib.2017.01.011