Back to Search Start Over

Regionalized models for Spanish language variations based on Twitter.

Authors :
Tellez, Eric S.
Moctezuma, Daniela
Miranda, Sabino
Graff, Mario
Ruiz, Guillermo
Source :
Language Resources & Evaluation. Dec2023, Vol. 57 Issue 4, p1697-1727. 31p.
Publication Year :
2023

Abstract

Spanish is one of the most spoken languages in the world. Its proliferation comes with variations in written and spoken communication among different regions. Understanding language variations can help improve model performances on regional tasks, such as those involving figurative language and local context information. This manuscript presents and describes a set of regionalized resources for the Spanish language built on 4-year Twitter public messages geotagged in 26 Spanish-speaking countries. We introduce word embeddings based on FastText, language models based on BERT, and per-region sample corpora. We also provide a broad comparison among regions covering lexical and semantical similarities and examples of using regional resources on message classification tasks. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
1574020X
Volume :
57
Issue :
4
Database :
Academic Search Index
Journal :
Language Resources & Evaluation
Publication Type :
Academic Journal
Accession number :
173723394
Full Text :
https://doi.org/10.1007/s10579-023-09640-9