Search

In recent years, the use of nontraditional data sources in statistical production has been increasing, given the additional need for more timely and disaggregated data. In the scope of nontraditional sources, citizen science represents an innovative approach to filling data gaps and including citizens as part of the recent innovation processes of national statistical offices (NSOs) in both the production of statistics and its role as data stewards of the national statistical systems (NSSs). The National Statistical Office of Colombia (DANE, acronym in Spanish) has structured a project within the framework of the Data4Now initiative for Sustainable Development Goal (SDG) indicators from SDG 16, using social networks as an alternative source of data generated by citizens, and natural language processing (NLP) to extract actionable intelligence from this data. In this paper, we describe the proposed strategy followed by DANE to estimate SDG indicators 16.b.1 and 16.7.2 as a pilot exercise in the framework of experimental statistics. Preliminary results illustrate potential use cases of unconventional information streams to analyze social phenomena through virtual environments such as online social media, and raise compelling challenges regarding representativity and quality assurance based on the statistical standards used by NSOs. [ABSTRACT FROM AUTHOR]

Sentiment analysis is a natural language processing task that has received increased attention in the last decade due to the vast amount of opinionated data on social media platforms such as Twitter. Although the methodologies employed have grown in number and sophistication, analysing irony and sarcasm still poses a severe problem. From the linguistic perspective, sarcasm has been studied in discourse analysis from several perspectives, but little attention has been given to specific metrics that measure its relevance. In this paper we describe the creation of a manually-annotated dataset where detailed text markers are included. This dataset is a sample from a larger corpus of tweets (n= 76,764) on two highly controversial films: Cats and Star Wars: The Rise of Skywalker. We took two different samples for each film, one before and one after their release, to compare reception and presence of sarcasm. We then used a sentiment analysis tool to measure the impact of sarcasm in polarity detection and then manually classified the mechanisms of sarcasm generation. The resulting corpus will be useful for machine learning approaches to sarcasm detection as well as discourse analysis studies on irony and sarcasm. [ABSTRACT FROM AUTHOR]

Traffic accident detection is an important strategy governments can use to implement policies intended to reduce accidents. They usually use techniques such as image processing, RFID devices, among others. Social network mining has emerged as a low-cost alternative. However, social networks come with several challenges such as informal language and misspellings. This paper proposes a method to extract traffic accident data from Twitter in Spanish. The method consists of four phases. The first phase establishes the data collection mechanisms. The second consists of vectorially representing the messages and classifying them as accidents or non-accidents. The third phase uses named entity recognition techniques to detect the location. In the fourth phase, locations pass through a geocoder that returns their geographic coordinates. This method was applied to Bogota city and the data on Twitter were compared with the official traffic information source; comparisons showed some influence of Twitter on the commercial and industrial area of the city. The results reveal how effective the information on accidents reported on Twitter can be. It should therefore be considered as a source of information that may complement existing detection methods. [ABSTRACT FROM AUTHOR]