Search

In recent years, Aspect-based Sentiment Analysis (ABSA) has been a crucial yet challenging task in recognizing textual emotions from text. ABSA has numerous application across various fields, such as social media, commodity review, and movie comment, making it an attractive area of research. Many researchers are working to develop more powerful sentiment analysis models. Currently, most existing ABSA models use the generic pre-trained language models (PLMs) based fine-tuning paradigm, which only utilizes the encoder parameters while discarding the decoder parameters of PLMs. However, this approach fails to leverage the prior knowledge revealed in PLMs effectively. To address these issues, we investigate the potential of the initial pre-training scheme of PLMs to conduct ABSA and thus propose a novel approach in this paper, namely Target Word Transferred ABSA (WordTransABSA). In WordTransABSA, we propose "Word Transferred LM", a novel sequence-level optimization strategy that transferred target words in sentence into pivot tokens to stimulate better PLM semantic understanding capability. Given a sentence with aspect terms as input, WordTransABSA generates contextually appropriate semantics and predicts the affective tokens on the corresponding positions of the aspect terms. The final sentiment polarity of each aspect term is determined through several sentiment identification strategies that we selected. WordTransABSA takes full advantage of the versatile linguistic knowledge of Pre-trained Language Model, resulting in competitive accuracy compared with recent baselines. The WordTransABSA demonstrates its superiority and effectiveness through extensive experiments in both data-sufficient (full-data supervised learning) and data-insufficient (few-shot learning) scenarios. We have made our code publicly available on GitHub: https://github.com/albert-jin/WordTransABSA. • We present WordTransABSA, introducing a "Word Transferred LM" strategy for ABSA. • Various strategies are explored for searching sentiment-related pivot tokens. • Data-sufficient/scarce experiments validate the effectiveness of WordTransABSA. • Stimulating PLM pre-training paradigm is proved to be a better solution for ABSA. [ABSTRACT FROM AUTHOR]

The study of Online Social Networks offers growing opportunities to examine a number of aspects of the real world and to better understand how human society works at scale. One crucial research direction, constantly evolving over time, concerns the language adopted by users and its impact on online communities. To provide a contribution in this setting, in this paper, we adopt a multi-relational model for social network and identify a new typology of relation, namely co-interest, as an explicit common declaration of engagement towards a given topic among pair of users. Thematic communities can be, hence, derived leveraging such relations. After that, exploiting Natural Language Processing and Machine Learning techniques, we identify and define suitable analysis metrics focusing on the characteristics of the language adopted in such communities. With the objective of analyzing how the adoption of different language may impact the formation of cohesive and strong communities, to make our study general, we consider two very popular and intrinsically different social platforms, namely Twitter and Reddit. The analysis carried out in this paper aims at comparing the two social media to find interesting and novel results about how their users compose textual comments and the corresponding impact on users' interaction. Interestingly, the obtained results show that, although the main factor is related to the popularity of the user generating the content, the characteristics of the adopted language play a non negligible role in the formation of strong communities in social systems. • Investigation about language characteristics of Online Social Networks posts (OSN). • Language analysis to identify the evolution dynamics of online communities. • Correlation between potential post engagement and user adopted language style. • Relationship between the content produced in OSNs and the formation of communities. [ABSTRACT FROM AUTHOR]

During the COVID-19 pandemic, online social media platforms such as Twitter facilitate the exchange of information among people. However, the prevalence of "infodemic" such as online hate speech has exacerbated social rifts, discrimination, prejudice and even hate crimes. Timely and effective detection of the hate speech will help create a healthy public opinion environment. Most of the current COVID-19-related hate speech research focuses on a single language, such as English. In this paper, we introduce a cross-lingual transfer learning method, aiming to contribute to hate speech detection in low-resource languages. We propose a deep learning based model to classify hate speech with a pre-trained language model for multilingual text embedding. Data augmentation and cross-lingual contrastive learning are then utilized to further improve the performance of cross-lingual knowledge transfer. To evaluate our method, we collected three publicly available annotated COVID-19-related hate speech datasets on Twitter, i.e., two in English and one in German. Furthermore, a Chinese dataset based on Weibo is constructed to expand multilingual data. The experimental results across three languages illustrate the effectiveness of our method for cross-lingual hate speech detection. Test F1-scores of our method for English, Chinese, German as transfer target languages can reach up to 0.728, 0.799 and 0.612 respectively, which are on average better than other baselines. • Suggested a cross-lingual COVID-19-related hate speech detection problem. • Introduced cross-lingual contrastive learning. • Validated model performance on datasets in three languages. [ABSTRACT FROM AUTHOR]

Regret is a universal emotion that arises from sadness, disappointment, or remorse about something that has occurred or that one has done or failed to do in the past. It typically involves wishing that a different decision had been made or that a different action had been taken. Although regret has been studied in various contexts such as psychology, neuroscience, and philosophy, its expression and analysis on social media using natural language processing techniques is a relatively recent research topic that warrants further investigation. In this paper, we present a study of regret and its expression on social media platforms. Specifically, we present a novel dataset of Reddit texts that have been classified into three classes: Regret by Action, Regret by Inaction, and No Regret. We then use this dataset to investigate the language used to express regret on Reddit and to identify the domains of text that are most commonly associated with regret. Our findings show that Reddit users are most likely to express regret for past actions, particularly in the domain of relationships. We also found that deep learning models using GloVe embedding outperformed other models in all experiments, indicating the effectiveness of GloVe for representing the meaning and context of words in the domain of regret. Overall, our study provides valuable insights into the nature and prevalence of regret on social media, as well as the potential of deep learning and word embeddings for analyzing and understanding emotional language in online text. These findings have implications for the development of natural language processing algorithms and the design of social media platforms that support emotional expression and communication. • Regret is an emotion that has a significant impact on behavior and decision-making. • Regret is often triggered by actions or inactions in the past. • Reddit's users often regret their actions about relationships in the past. • Effectiveness of GloVe in representing the meaning and context of words. [ABSTRACT FROM AUTHOR]

• Three datasets are merged to build a larger, more diversified spam dataset. • Data balancing is done using SmoteTomek and NearMiss data resampling techniques. • Proposed Hard and Soft voting ensemble models for performance improvement. • Several DL approaches are experimented with GloVe and FastText word embeddings. • Proposed FCB-SA hybrid DL approach outperformed other DL approaches. Cybercriminals use social media platforms to disseminate spam, misleading facts, fake news, and malicious links. Blocking such deceptive social media spam is essential. However, extracting relevant features from social networks is challenging due to privacy and time constraints. Traditional frequency-based word representation techniques are time-consuming and inefficient in producing contextual word vectors. Word embeddings and deep learning models have recently shown good results in text classification. Also, most existing approaches assumed balanced class distribution, which is false for most real-world datasets. In this paper, an attempt is made to advance the performance of the social spam detection system by leveraging dataset balancing, advanced word embedding techniques, machine learning, and deep learning approaches with the self-attention mechanism. In the proposed framework, the datasets are balanced using NearMiss and SmoteTomek techniques to feed several machine-learning models. Later, the baseline ML models and proposed voting-based ensemble models are evaluated on imbalanced and balanced datasets. For the proposed deep learning-based hybrid approaches, embeddings are generated using GloVe and FastText word embeddings on the balanced combined dataset and passed into the deep neural network comprised of Conv1D and Bi-directional recurrent neural network layers with the self-attention mechanism for improved context understanding and effective results. This study examines hybrid approaches for detecting social spam using imbalanced social network data and picks the optimum combination. Besides, Machine learning ensembles, word embeddings, deep learning with hyper-parameter optimization, and a self-attention method are compared thoroughly. Experiments and comparisons with other techniques show that the proposed hybrid framework with deep learning-based approaches achieves better performance. [ABSTRACT FROM AUTHOR]

Nowadays, fake news has turned into a major problem because of the negative impact that it creates on society. Social media allows people to spread information on the internet with slight investigations and to add fewer filters than the actual content. Nowadays, the false news in the internet community is unsure, and it creates a wrong impression among the users. Detecting false news has become a critical task based on shared content. To tackle the false news growth in social media, various automatic detection schemes were evaluated. The "Natural Language Processing (NLP)" method also gives a prominent solution for false news detection. The main intention of this paper is to design and introduce an innovative false news recognition method using Meta-heuristic Searched-Ensemble Learning (MS-EL). Further, the selected features are extracted by the "Term Frequency-Inverse Document Frequency (TF-IDF)" and also Word2vec features. Here, the extracted selected features are integrated with the Hybrid Squirrel–Dragonfly Search Optimization (HS-DSO) is used to optimize the weighted feature selection approach with the fitness function of solving data variance and correlation. The proposed MS-EL is adopted in the classification part, having three sets of classifiers, Long Short-Term Memory (LSTM), Support Vector Machine (SVM), and Deep Neural Network (DNN). Here, the ensemble classifier is enhanced by the same HS-DSO that shows the parameter tuning with a high convergence rate. From the experimental outcomes, the accuracy of HS-DSO-MS-EL is 22% higher than BMO-MS-EL, 24% higher than SP-BMO-MS-EL, 30% higher than SSA-MS-EL, and 29% higher than DA-MS-EL. Thus, the experimental analysis with standard datasets establishes that the introduced fake news detection method has gained higher accuracy than the existing models. [ABSTRACT FROM AUTHOR]

Internet public social media and forums provide a convenient channel for people concerned about public health issues, such as COVID-19, to share and discuss information/misinformation with each other. In this paper, we propose a natural language processing (NLP) method based on Bidirectional Long Short-Term Memory (Bi-LSTM) technique to perform sentiment classification and uncover various issues related to COVID-19 public opinions. Bi-LSTM is an improved version of conventional LSTMs for generating the output from both left and right contexts at each time step. We experimented with real datasets extracted from Twitter and Reddit social media platforms, and our experimental results showed improved metrics compared with the conventional LSTM model as well as recent studies available in the literature. The proposed model can be used by official institutions to mitigate the effects of negative messages and to understand peoples' concerns during the pandemic. Furthermore, our findings shed light on the importance of using NLP techniques to analyze public opinion and to combat the spreading of misinformation and to guide health decision-making. • Bi-LSTM sentiment detection model is developed to classify COVID-19 social comments. • Various scenarios to help counter negative COVID-19 comments and reduce their impact. • Comparative analysis of our approach with most popular models is presented. • Word embedding followed by Bi-LSTM provides better performance on Sentiment Analysis. [ABSTRACT FROM AUTHOR]

• Geotagged photographs are used to investigate cultural ecosystem services (CESs) to the coastal areas of Hong Kong. • Visiting sentiments are accessed through user-generated textual content as a proxy in the analysis of the geotagged photographs. • Both cultural attractions and protected areas are typical hotspots associated with CESs. • The relationships between CESs-related sentiments and critical sociodemographic and temporal factors are discussed. Ecosystem service assessments have been conducted for coastal management with a primary focus on tangible natural capital. Thus far, the explicit variation of cultural ecosystem services (CESs) and particularly the sentiments of CES-related ecotourism are not well understood. This paper takes advantage of big social media data to unravel the patterns of CESs and visiting sentiments in coastal areas of Hong Kong. Through machine-learned keyword labels, we employed content analysis to derive visual information for geotagged photographs. Applying natural language processing to apps with machine learning in cloud computing, we derived the sentiments based on user-generated textual content associated with coastal ecotourism. Based on regression analysis and multiple comparisons analysis, we identify the association between critical demographic and temporal factors with CES and related visiting sentiments. Referring to previous studies, we identified the main intangible benefits into six basic divisions based on 424 keyword labels for coastal areas. Our results show that hotspots of CESs are spatially concentrated in both cultural attractions and protected areas, which are critical for coastal ecosystem management and protection. More specifically, these areas of high CES value have good spatiotemporal accessibility, high infrastructure coverage, and spatially explicit population and economic growth. Furthermore, we discover that sentiments related to coastal CESs vary based on social media characteristics. Our study renews the indicators of quantitative CES evaluation based on crowdsourcing geospatial data. [ABSTRACT FROM AUTHOR]

Financial technology-based firms (FinTech) are crucial to promoting new technologies and advances in innovations related to the financial field, sustainable development, and financial inclusion. This paper aims to assess the Sustainable Development Goals (SDGs) and open innovation integrated within the public discourse in the social media of FinTech firms, using machine-learning-based social media analysis (SMA). Accordingly, we tracked the behavior of 21 firms based on the empirical material of 32,716 posts on Twitter. The outcomes showed dissimilar discourses based on FinTech firms' activities. However, it was found that only financial infrastructure, lending, and personal finance fields have a discourse related to innovation and, to a lesser extent, related to the SDGs thematic. Thus, awareness of sustainable objectives is still far from being a relevant issue for FinTech, which, in general, has neglected to significantly mention SDGs; nonetheless, innovation and related terms are a consistent topic in this area. Furthermore, hints of the implementation of the open innovation paradigm and interest in novel technologies are demonstrated, in addition to the promotion of different actors and events on social media that serve as a showcase for firms that have a presence on Twitter. [ABSTRACT FROM AUTHOR]