Search

Dimensionality Reduction (DR) is the process of reducing the numerous features or random variables under consideration to a limited number of features by obtaining a set of principal variables. These techniques cater great values in machine learning, which come in handy to simplify a classification or a regression dataset, thereby yielding a better-performing predictive model. Techniques used for DR include Feature Selection methods, Matrix Factorization, AutoEncoder methods, and Manifold Learning. Merits of DR include data compression, reduced space of storage, and removal of redundant features. This paper attempts to review various techniques used to carry out dimensionality reduction while providing an exhaustive comparative study over the merits and demerits of each of the techniques used under the empirical experiments performed by the authors whose work is being reviewed. [ABSTRACT FROM AUTHOR]

• Qualitative and quantitative detection of amine gases could be achieved by CSA. • A visible detection of beef freshness using the amine-responsive CSA was proposed. • ResNet34 had the best performance for beef freshness detection based on CSA. • T-SNE could further visualize and understand the classification process of DL. This study developed an innovative approach that combines a colourimetric sensor array (CSA) composed of twelve pH-response dyes with advanced algorithms, aiming to detect amine gases and assess the freshness of chilled beef. With the assistance of multivariate statistical analysis, the sensor array can effectively distinguish five amine gases and enable rapid quantification of trimethylamine vapour with a limit of detection (LOD) of 8.02 ppb and visually monitor the fresh levels of chilled beef. Moreover, the utilization of deep learning models (ResNet34, VGG16, and GoogleNet) for chilled beef freshness evaluation achieved an overall accuracy of 98.0 %. Furthermore, t -distributed stochastic neighbour embedding (t -SNE) visualized the feature extraction process and provided explanations to understand the classification process of deep learning. The results demonstrated that applying deep learning techniques in the process of pattern recognition of CSA can help in realizing the rapid, robust, and accurate assessment of chilled beef freshness. [ABSTRACT FROM AUTHOR]

In this study, a prediction model for visual fatigue is developed. As input, frequential and nonlinear features are extracted from multichannel EEG, and then dimensionally reduced. In the model, bidirectional LSTM and attention layers are combined for effective learning. As a result, 82.90% accuracy, 85.26% weighted precision, 82.90% weighted recall, and 84.02% weighted F1‐score were obtained. [ABSTRACT FROM AUTHOR]

The autonomous underwater vehicle (AUV) has a problem with feature loss when recognizing small targets underwater. At present, algorithms usually use multi-scale feature extraction to solve the problem, but this method increases the computational effort of the algorithm. In addition, low underwater light and turbid water result in incomplete information on target features. This paper proposes an enhanced dilated convolution framework (EHDC) for underwater blurred target recognition. Firstly, this paper extracts small target features through hybrid dilated convolution networks, increasing the perceptive field of the algorithm without increasing the computational power of the algorithm. Secondly, the proposed algorithm learns spatial semantic features through an adaptive correlation matrix and compensates for the missing features of the target. Finally, this paper fuses spatial semantic features and visual features for the recognition of small underwater blurred targets. Experiments show that the proposed method improves the recognition accuracy by 1.04% compared to existing methods when recognizing small underwater blurred targets. [ABSTRACT FROM AUTHOR]

This paper presents an overview of the uses of the combination of eye tracking and artificial intelligence. In the paper, several aspects of both eye tracking and applied AI methods have been analyzed. It analyzes the eye tracking hardware used along with the sampling frequency, the number of test participants, additional parameters, the extraction of features, the artificial intelligence methods used and the methods of verification of the results. Finally, it includes a comparison of the results obtained in the analyzed literature and a discussion about them. [ABSTRACT FROM AUTHOR]

Vacuum is an important parameter in cutter suction dredging operations because the equipment is underwater and can easily fail. It is necessary to analyze other parameters related to the vacuum to make real-time predictions about it, which can improve the construction efficiency of the dredger under abnormal working conditions. In this paper, a data-driven method for predicting the vacuum of the underwater pump of the cutter suction dredger (CSD) is proposed with the help of big data, machine learning, data mining, and other technologies, and based on the historical data of "Hua An Long" CSD. The method eliminates anomalous data, standardizes the data set, and then relies on theory and engineering experience to achieve feature extraction using the Spearman correlation coefficient. Then, six machine learning methods were employed in this study to train and predict the data set, namely, lasso regression (lasso), elastic network (Enet), gradient boosting decision tree (including traditional GBDT, extreme gradient boosting (XGBoost), light gradient boosting machine (LightGBM)), and stacking. The comparison of the indicators obtained through multiple rounds of feature number iteration shows that the LightGBM model has high prediction accuracy, a good running time, and a generalization ability. Therefore, the methodological framework proposed in this paper can help to improve the efficiency of underwater pumps and issue timely warnings in abnormal working conditions. [ABSTRACT FROM AUTHOR]

Deep learning algorithms have simplified the process of creating indistinguishable synthetic videos, or deep fakes, because of the unparalleled increase in processing power. It is concerning because these face-swapped manipulations are often used in a variety of contexts, such as blackmail and political manipulation. This paper presents a revolutionary deep learning-based approach to accurately discriminating between real and Artificial Intelligence (AI)-generated false films. Using a ResNext Convolutional Neural Network (CNN) for frame-level feature extraction, this method makes use of an automated mechanism intended to identify replacement and re-enactment deep fakes. A Recurrent Neural Network (RNN) equipped with Long Short-Term Memory (LSTM) training is utilized to classify videos and distinguish between real and modified ones. The system demonstrates the effectiveness of a straightforward and reliable methodology, in addition to utilizing complex neural network topologies. Through testing, this paper showcases how well the system can accurately identify videos playing a crucial role in ongoing initiatives to combat the increasing dangers posed by the proliferation of deep fake content in society. [ABSTRACT FROM AUTHOR]

This paper presents a collaborative filtering algorithm based on reinforcement learning theory. Then, the personalized bank financial recommendation system for users is constructed in the massive data environment. Tags mimic different types of user interest points to build a representative personalized data set. The collaborative screening of bank financial products is realized using the simulation results and users' historical access records. The ranking calculation of related financial products is added to the general bank financial product recommendation system. This method can more accurately express the query results for a specific user. It is found that the collaborative filtering algorithm based on enhanced learning theory can improve the efficiency of collaborative screening of bank financial products. The best results can be obtained by combining the two organically. This paper proposes that the recommendation algorithm of reinforcement learning bank financial products based on user preference and collaborative filtering is feasible. [ABSTRACT FROM AUTHOR]

A pipeline is the most efficient way to transport water from one place to another. Due to aging, corrosion, and external factors, the pipeline is prone to damage, which causes leaks. Many machine learning (ML) and deep learning (DL) methods are available to address this issue. This paper does an experimental study on available methods in ML and DL for leak detection for the collected data using an acousto-optic sensor. The experimental setup comprises of an acousto-optic sensor made of an erbium-doped fiber laser (EDFL), galvanized iron pipeline, a tank, a pump, and a data acquisition unit. The dimensions of the galvanized pipeline looped with the water tank are a length of 40 m, an inner diameter of 89 mm, and an outer diameter of 90 mm. The diameter of the simulated leak aperture is 5 mm. The methods analyzed in this study are k-means, k-medoids, Naive Bayes (NB), support vector machines (SVM), k-nearest neighbor (KNN), decision tree (DT), categorical boosting (CatBoost), random forest (RF), XGBoost, AdaBoost, and one-dimensional convolutional neural network (1DCNN). ML algorithms need a feature extraction technique because the data collected from the experiment is too large and contains redundant information. Feature extraction reduces the data size by extracting essential information. This paper extracts ten features from raw data. Among the ML algorithms, AdaBoost gives the highest prediction accuracy of 98.02%. This paper also implements eight models of 1DCNN, and Model 1 shows the best prediction accuracy of 98.16%, which is the highest compared with all the other classifiers in ML and DL for one-dimensional time series acousto-optic sensor data. [ABSTRACT FROM AUTHOR]

In the research field of small object detection, most object detectors have been successfully used for pedestrian detection, face recognition, lost and found, and automatic driving, among other applications, and have achieved good results. However, when general object detectors encounter challenging low-resolution images from the TinyPerson dataset, they will produce undesirable detection results because of the dense occlusion between people and different body poses. In order to solve these problems, this paper proposes a tiny object detection method TOD-YOLOv7 based on YOLOv7.First, this paper presents a reconstruction of the YOLOv7 network by adding a tiny object detection layer to enhance its detection ability. Then, we use the recursive gated convolution module to realize the interaction with the higher-order space to accelerate the model initialization process and reduce the reasoning time. Secondly, this paper proposes the integration of a coordinate attention mechanism into the YOLOv7 feature extraction network to strengthen the pedestrian object information and weaken the background information.Additionally, we leverage data augmentation techniques to improve the representation learning of the algorithm. The results show that compared with the baseline model YOLOv7, the detection accuracy of this model on the TinyPerson dataset is improved from 7.1% to 9.5%, and the detection speed reaches 208 frames per second (FPS). The algorithm of this paper is shown to achieve better detection results for tiny object detection. [ABSTRACT FROM AUTHOR]

Electroencephalography (EEG) is increasingly important in Brain-Computer Interface (BCI) systems due to its portability and simplicity. In this paper, we provide a comprehensive review of research on EEG signal processing techniques since 2021, with a focus on preprocessing, feature extraction, and classification methods. We analyzed 61 research articles retrieved from academic search engines, including CNKI, PubMed, Nature, IEEE Xplore, and Science Direct. For preprocessing, we focus on innovatively proposed preprocessing methods, channel selection, and data augmentation. Data augmentation is classified into conventional methods (sliding windows, segmentation and recombination, and noise injection) and deep learning methods [Generative Adversarial Networks (GAN) and Variation AutoEncoder (VAE)]. We also pay attention to the application of deep learning, and multi-method fusion approaches, including both conventional algorithm fusion and fusion between conventional algorithms and deep learning. Our analysis identifies 35 (57.4%), 18 (29.5%), and 37 (60.7%) studies in the directions of preprocessing, feature extraction, and classification, respectively. We find that preprocessing methods have become widely used in EEG classification (96.7% of reviewed papers) and comparative experiments have been conducted in some studies to validate preprocessing. We also discussed the adoption of channel selection and data augmentation and concluded several mentionable matters about data augmentation. Furthermore, deep learning methods have shown great promise in EEG classification, with Convolutional Neural Networks (CNNs) being the main structure of deep neural networks (92.3% of deep learning papers). We summarize and analyze several innovative neural networks, including CNNs and multi-structure fusion. However, we also identified several problems and limitations of current deep learning techniques in EEG classification, including inappropriate input, low cross-subject accuracy, unbalanced between parameters and time costs, and a lack of interpretability. Finally, we highlight the emerging trend of multi-method fusion approaches (49.2% of reviewed papers) and analyze the data and some examples. We also provide insights into some challenges of multi-method fusion. Our review lays a foundation for future studies to improve EEG classification performance. [ABSTRACT FROM AUTHOR]

Twitter sentiment analysis poses challenges due to the informal language, limited character count, and prevalence of sarcasm, which can alter the polarity of messages. This paper presents a pattern-based approach to detect irony in Twitter sentiment analysis. By analyzing various types of irony and identifying their patterns, this paper proposes a methodology to improve the efficiency of sentiment analysis. Tweets are classified into different categories based on their sarcasm using a machine learning algorithm. The proposed approach involves feature extraction from tweets, including sentiment-related features, punctuation-related features, grammatical and phonetic features, and patternbased features. A hybrid pattern extraction with a classification model is employed to process tweet data and classify it as sarcastic or not. Experimental results demonstrate the effectiveness of the proposed approach in detecting sarcasm in tweets, with precision ranging from 84.6% to 98.1% across different classifier algorithms. This pattern-based approach offers promising results for enhancing sentiment analysis on Twitter and understanding the nuances of communication in social media discourse. [ABSTRACT FROM AUTHOR]

In the operation of medium-voltage distribution cables, the local insulation performance may degrade due to inherent defects, environmental influences, and external forces, leading to consecutive self-recovering latent faults in the cables. If not addressed promptly, these faults may escalate into permanent failures. To address this issue, this paper analyzes the development mechanism and characteristics of latent cable faults. A 10kV low-resistance cable latent fault model based on the Kizilcay arc model is built in the PSCAD/EMTDC platform. Furthermore, the paper analyzes and extracts the time-domain, frequency-domain, and time-frequency domain features of fault current samples. Effective fault feature vectors are constructed using multivariate analysis of variance (MANOVA) and Principal Component Analysis (PCA). Based on the fault feature vectors and Extreme Learning Machine (ELM), an intelligent fault identification model for cable latent faults is developed. The initial parameters of the ELM model are optimized using the Particle Swarm Optimization (PSO) algorithm. Finally, the superiority of the proposed model is validated in terms of classification accuracy, training time, and robustness compared to other machine learning algorithms. [ABSTRACT FROM AUTHOR]

With the exponential growth of data, extracting actionable insights becomes resource-intensive. In many organizations, normalized relational databases store a significant portion of this data, where tables are interconnected through some relations. This paper explores relational learning, which involves joining and merging database tables, often normalized in the third normal form. The subsequent processing includes extracting features and utilizing them in machine learning (ML) models. In this paper, we experiment with the propositionalization algorithm (i.e., Wordification) for feature engineering. Next, we compare the algorithms PropDRM and PropStar, which are designed explicitly for multi-relational data mining, to traditional machine learning algorithms. Based on the performed experiments, we concluded that Gradient Boost, compared to PropDRM, achieves similar performance (F1 score, accuracy, and AUC) on multiple datasets. PropStar consistently underperformed on some datasets while being comparable to the other algorithms on others. In summary, the propositionalization algorithm for feature extraction makes it feasible to apply traditional ML algorithms for relational learning directly. In contrast, approaches tailored specifically for relational learning still face challenges in scalability, interpretability, and efficiency. These findings have a practical impact that can help speed up the adoption of machine learning in business contexts where data is stored in relational format without requiring domain-specific feature extraction. [ABSTRACT FROM AUTHOR]

Defect pattern analysis of wafer bin maps (WBMs) is an important means of identifying process problems. Recently, automated analysis methods using machine learning or deep learning have been studied as alternatives to manual classification by engineers. In this paper, we propose a method to improve the feature extraction performance of defect patterns by transforming the polar coordinate system instead of the existing WBM image input. To reduce the variability of the location representation, defect patterns in the Cartesian coordinate system, where the location of the distributed defect die is not constant, were converted to a polar coordinate system. The CNN classifier, which uses polar coordinate transformed input, achieved a classification accuracy of 91.3%, which is 4.8% better than the existing WBM image-based CNN classifier. Additionally, a tree-structured classifier model that sequentially connects binary classifiers achieved a classification accuracy of 94%. The method proposed in this paper is also applicable to the defect pattern classification of WBMs consisting of different die sizes than the training data. Finally, the paper proposes an automated pattern classification method that uses individual classifiers to learn defect types and then applies ensemble techniques for multiple defect pattern classification. This method is expected to reduce labor, time, and cost and enable objective labeling instead of relying on subjective judgments of engineers. [ABSTRACT FROM AUTHOR]

An aggressive driving state impacts drivers' decisions, which could potentially lead to accidents. Real-time recognition of driving state is particularly important for improving road safety. However, the majority of modeling in existing studies relies on a single algorithm, which may lead to unreliable predictions. This paper proposes a stacking ensemble aggressive driving state recognition model using electroencephalography (EEG), which is able to combine different heterogeneous classification algorithms. Five types of classification algorithms and their variants are tested and compared to identify suitable base classifiers. All of these classifiers are optimized by Bayesian optimizer before the comparison. Three stacking ensemble recognition models using different meta-classifiers (i.e., logistic regression, random forest, and AdaBoost) and an equal-weight voting ensemble recognition model are established. The aforementioned recognition models are evaluated by using a dataset collected from a car-following simulated driving experiment. Fast Fourier transformation (FFT) and wavelet packet transformation (WPT) are adopted to extract features from raw EEG data. The results suggest that the stacking ensemble recognition models outperform the best single (i.e., support vector machine) model; the random Forest stacking recognition model achieves the best performance and the accuracy is increased from 81.21% to 84.23% using FFT features and from 86.45% to 87.38% using WPT features. [ABSTRACT FROM AUTHOR]

The rapid growth of network infrastructures and the increasing volume of data transmitted through them have led to a critical need for efficient and accurate anomaly detection systems in network transport. This paper proposes a novel anomaly detection system that utilizes machine learning techniques to identify abnormal patterns and deviations in network traffic. The proposed system follows a multi-layered approach, starting with the collection of network traffic data from various sources, including routers, switches, and gateways. The data is then preprocessed to extract relevant features and eliminate noise. Feature extraction is carried out using statistical, time-series, and flow-based analysis to capture the inherent characteristics of network communication. Machine learning algorithms, such as neural networks, or in this case, auto-encoders, will be trained to learn the patterns of normal network behavior and subsequently detect deviations from these patterns as anomalies. The system provides alerts and notifications to network administrators, allowing prompt investigation and response to potential security threats or network performance issues. It effectively differentiates between benign and malicious network activities, enabling network administrators to take proactive measures to secure their infrastructure and ensure uninterrupted communication. [ABSTRACT FROM AUTHOR]

In the nature, there exists a huge number of species of insects. Insects have caused damage for human and crops. Traditional identification methods of insects require expert knowledge and time consuming. Therefore, the automatic identification and classification have been more and more necessary. In recent year, one of the efficient approaches to classify insects is the application of Deep neural networks. The paper presents the improvements for the classification of insect images. Firstly, we apply the data augmentation to improve the number of insect images. Then, we applied various deep neural networks to improve the classification accuracy of insect classification. Obtained classification accuracy of 98% on public insect datasets shows the efficiency of the proposed method. [ABSTRACT FROM AUTHOR]

Background: Emotion is a complex phenomenon that greatly affects human behavior and thinking in daily life. Electroencephalography (EEG), one of the human physiological signals, has been emphasized by most researchers in emotion recognition as its specific properties are closely associated with human emotion. However, the number of human emotion recognition studies using computer games as stimuli is still insufficient as there were no relevant publicly available datasets provided in the past decades. Most of the recent studies using the Gameemo public dataset have not clarified the relationship between the EEG signal's changes and the emotion elicited using computer games. Thus, this paper is proposed to introduce the use of data mining techniques in investigating the relationships between the frequency changes of EEG signals and the human emotion elicited when playing different kinds of computer games. The data acquisition stage, data pre-processing, data annotation and feature extraction stage were designed and conducted in this paper to obtain and extract the EEG features from the Gameemo dataset. The cross-subject and subject-based experiments were conducted to evaluate the classifiers' performance. The top 10 association rules generated by the RCAR classifier will be examined to determine the possible relationship between the EEG signal's frequency changes and game-induced emotions. Results: The RCAR classifier constructed for cross-subject experiment achieved highest accuracy, precision, recall and F1-score evaluated with over 90% in classifying the HAPV, HANV and LANV game-induced emotions. The 20 experiment cases' results from subject-based experiments supported that the SVM classifier could accurately classify the 4 emotion states with a kappa value over 0.62, demonstrating the SVM-based algorithm's capabilities in precisely determining the emotion label for each participant's EEG features' instance. Conclusion: The findings in this study fill the existing gap of game-induced emotion recognition field by providing an in-depth evaluation on the ruleset algorithm's performance and feasibility of applying the generated rules on the game-induced EEG data for justifying the emotional state prediction result. [ABSTRACT FROM AUTHOR]

Accurately predicting the price of carbon is an effective way of ensuring the stability of the carbon trading market and reducing carbon emissions. Aiming at the non-smooth and non-linear characteristics of carbon price, this paper proposes a novel hybrid prediction model based on improved feature extraction and non-linear integration, which is built on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), fuzzy entropy (FuzzyEn), improved random forest using particle swarm optimisation (PSORF), extreme learning machine (ELM), long short-term memory (LSTM), non-linear integration based on multiple linear regression (MLR) and random forest (MLRRF), and error correction with the autoregressive integrated moving average model (ARIMA), named CEEMDAN-FuzzyEn-PSORF-ELM-LSTM-MLRRF-ARIMA. Firstly, CEEMDAN is combined with FuzzyEn in the feature selection process to improve extraction efficiency and reliability. Secondly, at the critical prediction stage, PSORF, ELM, and LSTM are selected to predict high, medium, and low complexity sequences, respectively. Thirdly, the reconstructed sequences are assembled by applying MLRRF, which can effectively improve the prediction accuracy and generalisation ability. Finally, error correction is conducted using ARIMA to obtain the final forecasting results, and the Diebold–Mariano test (DM test) is introduced for a comprehensive evaluation of the models. With respect to carbon prices in the pilot regions of Shenzhen and Hubei, the results indicate that the proposed model has higher prediction accuracy and robustness. The main contributions of this paper are the improved feature extraction and the innovative combination of multiple linear regression and random forests into a non-linear integrated framework for carbon price forecasting. However, further optimisation is still a work in progress. [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD) is a popular neurological disorder affecting a critical part of the world's population. Its early diagnosis is extremely imperative for enhancing the quality of patients' lives. Recently, improved technologies like image processing, artificial intelligence involving machine learning, deep learning, and transfer learning have been introduced for detecting AD. This review describes the contribution of image processing, feature extraction, optimization, and classification approach in AD recognition. It deeply investigates different methods adopted for multiclass diagnosis of AD. The paper further presents a brief comparison of existing AD studies in terms of techniques adopted, performance measures, classification accuracy, publication year, and datasets. It then summarizes the important technical barriers in reviewed works. This paper allows the readers to gain profound knowledge regarding AD diagnosis for promoting extensive research in this field. [ABSTRACT FROM AUTHOR]

To address the cost and efficiency issues of manually analysing requirement dependency in requirements engineering, a requirement dependency extraction method based on part-of-speech features and an improved stacking ensemble learning model (P-Stacking) is proposed. Firstly, to overcome the problem of singularity in the feature extraction process, this paper integrates part-of-speech features, TF-IDF features, and Word2Vec features during the feature selection stage. The particle swarm optimization algorithm is used to allocate weights to part-of-speech tags, which enhances the significance of crucial information in requirement texts. Secondly, to overcome the performance limitations of standalone machine learning models, an improved stacking model is proposed. The Low Correlation Algorithm and Grid Search Algorithms are utilized in P-stacking to automatically select the optimal combination of the base models, which reduces manual intervention and improves prediction performance. The experimental results show that compared with the method based on TF-IDF features, the highest F1 scores of a standalone machine learning model in the three datasets were improved by 3.89%, 10.68%, and 21.4%, respectively, after integrating part-of-speech features and Word2Vec features. Compared with the method based on a standalone machine learning model, the improved stacking ensemble machine learning model improved F1 scores by 2.29%, 5.18%, and 7.47% in the testing and evaluation of three datasets, respectively. [ABSTRACT FROM AUTHOR]

This paper proposes a new algorithm composition network from the perspective of machine learning, based on an in-depth study of related literature. At the same time, this paper examines the characteristics of music and develops a model for recognising musical emotions. Using the model's information entropy of pitch and intensity to extract the main melody track, note features are extracted from bar features. Finally, the cosine of the vector included angle is used to judge the similarity between feature vectors of several adjacent sections, allowing the music to be divided into several independent segments. The emotional model of music is used to analyze each segment's emotion. By quantifying music features, this paper classifies and quantifies music emotion based on the mapping relationship between music features and emotion. Music emotion can be accurately identified by the model. The model's emotion recognition accuracy is up to 93.78 percent, and the algorithm's recall rate is up to 96.3 percent, according to simulation results. The recognition method used in this paper has a higher recognition ability than other methods, and the emotion recognition result is more reliable. This paper can not only meet the composer's auxiliary creative needs, but it can also help intelligent music services. [ABSTRACT FROM AUTHOR]

Emotions are strongly associated with individuals’ mood and personality. In the field of Human Computer Interaction, human face plays a very vital role. According to studies made by researchers’ majority of the information conveyed through facial expressions than verbal communication. In day-to-day life, human expresses different types of feelings such as Happiness, Anger, Sadness, Fear, Disgust and Surprise which is considered as “Universal Emotions”. It has always been difficult for computers to recognize human emotions. Thus, a substantial effort was made by the researchers to build the Facial Emotion Recognition system and which was considered as the best tool for recognizing emotions through facial expressions. In this paper, a detailed study on different methods that can be used in facial emotion recognition is done. For this study, the literature is collected from various reputable research published. This survey paper is based on the current approaches to face detection and feature extraction techniques for FER and also presented the real-time applications [ABSTRACT FROM AUTHOR]

Around 50 million individuals worldwide suffer from epilepsy, a chronic, non-communicable brain disorder. Several screening methods, including electroencephalography, have been proposed to identify epileptic episodes. EEG data, which are frequently utilised to enhance epilepsy analysis, offer essential information on the electrical processes of the brain. Prior to the emergence of deep learning (DL), feature extraction was accomplished by standard machine learning techniques. As a result, they were only as good as the people who made the features by hand. But with DL, both feature extraction and classification are fully automated. These methods have significantly advanced several fields of medicine, including the diagnosis of epilepsy. In this paper, the works focused on automated epileptic seizure detection using ML and DL techniques are presented as well as their comparative analysis is done. The UCI-Epileptic Seizure Recognition dataset is used for training and validation. Some of the conventional ML and DL algorithms are used with a proposed model which uses long short-term memory (LSTM) to find the best approach. Post that comparative analysis is performed on these algorithms to find the best approach for epileptic seizure detection. As a result, the proposed model LSTM gives a validation accuracy of 97% giving the most appropriate and precise result as compared to other mentioned algorithms used in this study. [ABSTRACT FROM AUTHOR]

The automation of an application is crucial in the modern digital environment. In the atomization process, handwritten papers must be converted into digital format. There are more than 120 spoken languages that employ the Devanagari script. Recognizing handwritten Devanagari characters is made more challenging by the characters' complicated shapes, a wide range of modifiers, and variable writing styles. Preprocessing is a crucial step in recognizing handwritten images and comprises noise reduction, segmentation, feature extraction from the image, and more. Preprocessing and recognition are done using several methods. Due to its automatic feature extraction, a deep learning algorithm like CNN is particularly effective in recognition tasks. The main goal of this paper is to conduct a study of the literature and conduct a comparative analysis of the various preprocessing and recognition strategies to help guide future research on the problem of handwritten Devanagari script recognition. [ABSTRACT FROM AUTHOR]

To solve the problems of a few optical fibre line fault samples and the inefficiency of manual communication optical fibre fault diagnosis, this paper proposes a communication optical fibre fault diagnosis model based on variational modal decomposition (VMD), fuzzy entropy (FE) and fuzzy clustering (FC). Firstly, based on the OTDR curve data collected in the field, VMD is used to extract the different modal components (IMF) of the original signal and calculate the fuzzy entropy (FE) values of different components to characterize the subtle differences between them. The fuzzy entropy of each curve is used as the feature vector, which in turn constructs the communication optical fibre feature vector matrix, and the fuzzy clustering algorithm is used to achieve fault diagnosis of faulty optical fibre. The VMD-FE combination can extract subtle differences in features, and the fuzzy clustering algorithm does not require sample training. The experimental results show that the model in this paper has high accuracy and is relevant to the maintenance of communication optical fibre when compared with existing feature extraction models and traditional machine learning models. [ABSTRACT FROM AUTHOR]

In our age, we are bombarded with multimedia content daily. Although, face-to-face communication always outgrows the potential factors of healthy assessment of our peers through recorded content or live media interaction, (be it text, video, images, speech) new approaches to render us able to understand and discern between emotions of our peers on multimedia content are getting more and more popular and more complex. Two robust topics in this regard are generally named as sentiment analysis and emotion detection. The advent and exponential growth of social networks and for instance, the employment of speech bots have made it a necessity to particularly address the problem of healthy emotion recognition outside face-to-face, everyday conversations or interactions. Machines’ capability to perform the set of tasks through Machine Learning approaches, namely consisting of detecting, expressing, and understanding emotions is collectively known as, as in humans, emotional intelligence. Different modes of input as human behavior like those taken from audio, image, video sources and signal interpretations processed through Electro-encephalography (EEG), related brain wave measurements are used in emotion recognition. My study aim is intended to be the examination and review of recent study approaches in Emotion Detection in Speech, possibly establishing links or differences between recent study publishes because each study paper focuses on a single or set of Machine Learning approaches which are employed in Emotion Detection in Speech. This paper tries to examine various relevant research involving methods of Machine Learning which were studied and tested under this research respective to Speech Emotion Recognition (SER). Effectiveness of the involved methods and databases are discussed while commenting on the studies and expressed in the form of their findings. Improvements throughout these studies are, though not chronologically, compared using simple tables which show independent accuracies of several Machine Learning classifier combinations. [ABSTRACT FROM AUTHOR]

Depression is a serious mood disorder that can significantly impact a person's ability to live a normal life. In severe cases, it can even lead to suicidal thoughts. As such, accurate detection of depression is crucial for effective management and treatment. This paper presents a facial expression-based approach for depression detection, which is composed of two steps. First, static features are extracted using Local Binary Pattern (LBP), Histogram of Oriented Gradients (HOG), and Bag of Words (BOW). Second, dynamic features are obtained by applying LBPs on Three Orthogonal Planes (LBP-TOP) and Eight Vertices LBP (EVLBP) frame by frame. Next, the static and dynamic features are combined to create a 1377-dimensional vector for each video. Finally, Gradient Boosting Regression is used to predict depression scores. The experimental results on the AVEC 2014 depression dataset (RMSE = 8. 6 5 , MAE = 6. 9 1) demonstrate the effectiveness of the proposed method. These results indicate that the low-dimensional vectors extracted by the proposed method can effectively capture the facial motion of individuals with depression, and also suggest that hand-crafted methods could have potential in depression detection. [ABSTRACT FROM AUTHOR]

This paper aims to improve the accuracy of sentiment analysis on Apache Spark for a real-time general twitter data. A lot of works exist on sentiment analysis on offline or stored twitter data that uses several classification algorithms on relevant features extracted using well-known feature extraction methodologies on pre-processed text data. However, not much works exist for sentiment analysis of real-time twitter data and especially for the generic data on big data processing platforms such as Apache Spark. This paper proposes a real-time sentiment analysis for generic twitter data through Apache Spark using six classification algorithms on N-gram and Term Frequency - Inverse Document Frequency (TF-IDF) feature extraction methodologies on the pre-processed data. An exhaustive comparison is done using Logistic Regression (LR), Multinomial Naive Bayes (MNB), Random Forest Classfier(RFC), Support Vector Machine (SVM), K-Nearest Neighbour (K-NN), and Decision Tree (DT) classification algorithms. It is observed that the trigram feature extraction method performs the best on LR and SVM and the RFC results are also comparable on the considered general tweets data. [ABSTRACT FROM AUTHOR]

An important part of diagnostics is to gain insight into properties that characterize a disease. Machine learning has been used for this purpose, for instance, to identify biomarkers in genomics. However, when patient data are presented as images, identifying properties that characterize a disease becomes far more challenging. A common strategy involves extracting features from the images and analyzing their occurrence in healthy versus pathological images. A limitation of this approach is that the ability to gain new insights into the disease from the data is constrained by the information in the extracted features. Typically, these features are manually extracted by humans, which further limits the potential for new insights. To overcome these limitations, in this paper, we propose a novel framework that provides insights into diseases without relying on handcrafted features or human intervention. Our framework is based on deep learning (DL), explainable artificial intelligence (XAI), and clustering. DL is employed to learn deep patterns, enabling efficient differentiation between healthy and pathological images. Explainable artificial intelligence (XAI) visualizes these patterns, and a novel "explanation-weighted" clustering technique is introduced to gain an overview of these patterns across multiple patients. We applied the method to images from the gastrointestinal tract. In addition to real healthy images and real images of polyps, some of the images had synthetic shapes added to represent other types of pathologies than polyps. The results show that our proposed method was capable of organizing the images based on the reasons they were diagnosed as pathological, achieving high cluster quality and a rand index close to or equal to one. [ABSTRACT FROM AUTHOR]

A literature review on sarcasm detection has been undergone in this research work. To have a meaningful study about the existing works on sarcasm detection, a total of 65 research papers have been analyzed in diverse aspects like the datasets utilized, language, pre-processing technique, type of features, feature extraction technique, machine learning/deep learning-based sarcasm classification. All these papers belong to diverse international as well as national journals. Moreover, the performance of each work in terms of accuracy, F-score and recall will also be manifested. To show the superiority of the works, a comparative evaluation has been undergone in terms of analyzed performances of each of the works. Finally, the works that hold the superior or improved values are furnished. In addition, the current challenges faced by the sarcasm detection system are portrayed, and this will be a milestone for future researchers. [ABSTRACT FROM AUTHOR]

The paper offers a solution to the problem of detecting and recognizing surface defects in welded joints that appear during tungsten inert gas welding of metal edges. This problem belongs to the machine vision. Welding of stainless-steel edges is carried out automatically on the pipe production line. Therefore, frames of video sequences are investigated. Images of some welding defects are shown in the paper. An algorithm proposed by the authors is used to detect welding defects in the video sequence frames, the efficiency of which has been confirmed experimentally. The problem solution of welding defects recognition is based on the use of traditional machine learning methods: support vector machine and artificial neural network. To build classification models, a labeled dataset containing automatically extracted texture features from the areas of welding defects detected in the video sequences was created. An analysis was performed to identify the strength of the correlation of texture features between each other and the dependent variable in the dataset for dimensionality reduction of the feature vector. The models were trained and tested on datasets with different numbers of features. The quality of the classification models was evaluated based on the accuracy metric values. The best results were achieved by the classifier built using the support vector machine with a chi-square kernel on a training sample with two features. The build models allow automatic recognition of such welding defects as lack of fusion and metal oxidation. The computational experiments with real video sequences obtained with a digital camera confirmed the possibility of using the proposed solution for recognizing surface welding defects in the process of manufacturing stainless steel pipes. [ABSTRACT FROM AUTHOR]

This paper aims to develop Machine Learning algorithms to classify electronic articles related to this phenomenon by retrieving information and topic modelling. The Methodology of this study is categorized into three phases: the Text Classification Approach (TCA), the Proposed Algorithms Interpretation (PAI), and finally, Information Retrieval Approach (IRA). The TCA reflects the text preprocessing pipeline called a clean corpus. The Global Vectors for Word Representation (Glove) pre-trained model, FastText, Term Frequency-Inverse Document Frequency (TF-IDF), and Bag-of-Words (BOW) for extracting the features have been interpreted in this research. The PAI manifests the Bidirectional Long Short-Term Memory (Bi-LSTM) and Convolutional Neural Network (CNN) to classify the COVID-19 news. Again, the IRA explains the mathematical interpretation of Latent Dirichlet Allocation (LDA), obtained for modelling the topic of Information Retrieval (IR). In this study, 99% accuracy was obtained by performing K-fold cross-validation on Bi-LSTM with Glove. A comparative analysis between Deep Learning and Machine Learning based on feature extraction and computational complexity exploration has been performed in this research. Furthermore, some text analyses and the most influential aspects of each document have been explored in this study. We have utilized Bidirectional Encoder Representations from Transformers (BERT) as a Deep Learning mechanism in our model training, but the result has not been uncovered satisfactory. However, the proposed system can be adjustable in the real-time news classification of COVID-19. [ABSTRACT FROM AUTHOR]

In the traditional text detection process, the text area of the small receptive field in the video image is easily ignored, the features that can be extracted are few, and the calculation is large. These problems are not conducive to the recognition of text information. In this paper, a lightweight network structure on the basis of the EAST algorithm, the Convolution Block Attention Module (CBAM), is proposed. It is suitable for the spatial and channel hybrid attention module of text feature extraction of the natural scene video images. The improved structure proposed in this paper can obtain deep network features of text and reduce the computation of text feature extraction. Additionally, a hybrid feature pyramid + BLSTM network is designed to improve the attention to the small acceptance domain text regions and the text sequence features of the region. The test results on the ICDAR2015 demonstrate that the improved construction can effectively boost the attention of small acceptance domain text regions and improve the sequence feature detection accuracy of small acceptance domain of long text regions without significantly increasing computation. At the same time, the proposed network constructions are superior to the traditional EAST algorithm and other improved algorithms in accuracy rate P, recall rate R, and F-value. [ABSTRACT FROM AUTHOR]

Collecting and analyzing data from all devices to improve the efficiency of business processes is an important task of Industrial Internet of Things (IIoT). In the age of data explosion, extensive text data generated by the IIoT have given birth to a variety of text representation methods. The task of text representation is to convert the natural language to a form that computer can understand with retaining the original semantics. However, these methods are difficult to effectively extract the semantic features among words and distinguish polysemy in natural language. Combining the advantages of convolutional neural network (CNN) and variational autoencoder (VAE), this paper proposes an intelligent CNN-VAE text representation algorithm as an advanced learning method for social big data within next-generation IIoT, which help users identify the information collected by sensors and perform further processing. This method employs the convolution layer to capture the local features of the context and uses the variational technique to reconstruct feature space to make it conform to the normal distribution. In addition, the improved word2vec model based on topical word embedding (TWE) is utilized to add topical information to word vectors to distinguish polysemy. This paper takes the social big data as an example to illustrate the way of the proposed algorithm applied in the next-generation IIoT and utilizes Cnews dataset to verify the performance of proposed method with four evaluating metrics (i.e., recall, accuracy, precision, and F1-score). Experimental results indicate that the proposed method outperforms word2vec-avg and CNN-AE in K-nearest neighbor (KNN), random forest (RF), and support vector machine (SVM) classifiers and distinguishes polysemy effectively. [ABSTRACT FROM AUTHOR]

In this paper, a fault identification algorithm combining a signal processing algorithm and machine learning algorithm is proposed, using a four-mass vibration MEMS gyroscope (FMVMG) for signal acquisition work, constructing a gyroscope fault dataset, and performing the model training task based on this dataset. Combining the improved EWT algorithm with SEResNeXt-50 reduces the impact of white noise in the signal on the identification task and significantly improves the accuracy of fault identification. The EWT algorithm is a wavelet analysis algorithm with adaptive wavelet analysis, which can significantly reduce the impact of boundary effects, and has a good effect on decomposition of signal segments with short length, but a reconstruction method is needed to effectively separate the noise signal and effective signal, and so this paper uses multiscale permutation entropy for calculation. For the reason that the neural network has a better ability to characterize high-dimensional signals, the one-dimensional signal is reconstructed into a two-dimensional image signal and the signal features are extracted. Then, the constructed image signals are fed into the SEResNeXt-50 network, and the characterization ability of the model is further improved in the network with the addition of the Squeeze-and-Excitation module. Finally, the proposed model is applied to the FMVMG fault dataset and compared with other models. In terms of recognition accuracy, the proposed method improves about 30.25% over the BP neural network and about 1.85% over ResNeXt-50, proving the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Underwater target detection and classification based on sonar images is a challenging task because of the complex underwater environment. In recent years, deep learning technology has effectively improved the detection accuracy of underwater targets compared to traditional sonar image target detection methods, which have a low accuracy and poor robustness. However, deep learning algorithms for sonar image target detection have fewer training samples and a low detection speed. To solve these problems, an improved YOLOv4 based sonar target detection and classification algorithm is proposed in this paper. First, the feature extraction network CSPDarknet-53 in YOLOv4 is improved to reduce both the model parameters and the network depth. Second, the PANet feature enhancement module in the YOLOv4 model is replaced by the adaptive spatial feature fusion module (ASFF) to obtain a better feature fusion effect. In addition, the number of fusion feature layers is increased to improve the receptive field and detection accuracy. Furthermore, this paper uses the k-means++ algorithm to cluster the sonar image dataset to obtain the appropriate size and number of anchor boxes for model training. The experimental results show that the proposed method has better performance in detection accuracy and detection speed compared to YOLOv4 and YOLOv4-tiny. [ABSTRACT FROM AUTHOR]

This paper presents an image fusion network based on a special residual network and attention mechanism. Compared with the traditional fusion network, the image fusion network has the advantages of an end-to-end network and integrates the feature extraction advantages of the attention mechanism residual network. It overcomes the shortcomings of the traditional network that need complex design rules and manual operation. In this method, hierarchical feature fusion is used to achieve effective fusion. A combined loss function is designed to optimize training results and improve image fusion quality. This paper uses many qualitative and quantitative experimental analyses on different data sets. The results show that, compared with the comparison algorithm, the method in this paper has a stronger retention ability of infrared and visible light information and better indexes. 72% of eleven indexes compared with some images in the public TNO data set are optimal or sub-optimal, and 80% are optimal or suboptimal in the RoadScene data set, which is much higher than other algorithms. The overall fusion effect is more in line with human visual perception. [ABSTRACT FROM AUTHOR]

Deep learning has made substantial progress in crowd counting, but in practical applications, due to interference factors such as perspective distortion and complex background, the existing methods still have large errors in counting. In response to the above problems, this paper designs a multi-scale feature fusion network (IA-MFFCN) based on the reverse attention mechanism, which maps the image to the crowd density map for counting. The network consists of three parts: feature extraction module, inverse attention module, and back-end module. First, to overcome the problem of perspective distortion, deeper single-column CNNs was designed as a feature extraction module to extract multi-scale feature information and merge them; second, to avoid interference of complex backgrounds, the inverse attention module was designed, through the multi-scale inverse attention mechanism, reducing the influence of noise on counting accuracy. Finally, to generate a high-quality crowd density map, dilation convolution was introduced. Simultaneously, to enhance the sensitivity of the network to crowd counting, a comprehensive loss function based on Euclidean loss and predicted population loss is designed to improve training accuracy, to produce a more accurate density value. Experiments show that compared with the comparison algorithm, the algorithm in this paper has a significant reduction in the mean absolute error (MAE) and mean square error (MSE) on the ShanghaiTech dataset, UCF_CC_50 dataset and WorldExpo'10 dataset. [ABSTRACT FROM AUTHOR]

Teaching and exam proctoring represent key pillars of the education system. Human proctoring, which involves visually monitoring examinees throughout exams, is an important part of assessing the academic process. The capacity to proctor examinations is a critical component of educational scalability. However, such approaches are time-consuming and expensive. In this paper, we present a new framework for the learning and classification of cheating video sequences. This kind of study aids in the early detection of students' cheating. Furthermore, we introduce a new dataset, "actions of student cheating in paper-based exams". The dataset consists of suspicious actions in an exam environment. Five classes of cheating were performed by eight different actors. Each pair of subjects conducted five distinct cheating activities. To evaluate the performance of the proposed framework, we conducted experiments on action recognition tasks at the frame level using five types of well-known features. The findings from the experiments on the framework were impressive and substantial. [ABSTRACT FROM AUTHOR]

Machine learning (ML) algorithms are increasingly used in power systems applications. One important application is the classification and localization of various types of transmission line faults. Using voltage and current measurements from phasor measurement units (PMUs), a number of useful features can be extracted, which can form the basis of a ML-based prediction of the fault type, line, and distance on the line. This paper proposes a technique to find the optimal number and placement of PMUs by performing thorough feature selection. The features are selected to maximize the accuracy of the ML classification and regression algorithms. The results show that for the IEEE 14 bus system, the use of only five PMUs is sufficient to obtain high levels of accuracy. For example, a testing accuracy of 99.0% and 97.1% can be achieved for the fault type and fault line location, respectively. As for the fault distance along the line, the testing MAE of 3.1% can be obtained along with an R 2 score of 94.4%. Adding more PMUs does not provide any additional value in terms of accuracy. [ABSTRACT FROM AUTHOR]

Problems related to ventral hernia repairs (VHR) are very common, and evaluating them using computational methods can assist in selecting the most appropriate treatment. This study is based upon data from 3339 patients from different European countries observed during the last 12 years (2012–2023), which were collected by specialists in hernia surgery. Most patients underwent standard surgical procedures, with a growing trend towards laparoscopic surgery. This paper focuses on statistically evaluating the treatment methods in relation to patient age, body mass index (BMI), and the type of repair. Appropriate mathematical methods are employed to extract and classify the selected features, with emphasis on computational and machine-learning techniques. The paper presents surgical hernia treatment statistics related to patient age, BMI, and repair methods. The main conclusions point to mean groin hernia repair (GHR) complications of 19% for patients in the database. The accuracy of separating GHR mesh surgery with and without postoperative complications reached 74.4% using a two-layer neural network classification. Robotic surgeries represent 22.9% of all the evaluated hernia repairs. The proposed methodology suggests both an interdisciplinary approach and the utilization of computational intelligence in hernia surgery, potentially applicable in a clinical setting. [ABSTRACT FROM AUTHOR]