Search

The number of scientific papers has been increasing ever more rapidly. Researchers have to spend a lot of time classifying papers relevant to their study, especially into fine-grained subfields. However, almost all existing paper classification models are coarse-grained, which can not meet the needs of researchers. Observing this, we propose a lightweight fine-grained classification model for scientific paper. Dynamic weighting coefficients on feature words are incorporated into the model to improve the classification accuracy. The feature word weight is optimized by the Mean Decrease Accuracy (MDA) algorithm. Considering applicability, the lightweight processing is conducted through algorithm pruning and training sample pruning. Comparison with mainstream models shows simultaneous improvement in accuracy and time efficiency by our model. [ABSTRACT FROM AUTHOR]

Data driven deep learning methods have become the mainstream method of building extraction from remote sensing images. In this paper, deep learning algorithm is used to classify and extract buildings from remote sensing images of rural areas around the Great Wall in the suburbs of Beijing captured by unmanned aerial vehicles. Aiming at the shortcomings of the current mainstream instance segmentation algorithm Mask R-CNN in feature fusion and poor prediction of instance mask boundaries, this paper proposes a boundary optimization algorithm for building instance segmentation based on discrete wavelet transform. Firstly, the discrete wavelet transform is introduced into the segmentation task branch of Mask R-CNN algorithm to extract the low-frequency and high-frequency information of the real mask, in which the high-frequency information includes the boundary information. Secondly, the pixel by pixel prediction of the mask turns into the learning of the low-frequency and high-frequency information of the real mask. The learning of the high-frequency information helps the segmentation network to learn the boundary features better. Finally, using the reversibility of discrete wavelet transform, the low-frequency and high-frequency information of the learned mask is inversely transformed to reconstruct the final mask. The improved algorithm is evaluated on the dataset COCO, and applied to the automatic extraction of buildings. The DWT Mask R-CNN algorithm model achieved 70.2% segmentation accuracy and 71.4% detection accuracy, which were improved by 1% and 0.7% respectively compared with the Mask R-CNN and Cascade Mask R-CNN models. The experimental results show that the instance segmentation edge optimization algorithm combined with wavelet transform has achieved better results on the segmentation boundary, improved the poor effect of mask edge detection and achieved higher detection accuracy, and can accurately extract village buildings. [ABSTRACT FROM AUTHOR]

Considering the power transformers fault diagnosis model has unstable performance and prone to over-fitting, we propose a transformers fault diagnosis model based on a meta-learning approach to kernel extreme learning machine with opposition-based learning sparrow search algorithm optimization (Meta-OSSA-KELM) in this paper. Its learning proceeds in two steps. Firstly, the base-learner KELMs is trained on the disjoint training subset. Then, meta-learner KELM is trained with the hidden codes of training set in base-learner KELMs that have been trained. In this paper, chaotic mapping and opposition-based learning are integrated into Sparrow search algorithm(SSA) and used it to optimize each learner. We simulate this model with measured dissolved gas analysis(DGA) data, the results show that compared with PSO and SSA, opposition-based learning sparrow search algorithm(OSSA) has better global search-ability on the optimization for the proposed model. In addition, compared with Adaboost.M1, BPNN, SVM and KELM, Meta-OSSA-KELM has a higher average accuracy (90.9% vs 78.5%, 74.0%, 76.9%, 76.9%) and a lower standard deviation (1.56x10-2 vs 4.21x10-2, 10.5x10-2, 3.7x10-2, 2.18x10-2) in simulation tests for 30 times. It is shown that the proposed model is a stable and better performance transformers fault diagnosis method. [ABSTRACT FROM AUTHOR]

In this paper, 1,538 papers retrieved with the keywords "sports artificial intelligence (AI)" on the Web of Science database since 2007 were taken as the data source, and the Cite Space V software was used to visualize and analyze them. A visual knowledge graph was used to streamline the countries, institutions and authors conducting sports AI research, discipline distribution, research hotspots and development trends in the past 15 years. Subsequently, its development direction and research progress were discussed. Sports AI was widely distributed, with the US, China and the UK leading the way. The most prolific authors and teams in research on sports AI were concentrated in American universities. Their main research direction is to develop and improve smart wearable devices based on machine learning and deep learning technologies for different groups of people. Research on sports AI involved multiple disciplines, which mainly applied and referred to research methodologies and theories on engineering, computer science and sports science. It could be seen from the frequency and centrality of keywords that in the current field of sports AI, machine learning is the main direction, artificial neural networks is the main algorithm, and practical and empirical research based on data mining is the focus. The research hotspots were divided into three major clusters: physical health promotion, sports injury prevention and control, and athletic performance enhancement. How to introduce intelligent technology into sports for a perfect integration still has an arduous and long way to go. Future development requires joint efforts and participation of scientific researchers, professionals and common people. [ABSTRACT FROM AUTHOR]

In order to better evaluate and promote human health, this paper analyzes the influence of different inertial-measurement-unit signals, different sensor locations, different activity intensities and different signal fusion schemes on the accuracy of physical strength consumption estimation during walking and running activities. Different pattern recognition methods, such as the Counts-based linear regression model, the typical non-linear model based on decision tree and artificial neural network, and the end-to-end convolutional neural network model, are analyzed and compared. Our findings are as follows: 1) For the locations of sensors during walking and running activities, the physical strength consumption prediction accuracy at the ankle location is higher than that at the hip location. Therefore, wearing an inertial-measurement-unit at the ankle can improve the accuracy of the model. 2) Regarding the types of activity signals during walking and running activities, the impact of accelerometer signals on hip and ankle prediction accuracy is not significantly different, while the gyroscope model is more sensitive to the location, with higher prediction accuracy at the ankle than at the hip. In addition, the physical strength consumption prediction accuracy of accelerometer signals is higher than that of gyroscope signals, and fusion of accelerometer and gyroscope signals can improve the accuracy of physical strength consumption prediction. 3) For different data analysis models during walking and running activities, the artificial neural network model that integrates different sensor locations and inertial-measurement-unit signals with different activity intensities has the lowest mean squared error for the measurement of physical strength consumption. The non-linear models based on decision tree and artificial neural network have better physical strength consumption prediction capabilities than the Counts-based linear regression model, especially for high-intensity activity energy consumption prediction. In addition, feature engineering models are generally better than convolutional neural network model in terms of overall performance and prediction results under the three different activity intensities. Furthermore, as the activity intensity increases, the performance of all physical strength consumption calculation models decreases. We recommend using the artificial neural network model based on multi-signal fusion to estimate physical strength consumption during walking and running activities because this model exhibits strong generalization ability in cross-validation and test results, and its stability under different activity intensities is better than that of the other three models. To the best of our knowledge, this paper is the first to delve deeply and in detail into methods for estimating physical strength consumption. Undoubtedly, our paper will have an impact on research related to topics such as intelligent wearable devices and subsequent methods for estimating physical strength consumption, which are directly related to physical health. [ABSTRACT FROM AUTHOR]

In practical applications of machine learning, only part of data is labeled because the cost of assessing class label is relatively high. Measure of uncertainty is abbreviated as MU. This paper explores MU for partially labeled real-valued data via a discernibility relation. First, a decision information system with partially labeled real-valued data (p-RVDIS) is separated into two decision information systems: one is the decision information system with labeled real-valued data (l-RVDIS) and the other is the decision information system with unlabeled real-valued data (u-RVDIS). Then, based on a discernibility relation, dependence function, conditional information entropy and conditional information amount, four degrees of importance on an attribute subset in a p-RVDIS are defined. They are calculated by taking the weighted sum of l-RVDIS and u-RVDIS based on the missing rate, which can be considered as four MUs for a p-RVDIS. Combining l-RVDIS and u-RVDIS provides a more accurate assessment of the importance and classification ability of attribute subsets in a p-RVDIS. This is precisely the novelty of this paper. Finally, experimental analysis on several datasets verify the effectiveness of these MUs. These findings will contribute to the comprehension of the essence of the uncertainty in a p-RVDIS. [ABSTRACT FROM AUTHOR]

Structure learning is the core of graph model Bayesian Network learning, and the current mainstream single search algorithm has problems such as poor learning effect, fuzzy initial network, and easy falling into local optimum. In this paper, we propose a heuristic learning algorithm HC-PSO combining the HC (Hill Climbing) algorithm and PSO (Particle Swarm Optimization) algorithm, which firstly uses HC algorithm to search for locally optimal network structures, takes these networks as the initial networks, then introduces mutation operator and crossover operator, and uses PSO algorithm for global search. Meanwhile, we use the DE (Differential Evolution) strategy to select the mutation operator and crossover operator. Finally, experiments are conducted in four different datasets to calculate BIC (Bayesian Information Criterion) and HD (Hamming Distance), and comparative analysis is made with other algorithms, the structure shows that the HC-PSO algorithm is superior in feasibility and accuracy. [ABSTRACT FROM AUTHOR]

In the field of text classification, current research ignores the role of part-of-speech features, and the multi-channel model that can learn richer text information compared to a single model. Moreover, the method based on neural network models to achieve final classification, using fully connected layer and Softmax layer can be further improved and optimized. This paper proposes a hybrid model for text classification using part-of-speech features, namely PAGNN-Stacking1. In the text representation stage of the model, introducing part-of-speech features facilitates a more accurate representation of text information. In the feature extraction stage of the model, using the multi-channel attention gated neural network model can fully learn the text information. In the text final classification stage of the model, this paper innovatively adopts Stacking algorithm to improve the fully connected layer and Softmax layer, which fuses five machine learning algorithms as base classifier and uses fully connected layer Softmax layer as meta classifier. The experiments on the IMDB, SST-2, and AG_News datasets show that the accuracy of the PAGNN-Stacking model is significantly improved compared to the benchmark models. [ABSTRACT FROM AUTHOR]

Online shopping is a form of electronic commerce that enables customers to purchase products directly from the seller over the internet using a web browser or a mobile application. With the growing number of research papers on Deep Learning (DL)-based recommendations, DL models have proven to be effective in Recommender systems. Hence in this paper, relevant product accessories recommendation is proposed using deep learning and histogram features. The proposed recommendation describes the novel way of content-based filtering which divides the work into two phases. In phase 1, the implemented approach determines the color and category of the product. In phase 2, the recommendation system retrieves the matching accessories for the chosen product. For phase 1, Decision Tree, Linear Regression, Logistic Regression, Naïve Bayes, Long Short-Term Memory (LSTM), and a novel method of Stack dense Recurrent Neural Network (RNN) along with the color histogram is applied to identify the category and color of the product. It is justified that the proposed technique of stack dense RNN achieves 98% accuracy. In phase 2, from the Machine Learning (ML) perspective, Random Forest (RF) is employed for the recommendation. The RF model finds the matching accessories for the chosen product and retrieves the top relevant items. [ABSTRACT FROM AUTHOR]

Most existing Web service recommendation models based on machine learning do not fully consider the high-order features interaction between users and services and with poor interpretability. In this paper, an Interpretable Web Service Recommendation model based on Disentangled Representation Learning (WSR-DRL) is proposed. First of all, to make full use of the service description information to improve the accuracy of Web service recommendation, the features representation of service name is obtained by using BERT model, and the local and global features representation of service description information is further obtained by combining 2-D CNN and Bi-LSTM. Then the disentangled convolution neural network is used to generate the high-order interaction features between users and services, and the neighborhood routing algorithm is used to mine the latent factors in these features. That improves the accuracy of Web service recommendation and make it interpretable. Finally, in order to verify the effectiveness of the model, several groups of experiments are carried out on real data sets. The experimental results show that compared with latest models such as DMF, DeepFM, DKN, GCMC, NDCG model and WSR-MGAT model, the WSR-DRL model proposed in this paper shows better performance on Precision@10, Recall@10, F1@10 and NDCG@10 evaluation metrics. [ABSTRACT FROM AUTHOR]

As one of the main methods of information fusion, artificial intelligence class fusion algorithm not only inherits the powerful skills of artificial intelligence, but also inherits many advantages of information fusion. Similarly, as an important sub-field of artificial intelligence class fusion algorithm, deep learning class fusion algorithm also inherits advantages of deep learning and information fusion. Hence, deep learning fusion algorithm has become one of the research hotspots of many scholars. To solve the problem that the existing neural networks are input into multiple channels as a whole and cannot fully learn information of multichannel images, Shan et al. proposed multichannel concat-fusional convolutional neural networks. To mine more multichannel images' information and further explore the performance of different fusion types, the paper proposes new fusional neural networks called multichannel cross-fusion convolutional neural networks (McCfCNNs) with fusion types of "R+G+B/R+G+B/R+G+B" and "R+G/G+B/B+R" based on the tremendous strengths of information fusion. Experiments show that McCfCNNs obtain 0.07-6.09% relative performance improvement in comparison with their corresponding non-fusion convolutional neural networks (CNNs) on diverse datasets (such as CIFAR100, SVHN, CALTECH256, and IMAGENET) under a certain computational complexity. Hence, McCfCNNs with fusion types of "R+G+B/R+G+B/R+G+B" and "R+G/G+B/B+R" can learn more fully multichannel images' information, which provide a method and idea for processing multichannel information fusion, for example, remote sensing satellite images. [ABSTRACT FROM AUTHOR]

Temporal knowledge base exists on various fields. Take medical medicine field as example, diabetes is a typical chronic disease which evolves slowly. This paper starts from actual EMR data of hospitals by combination of experience and knowledge of clinical doctors. Link prediction on clinical knowledge base such as diabetic complication requires the analysis on temporal characteristic of temporal knowledge base, which is a great challenge for traditional link prediction models. This paper proposes temporal knowledge graph link prediction model based on deep learning. This model selects the TransR transformation model suitable for big data and makes entity projection in relation space containing different semantic meanings, so as to vector the entities and complex semantic relations in graph. Then it adopts LSTM recursive neural network and adds the top-bottom relational information of the graph for sequential learning. Finally it constantly carries out deep learning through incremental calculation and LSTM recursive network to improve the accuracy of prediction. The incremental LSTM model highlights the hidden semantic and clinical temporal information and effectively utilizes sequential learning to mining forward-backward dependent information. It compensates the deficiency of lower prediction accuracy on timely knowledge graph caused by the traditional link prediction models. Finally, it is proved that the new model has better performance over temporal knowledge graph link prediction. [ABSTRACT FROM AUTHOR]

In this paper, a novel Z-number based Fuzzy Neural Network (Z-FNN) based on the integration of Z-valued fuzzy logic and neural networks is proposed. Z-valued fuzzy rule base is presented and its inference process is described using interpolative approximate reasoning. Accordingly, the structure of the Z-FNN is proposed using a distance measure and interpolative approximate reasoning scheme. Based on presented architecture the learning algorithm of Z-FNN is designed. The updating of the unknown parameters of the network is carried out using Genetic Algorithms (GA). The proposed Z-FNN system is utilized for dynamic plant identification. The effectiveness of Z-FNN has been tested by comparing its performance with the performances of other fuzzy systems available in the literature. The proposed approach has been proven to be a suitable alternative for the identification of nonlinear systems characterized by uncertain and imprecise information. [ABSTRACT FROM AUTHOR]

The quality of sleep plays a crucial role in physical well-being, and individuals are becoming increasingly concerned about sleep quality and its associated health issues. Although various sleep monitoring devices exist, there remains a need for a highly accurate sleep state identification algorithm. To address this, we present a paper that utilizes machine learning techniques to identify human sleep states based on electroencephalogram (EEG) signals collected by an EEG instrument. We propose a model that incorporates two nonlinear characteristic parameters, MSE and PSE, extracted from artificially designed EEG signals as input. Additionally, we employ a Support Vector Machine (SVM) classifier algorithm to accurately identify sleep states, eliminating uncertainties associated with manually designed feature parameters. Experimental results demonstrate the superior accuracy of our proposed model for sleep state analysis, offering valuable insights for improving sleep quality and addressing related health concerns. [ABSTRACT FROM AUTHOR]

Designers refer to existing product cases and innovate products to develop new products. However, when designers screen product cases, there is no user participation, which leads to the lack of user-side knowledge and emotional drive that is very important for design. Therefore, it is necessary to play the role of user emotional knowledge in promoting the whole design process. This paper proposes the concept of the positive perceptual sample, which applies the knowledge emotion integration of designers and users to the screening sample case stage at the beginning of the design process. This study is based on the lack of user-side knowledge and emotional drive of reference cases and integrates user emotion into the reference case screening process. Then, in the emotion measurement process, users' cognitive data in the screening process are obtained through the eye-brain fusion cognitive experiment. Finally, the XGBoost algorithm is used to process feature index data to realize the classification and recognition of cognitive data and applied to the positive perceptual classification of products. The results show that the classification accuracy of physiological cognitive data with user emotional representation by the XGBoost algorithm is 90.87%. The results of cognitive data classification are applied to the screening of positive perceptual samples, and the satisfaction rate is 98.35%. The results show that the method proposed in this paper provides a new source of ideas for obtaining positive perceptual samples and can be applied to new product development. [ABSTRACT FROM AUTHOR]

The stock market is a chaotic system, and stock forecasting has been the research focus. This paper proposes a multi-factor model based on DeepForest-CQP to make it more applicable to the stock domain. A t-test is used for selecting factors, and orthogonalization and heteroskedasticity tests are performed for the combined factors, which are particularly important in stock forecasting. DeepForest-CQP was combined with the multi-factor model to construct a stock selection model that can achieve higher returns. The obtained multi-factor quantitative stock selection model is used to study stock selection strategies, and simulated trading is used to evaluate the multi-factor model and stock selection strategies and compare them with various machine learning multi-factor models. The experimental results show that the DeepForest-CQP-based multi-factor stock selection model achieves significant performance advantages in all backtesting metrics. [ABSTRACT FROM AUTHOR]

In this paper, we presents an apporch for real-world human face close-up images cartoonization. We use generative adversarial network combined with an attention mechanism to convert real-world face pictures and cartoon-style images as unpaired data sets. At present, the image-to-image translation model has been able to successfully transfer style and content. However, some problems still exist in the task of cartoonizing human faces:Hunman face has many details, and the content of the image is easy to lose details after the image is translated. the quality of the image generated by the model is defective. The model in this paper uses the generative adversarial network combined with the attention mechanism, and proposes a new generative adversarial network combined with the attention mechanism to deal with these problems. The channel attention mechanism is embedded between the upper and lower sampling layers of the generator network, to avoid increasing the complexity of the model while conveying the complete details of the underlying information. After comparing the experimental results of FID, PSNR, MSE three indicators and the size of the model parameters, the new model network proposed in this paper avoids the complexity of the model while achieving a good balance in the conversion task of style and content. [ABSTRACT FROM AUTHOR]

This paper presents a Hybrid Feature Selection Technique for Sentiment Classification. We have used a Genetic Algorithm and a combination of existing Feature Selection methods, namely: Information Gain (IG), CHI Square (CHI), and GINI Index (GINI). First, we have obtained features from three different selection approaches as mentioned above and then performed the UNION SET Operation to extract the reduced feature set. Then, Genetic Algorithm is applied to optimize the feature set further. This paper also presents an Ensemble Approach based on the error rate obtained different domain datasets. To test our proposed Hybrid Feature Selection and Ensemble Classification approach, we have considered four Support Vector Machine (SVM) classifier variants. We have used UCI ML Datasets of three domains namely: IMDB Movie Review, Amazon Product Review and Yelp Restaurant Reviews. The experimental results show that our proposed approach performed best in all three domain datasets. Further, we also presented T-Test for Statistical Significance between classifiers and comparison is also done based on Precision, Recall, F1-Score, AUC and model execution time. [ABSTRACT FROM AUTHOR]

Smart city has come a long way since the development of emerging technology like Information and communications technology (ICT), Internet of Things (IoT), Machine Learning (ML), Block chain and Artificial Intelligence. The Intelligent Transportation System (ITS) is an important application in a rapidly growing smart city. Prediction of the automotive accident severity plays a very crucial role in the smart transportation system. The main motive behind this research is to determine the specific features which could affect vehicle accident severity. In this paper, some of the classification models, specifically Logistic Regression, Artificial Neural network, Decision Tree, K-Nearest Neighbors, and Random Forest have been implemented for predicting the accident severity. All the models have been verified, and the experimental results prove that these classification models have attained considerable accuracy. The paper also explained a secure communication architecture model for secure information exchange among all the components associated with the ITS. Finally paper implemented web base Message alert system which will be used for alert the users through smart IoT devices. [ABSTRACT FROM AUTHOR]

With the rise of social networks, people now express their sentiments more frequently and comfortably through their social media activities on different events, person, and every little thing surrounding them. This generates a lot of unstructured data; billions of users post tweets every day as a daily regime on Twitter itself. This has given rise to many texts classification and analysis tasks, Sentiment Analysis (SA) being one of them. Through SA, it is conferred whether the users have negative or positive orientations in their opinions; the results of this task are significantly useful for decision-makers in various fields. This paper presents various facets of SA, like the process followed in SA, levels, approaches, and sentences considered in SA. Aspects such as growth, techniques, the share of various platforms, and SA pipeline are also covered in this paper. At last, we have highlighted some major challenges in order to define future directions. [ABSTRACT FROM AUTHOR]

Because multiple domain cyberspace joint attacks are becoming more widespread, establishing a multiple domain cyberspace defensive paradigm is becoming more vital. However, although some physical domain and social domain information is incorporated in present approaches, total modeling of cyberspace is absent, therefore thorough modeling of cyberspace is becoming increasingly necessary. This paper proposed a knowledge graph based multiple domain cyberspace modeling approach. A knowledge graph of multiple domain cyberspace is produced by extracting multiple domain entity information and entity relations such as physical domain, social domain, network domain, and information domain, so that semantic information of multiple domain cyberspace may be described consistently. At the same time, this paper proposed a user's permissions reasoning method based on multiple domain cyberspace knowledge graph to address the user's permissions reasoning that relies on artificial reasoning principles. Through the model learning knowledge graph triples characteristics and rules, and implementing automatic reasoning of user's permissions, this proposed method can abandon the artificial model of writing reasoning rules, allowing the machine to learn the reasoning rules using machine learning and other methods. Experimental results showed that the proposed method can learn relevant reasoning rules and accomplish automated reasoning of user's permissions, and that the method's accuracy and recall rates are higher than those of path ranking and translating embeddings. [ABSTRACT FROM AUTHOR]

Click-through rate (CTR) prediction, which aims to predict the probability of a user clicking on an ad, is a critical task in online advertising systems. The problem is very challenging since(1) an effective prediction relies on high-order combinatorial features, and(2)the relationship to auxiliary ads that may impact the CTR. In this paper, we propose Deep Context Interaction Network on Attention Mechanism(DCIN-Attention) to process feature interaction and context at the same time. The context includes other ads in the current search page, historically clicked and unclicked ads of the user. Specifically, we use the attention mechanism to learn the interactions between the target ad and each type of auxiliary ad. The residual network is used to model the feature interactions in the low-dimensional space, and with the multi-head self-attention neural network, high-order feature interactions can be modeled. Experimental results on Avito dataset show that DCIN outperform several existing methods for CTR prediction. [ABSTRACT FROM AUTHOR]

With the continuous deepening of the urbanization process and the progress of science and technology, people transform nature and develop nature on a larger and larger scale, among which the most iconic transformation is a variety of building structures built by people. And with the passage of time, the building structure in the perennial wind and sun, there will be signs of "illness", if not timely treatment, it will have a huge impact on the stability and safety of the building structure. Based on this, in this paper, according to the characteristics of crack identification on the surface of concrete structure, background subtraction algorithm is selected for image noise reduction processing. Through three steps of digital image noise reduction, crack extraction and crack parameter identification, the quantitative recognition of cracks is completed and a complete system of crack parameter identification is formed. The experimental results show that the machine learning model of building structure health monitoring and damage recognition algorithm proposed in this paper has excellent statistical performance, and the relative error accuracy of recognition can be controlled within 10%. [ABSTRACT FROM AUTHOR]

The research of biomedical data is crucial for disease diagnosis, health management, and medicine development. However, biomedical data are usually characterized by high dimensionality and class imbalance, which increase computational cost and affect the classification performance of minority class, making accurate classification difficult. In this paper, we propose a biomedical data classification method based on feature selection and data resampling. First, use the minimal-redundancy maximal-relevance (mRMR) method to select biomedical data features, reduce the feature dimension, reduce the computational cost, and improve the generalization ability; then, a new SMOTE oversampling method (Spectral-SMOTE) is proposed, which solves the noise sensitivity problem of SMOTE by an improved spectral clustering method; finally, the marine predators algorithm is improved using piecewise linear chaotic maps and random opposition-based learning strategy to improve the algorithm's optimization seeking ability and convergence speed, and the key parameters of the spectral-SMOTE are optimized using the improved marine predators algorithm, which effectively improves the performance of the over-sampling approach. In this paper, five real biomedical datasets are selected to test and evaluate the proposed method using four classifiers, and three evaluation metrics are used to compare with seven data resampling methods. The experimental results show that the method effectively improves the classification performance of biomedical data. Statistical test results also show that the proposed PRMPA-Spectral-SMOTE method outperforms other data resampling methods. [ABSTRACT FROM AUTHOR]

Under the influence of the coronavirus disease and other factors, agricultural product prices show non-stationary and non-linear characteristics, making it increasingly difficult to forecast accurately. This paper proposes an innovative combinatorial model for Chinese hog price forecasting. First, the price is decomposed using the Seasonal and Trend decomposition using the Loess (STL) model. Next, the decomposed data are trained with the Long Short-term Memory (LSTM) and Seasonal Autoregressive Integrated Moving Average (SARIMA) models. Finally, the prepared data and the multivariate influence factors after Factor analysis are predicted using the gated recurrent neural network and attention mechanisms (AttGRU) to obtain the final prediction values. Compared with other models, the STL-FA-AttGRU model produced the lowest errors and achieved more accurate forecasts of hog prices. Therefore, the model proposed in this paper has the potential for other price forecasting, contributing to the development of precision and sustainable agriculture. [ABSTRACT FROM AUTHOR]

Intelligent Transportation Systems (ITS) have experienced significant growth over the past decade thanks to advances in control, communication, and information technology applied to vehicles, roads, and traffic control systems. Vehicle type classification plays a vital role in implementing ITS because of its ability to collect useful traffic information, enable future development of transport infrastructures, and increase human comfort. As a branch of machine learning, deep learning represents a frontier for artificial intelligence, which seeks to be closer to its primary goal. Deep learning is a powerful tool for classifying vehicle types because it can capture complex traffic data characteristics and learn from large amounts of data. This means that it can be used to accurately classify traffic data and generate valuable insights that can be used to improve traffic management. Researchers have successfully adopted these algorithms as a solution to propose optimal vehicle-type classification strategies. This paper highlights the role of deep learning algorithms in solving the vehicle type classification problem, reviewing the state-of-the-art approaches in this field. [ABSTRACT FROM AUTHOR]

Feature selection can remove data noise and redundancy and reduce computational complexity, which is vital for machine learning. Because the difference between nominal attribute values is difficult to measure, feature selection for hybrid information systems faces challenges. In addition, many existing feature selection methods are susceptible to noise, such as Fisher, LASSO, random forest, mutual information, rough-set-based methods, etc. This paper proposes some techniques that consider the above problems from the perspective of fuzzy evidence theory. Firstly, a new distance incorporating decision attributes is defined, and then a relation between fuzzy evidence theory and fuzzy β covering with an anti-noise mechanism is established. Based on fuzzy belief and fuzzy plausibility, two robust feature selection algorithms for hybrid data are proposed in this framework. Experiments on 10 datasets of various types have shown that the proposed algorithms achieved the highest classification accuracy 11 times out of 20 experiments, significantly surpassing the performance of the other 6 state-of-the-art algorithms, achieved dimension reduction of 84.13% on seven UCI datasets and 99.90% on three large-scale gene datasets, and have a noise tolerance that is at least 6% higher than the other 6 state-of-the-art algorithms. Therefore, it can be concluded that the proposed algorithms have excellent anti-noise ability while maintaining good feature selection ability. [ABSTRACT FROM AUTHOR]

The present study focuses on the implementation of Deep Reinforcement Learning (Deep-RL) techniques for a parallel manipulator robot, specifically the Delta Robot, within a simulated setting. We introduced a simulation framework designed to guide the Delta Robot's end-effector to a designated spatial point accurately. Within this environment, the robotic agent undergoes a learning process grounded in trial and error. It garners positive rewards for successful predictions regarding the next action and faces negative repercussions for inaccuracies. Through this iterative learning mechanism, the robot refines its strategies, thereby establishing improved decision-making rules based on the ever-evolving environment states. Our investigation delved into three distinct Deep-RL algorithms: the Deep Q-Network Algorithm (DQN), the Double Deep Q-Network (DDQN), and the Trust Region Policy Optimization Algorithm (TRPO). All three methodologies were adept at addressing the challenge presented, and a comprehensive discussion of the findings is encapsulated in the subsequent sections of the paper. [ABSTRACT FROM AUTHOR]

A new era in communication has been ushered in by MANET networks, in which users (nodes) interact with one another through a self-configuring network of handheld devices linked by wireless links. Nodes are capable of participating and enthusiastic about sending packets to other nodes. Consequently, the need for a routing protocol materializes. The most difficult aspect is dealing with the network's dynamic topology as a result of node mobility. This is because limited resources like storage space, battery life, and bandwidth require a protocol that can quickly adapt to topology changes while periodically updating messages. On the other hand, security is another important aspect of routing since the involvement of attackers will exhaust the network resources. This paper addresses the main issue of designing a routing protocol that handles all the adversaries and achieves better efficiency. For that, we proposed a Hybrid Machine Learning (HyML) model which evaluates the. Initially, the network is segregated by the Secure Stable Clustering (SSC) approach which first verifies the node's legacy and forms clusters based on stability. The HyML is designed by combining two important ML techniques such as ANN and fuzzy-C Means (FCM) algorithm. The ANN model learns multiple attributes of the trust value and computes the cumulative trust score. Next, FCM determines the node position upon trust score. After the computation of the trust value, optimal route selection is performed by the Spider Monkey Optimization (SMO) technique. The overall work is evaluated through comprehensive simulations based on network longevity, throughput, energy usage, PDR, attack detection efficiency, and delay. [ABSTRACT FROM AUTHOR]

In response to the evolving landscape of the modern era, the requirements for engineering audit have undergone significant changes. To achieve efficient audit tasks and obtain accurate and reliable results, the integration of machine learning and wireless network technology has become essential, leading to the emergence of digital and information-based audit modes. This paper focuses on the development of a digital audit system that combines engineering audit management fusion with machine learning and wireless network technology. Such an approach reflects the dynamic shift in internal audit functions and objectives, providing clear guidelines for the future of digital audit management. By harnessing the power of machine learning and wireless networks, the digital audit system effectively addresses challenges associated with data management, sharing, exchange, and security during the audit process. Through seamless integration, it enables comprehensive electronic and digital management of internal and audit business processes. This research explores the platform's functionalities and its potential application, using actual audit data for analysis. The proposed digital audit system showcases superior real-time data querying performance, heightened accuracy in checks, and enhanced retrieval capabilities. The simulation results validate the system's efficacy, highlighting its ability to deliver true and dependable audit outcomes. By embracing digital transformation, the engineering audit field can harness the potential of cutting-edge technologies, thus paving the way for a more efficient, reliable, and future-ready approach to audit management. [ABSTRACT FROM AUTHOR]

Literature in recent years has introduced several studies conducted to solve the target coverage problem in wireless sensor networks (WSNs). Sensors are conventionally assumed as devices with only a single power level. However, real applications may involve sensors with multiple power levels (i.e., multiple sensing ranges each of which possesses a unique power consumption). Consequently, one of the key problems in WSNs is how to provide a full coverage on all targets distributed in a network containing sensors with multiple power levels and simultaneously prolong the network lifetime as much as possible. This problem is known as Maximum Network Lifetime With Adjustable Ranges (MNLAR) and its NP-completeness has been already proved. To solve this problem, we proposed an efficient hybrid algorithm containing Genetic Algorithm (GA) and Tabu Search (TS) aiming at constructing cover sets that consist of sensors with appropriate sensing ranges to provide a desirable coverage for all the targets in the network. In our hybrid model, GA as a robust global searching algorithm is used for exploration purposes, while TS with its already-proved local searching ability is utilized for exploitation purposes. As a result, the proposed algorithm is capable of creating a balance between intensification and diversification. To solve the MNLR problem in an efficient way, the proposed model was also enriched with an effective encoding method, genetic operators, and neighboring structure. In the present paper, different experiments were performed for the purpose of evaluating how the proposed algorithm performs the tasks defined. The results clearly confirmed the superiority of the proposed algorithm over the greedy-based algorithm and learning automata-based algorithm in terms of extending the network lifetime. Moreover, it was found that the use of multiple power levels altogether caused the extension of the network lifetime. [ABSTRACT FROM AUTHOR]

Multi-modal information outbreak is consistently increasing in social media. Classification of tweet sentiments using various information modalities will help the recommender systems to achieve success in digital marketing. Moreover, aspect-level sentiment analysis categorizes a target's sentiment polarity in a specific environment. Using topic modelling in aspect-level sentiment analysis enables the identification of more accurate aspect-based tweet sentiments. The existing sentiment classification techniques used for the development of recommendation systems do not focus on the aspect-based approach modelled using deep learning classifier with temporal analysis on the social media data. Hence, this paper proposes an efficient sentiment classification model that highlights the impact of topic modelling-based word feature embedding for improvising the classification of Twitter sentiments and product reviews based on temporal reasoning and analysis for performing predictive analysis. For tweets context analysis, Latent Dirichlet Allocation based topic modelling is used in this work which generates the topics. For each topic, the sentiment is calculated separately and the topic guided feature expansion is done using Senti-wordnet. Moreover, an extended deep learning classification algorithm called Long Short-Term Memory (LSTM) with word embedding and temporal reasoning(LSTMWTR) is proposed in this paper for improving the classification accuracy. Finally, the labelled data are classified using the existing machine learning algorithms namely Naïve Bayes, Support Vector Machines and also using the deep learning models such as Convolution Neural Network(CNN),LSTM, Recurrent Neural Networks (RNN) and the transformer model namelyBi-directional Encoder Representation from Transformers (BERT),Convolution Bi-directional Recurrent Neural Network (CBRNN) and the proposed deep learning algorithm namelyLSTMWTR. These sentiment classification algorithms have been evaluated with word embedding for tweet sentiment classification and product review classification. The results obtained from this work show that the proposed LSTMWTR algorithm emerges as the highly accurate model for tweet sentiment and product review classification. [ABSTRACT FROM AUTHOR]

Online services have advanced to the point where they have made our lives much easier, but many problems should be solved to make these services safer for consumers. Numerous transactions are conducted daily, and much personal information is published and shared on e-commerce and social media platforms. This makes security, privacy, and problematic reliability barriers to overcome. One of these problems is detecting credit card fraud because thieves aim to make all transactions legitimate by stealing credit card information. Imbalanced data is a potential problem in machine learning that impairs the performance of the classifiers used in real-world systems. For example, anomaly detection and fraudulent transactions. The term "data imbalance" refers to the problem in which the sample distribution is skewed or skewed towards a particular class. Due to its inherent nature, the software failure prediction dataset falls into the same category as non-defective software modules. The main objective of this paper is to solve the problem of the imbalanced fraud credit card dataset for enhancing the detection accuracy of using machine learning algorithms. This paper provides a unique fraud detection model using the Particle Swarm Optimization (PSO) based on oversampling technique of the minority class to solve the imbalanced dataset problem compared with the Genetic Algorithm (GA) technique. Random Forest (RF) algorithm shows up with sensitivity, specificity, and accuracy. The experimental results achieved 99.3% and 99.4% for GA and PSO within seconds, respectively. Experiments show that the proposed methods outperform other methods, evidenced by the higher classification accuracy obtained. [ABSTRACT FROM AUTHOR]

In today's big data era, there are a large number of unstructured information resources on the web. Natural language processing researchers have been working hard to figure out how to extract useful information from them. Entity Relation Extraction is a crucial step in Information Extraction and provides technical support for Knowledge Graphs, Intelligent Q&A systems and Intelligent Retrieval. In this paper, we present a comprehensive history of entity relation extraction and introduce the relation extraction methods based on Machine Mearning, the relation extraction methods based on Deep Learning and the relation extraction methods for open domains. Then we summarize the characteristics and representative results of each type of method and introduce the common datasets and evaluation systems for entity relation extraction. Finally, we summarize current entity relation extraction methods and look forward to future technologies. [ABSTRACT FROM AUTHOR]

Trend following strategies have a wide-ranging role in quantitative trading fields, which can capture important unilateral market trends for large gains, while this is vulnerable to losses in the period of consolidation. In this paper, we explored the trend trading system in the Chinese futures market based on machine learning techniques and statistical methods. This research utilized the Long-Short-Term Memory network to extract features of time series then predicted the price movements by Machine Learning classifiers. Moreover, based on rebar futures data, the results reveal that the annualized return improved from 6.39% to 15.68% after the trading signals generated in the trading strategy were filtered using the XGBoost model. Also, futures on gold and soybean were used to further test the integrated strategy and the results of the experiment show the effectiveness of the model in filtering false trading signals. [ABSTRACT FROM AUTHOR]

Whether the exact amount of training data is enough for a specific task is an important question in machine learning, since it is always very expensive to label many data while insufficient data lead to underfitting. In this paper, the topic that what is the least amount of training data for a model is discussed from the perspective of sampling theorem. If the target function of supervised learning is taken as a multi-dimensional signal and the labeled data as samples, the training process can be regarded as the process of signal recovery. The main result is that the least amount of training data for a bandlimited task signal corresponds to a sampling rate which is larger than the Nyquist rate. Some numerical experiments are carried out to show the comparison between the learning process and the signal recovery, which demonstrates our result. Based on the equivalence between supervised learning and signal recovery, some spectral methods can be used to reveal underlying mechanisms of various supervised learning models, especially those "black-box" neural networks. [ABSTRACT FROM AUTHOR]

Clustering is widely used in data mining and machine learning. The possibilistic c-means clustering (PCM) method loosens the constraint of the fuzzy c-means clustering (FCM) method to solve the problem of noise sensitivity of FCM. But there is also a new problem: overlapping cluster centers are not suitable for clustering non-cluster distribution data. We propose a novel possibilistic c-means clustering method based on the nearest-neighbour isolation similarity in this paper. All samples are taken as the initial cluster centers in the proposed approach to obtain k sub-clusters iteratively. Then the first b samples farthest from the center of each sub-cluster are chosen to represent the sub-cluster. Afterward, sub-clusters are mapped to the distinguishable space by using these selected samples to calculate the nearest-neighbour isolation similarity of the sub-clusters. Then, adjacent sub-clusters can be merged according to the presented connecting strategy, and finally, C clusters are obtained. Our method proposed in this paper has been tested on 15 UCI benchmark datasets and a synthetic dataset. Experimental results show that our proposed method is suitable for clustering non-cluster distribution data, and the clustering results are better than those of the comparison methods with solid robustness. [ABSTRACT FROM AUTHOR]

The Journal of Intelligent & Fuzzy Systems has retracted an article titled "Intelligent Cloud Agent-Based Action Recognition Detection Using Machine Learning" by L. Nalini Joseph and R. Anand. The retraction was due to the discovery of a 74% exact text similarity between this article and another paper titled "Smart Healthcare Activity Recognition Using Statistical Regression and Intelligent Learning" by K. Akilandeswari et al. The authors of the retracted article agree with the retraction, and the publisher has marked the original PDF with the word "RETRACTED" on every page. [Extracted from the article]

Arrhythmia disorders are the leading cause of death worldwide and are primarily recognized by the patient's irregular cardiac rhythms. Wearable Internet of Things (IoT) devices can reliably measure patients' heart rhythms by producing electrocardiogram (ECG) signals. Due to their non-invasive nature, ECG signals have been frequently employed to detect arrhythmias. The manual procedure, however, takes a long time and is prone to error. Utilizing deep learning models for early automatic identification of cardiac arrhythmias is a preferable approach that will improve diagnosis and therapy. Though ECG analysis using cloud-based methods can perform satisfactorily, they still suffer from security issues. It is essential to provide secure data transmission and storage for IoT medical data because of its significant development in the healthcare system. So, this paper proposes a secure arrhythmia classification system with the help of effective encryption and a deep learning (DL) system. The proposed method mainly involved two phases: ECG signal transmission and arrhythmia disease classification. In the ECG signal transmission phase, the patient's ECG data collected through the IoT sensors is encrypted using the optimal key-based elgamal elliptic curve cryptography (OKEGECC) mechanism, and the encrypted data is securely transmitted to the cloud. After that, in the arrhythmia disease classification phase, the system collects the data from the Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) database to perform training. The collected data is preprocessed by applying the continuous wavelet transform (CWT) to improve the quality of the ECG data. Next, the feature extraction is carried out by deformable attention-centered residual network 50 (DARNet-50), and finally, the classification is performed using butterfly-optimized Bi-directional long short-term memory (BOBLSTM). The experimental outcomes showed that the proposed system achieves 99.76% accuracy, which is better than the existing related schemes. [ABSTRACT FROM AUTHOR]

Globally, heart disease is the primary cause of death. Early detection of this disease enables cardiologists to make more accurate judgments regarding the health of their patients. Due to machine learning's ability to identify patterns in data, its use in the medical industry has increased. Many heart disease prediction models have been developed by various researchers utilizing machine learning techniques (MLTs). The performance of MLTs on heart disease prediction may vary for different accuracy measures. Thus, the choice of the appropriate machine-learning technique for heart disease prediction is a challenging task. This paper proposes a multi-criteria decision-making (MCDM)-based method to evaluate the MLTs for heart disease prediction considering various performance measures taken into account altogether. The proposed approach uses the concept of a combined compromise solution (CoCoSo)- an MCDM method. For validation of the proposed approach, an experimental study was conducted to evaluate the performance of fifteen machine learning techniques for predicting heart disease over three heart disease datasets considering six performance measures taken into account altogether. Results show that the logistic regression and support vector machine are recommended as the most suitable MLTs for heart disease prediction modeling with respect to six performance measures considered simultaneously. [ABSTRACT FROM AUTHOR]

In the current industry, quality inspection in semiconductor manufacturing is of immense significance. Significant achievements have been made in fault diagnosis in fabricated semiconductor wafer manufacturing due to the development of machine learning. Since real-time intermediate signals are non-linear and time-varying, the signals undergo various distortions due to changes in equipment, material, and process. This leads to a drastic change in information in intermediate signals. This paper presents a fault diagnosis model for semiconductor manufacturing processes using a generative adversarial network (GAN). The study aims to address the challenges associated with efficient and accurate fault identification in these complex processes. Our approach involves the extraction of relevant components, development of a paired generator model, and implementation of a deep convolutional neural network. Experimental evaluations were conducted using a comprehensive dataset and compared against six existing models. The results demonstrate the superiority of our proposed model, showcasing higher accuracy, specificity, and sensitivity across various shift tasks. This research contributes to the field by introducing a novel approach for fault diagnosis, paving the way for improved process control and product quality in semiconductor manufacturing. Future work will focus on further optimizing the model and extending its applicability to other manufacturing domains. [ABSTRACT FROM AUTHOR]

PCB defect detection aims to identify the presence of gaps, open circuits, short circuits, and other defects in the PCB boards produced in the industry. Designing effective deep learning algorithms is crucial to finding a solution. Previously proposed PCB defect detection algorithms are limited in detecting tiny objects in high-density. Directly applying previous models to tackle PCB defect detection tasks will cause serious issues, such as missed detection and false detection. In this paper, we present a detection algorithm for tiny PCB defect targets in high-density regions to solve the above-mentioned problems. We firstly propose a detection head to detect tiny objects. Then, we design a four-channel feature fusion mechanism to fuse four different scale features and add an attention mechanism to find the attention region in scenarios with dense objects. Finally, we achieved accurate detection of tiny targets in high-density areas. Experiments were performed on the publicly available PCB defect dataset from Peking University. Our mAP@.5:.95 achieves 48.6%, while mAP@0.5 exceeds 90%. Compared with YOLOX and YOLOv5, our improved model can better localize tiny objects in high-density scenes. The experimental results certify that our model can obtain higher performance in comparison with the baseline and the state of the art. [ABSTRACT FROM AUTHOR]

Cyber-physical systems (CPS) play a pivotal role in various critical applications, ranging from industrial automation to healthcare monitoring. Ensuring the reliability and accuracy of sensor data within these systems is of paramount importance. This research paper presents a novel approach for enhancing fault detection in sensor data within a cyber-physical system through the integration of machine learning algorithms. Specifically, a hybrid ensemble methodology is proposed, combining the strengths of AdaBoost and Random Forest with Rocchio's algorithm, to achieve robust and accurate fault detection. The proposed approach operates in two phases. In the first phase, AdaBoost and Random Forest classifiers are trained on a diverse dataset containing normal and faulty sensor data to develop individual base models. AdaBoost emphasizes misclassified instances, while Random Forest focuses on capturing complex interactions within the data. In the second phase, the outputs of these base models are fused using Rocchio's algorithm, which exploits the similarities between faulty instances to improve fault detection accuracy. Comparative analyses are conducted against individual classifiers and other ensemble methods to validate the effectiveness of the hybrid approach. The results demonstrate that the proposed approach achieves superior fault detection rates. Additionally, the integration of Rocchio's algorithm significantly contributes to the refinement of the fault detection process, effectively leveraging the strengths of AdaBoost and Random Forest. In conclusion, this research offers a comprehensive solution to enhance fault detection capabilities in cyber-physical systems by introducing a novel ensemble framework. By synergistically combining AdaBoost, Random Forest, and Rocchio's algorithm, the proposed methodology provides a robust mechanism for accurately identifying sensor data anomalies, thus bolstering the reliability and performance of cyber-physical systems across a multitude of critical applications. [ABSTRACT FROM AUTHOR]

Offloading strategies in mobile edge computing are hot research, whereas, existing offloading strategies at the edge hard handle the issues of multi-user intensive task scheduling, resulting in the poor utilization of network resource. Therefore, this makes the quality of experience for end users far from satisfactory. To address this, this paper proposes a novel joint offloading strategy consisting of the back propagation neural network and the genetic algorithm. Firstly, using the genetic algorithm optimizes the learning error of the back propagation neural network, and then energy consumption in the system and response delay are jointly optimized by the back propagation neural network. Under long-term total overhead-cost constraints, the joint strategy can achieve the search of the optimal solutions to generate superior calculated offloading results. Unlike those approaches devoting into reducing response delay only for end users, this work takes account into the total overhead-cost in the system thereby affording more efficient for application service providers. Multiple simulation results indicate that the proposed strategy can not only reduce the average response delay of the mobile edge computing system, but also remain a low average energy consumption. [ABSTRACT FROM AUTHOR]

The use of mobile devices has contributed greatly to the expansion of Human Activity Recognition (HAR) studies in recent years. Researchers find it attractive because of its versatility, low cost, compact size, ease of usage, and wide range of possible applications. Conventional, biological, and control-based systems are just some of the methods that have been created for humanoid robot movement in recent years. This article specifically targeted improvement in the proposed method, which is different from previous papers. This is being done with the use of the publicly available Human Activity Gait (HAG) data set, which documents a wide range of different types of activities. IMU sensors were used to collect this data set. Several experiments were conducted using different machine-learning strategies, each with its own set of hyper-parameters, to determine how best to utilize these data. In our proposed model Cuckoo Search Optimization is being used for optimum feature selection. On this data set, we have tested a number of machine learning models, including LR, KNN, DT, and proposed CSOEM (Cuckoo Search-Based Optimized Ensemble Model). The simulation suggests that the proposed model CSOEM achieves an impressive accuracy of 98%. This CSOEM is built by combining the feature selection strategy of Cuckoo Search Optimizations with the ensembling of the LR, KNN, and DT. [ABSTRACT FROM AUTHOR]

Extreme learning machine (ELM) has received increasingly more attention because of its high efficiency and ease of implementation. However, the existing ELM algorithms generally suffer from the drawbacks of noise sensitivity and poor robustness. Therefore, we combine the advantages of twin hyperplanes with the fast speed of ELM, and then introduce the characteristics of heteroscedastic Gaussian noise. In this paper, a new regressor is proposed, which is called twin extreme learning machine based on heteroskedastic Gaussian noise (TELM-HGN). In addition, the augmented Lagrange multiplier method is introduced to optimize and solve the presented model. Finally, a significant number of experiments were conducted on different data-sets including real wind-speed data, Boston housing price dataset and stock dataset. Experimental results show that the proposed algorithms not only inherits most of the merits of the original ELM, but also has more stable and reliable generalization performance and more accurate prediction results. These applications demonstrate the correctness and effectiveness of the proposed model. [ABSTRACT FROM AUTHOR]

Credit scoring is a typical example of imbalanced classification, which poses a challenge to conventional machine learning algorithms and statistical classifiers when attempting to accurately predict outcomes for defaulting customers. In this paper, we propose a credit scoring classifier called Decision Tree Ensemble model (DTE). This model effectively addresses the challenge of imbalanced data and identifies significant features that influence the likelihood of credit status. An experiment demonstrates that DTE exhibits superior performance metrics in comparison to well-known based-tree ensemble classifiers such as Bagging, Random Forest, and AdaBoost, particularly when integrated with resampling techniques for handling imbalanced data. [ABSTRACT FROM AUTHOR]

Class imbalance problem (CIP) exists when the class distribution is not uniform. Many real-world scenarios face CIP which attracted the researcher's attention to this problem. Training machine learning (ML) models with class imbalanced datasets is a challenging problem. Ensemble methods in ML involve training multiple classifiers, combining or averaging their predictions to come to a final prediction. Specifically designed ensemble-based methods can overcome the difficulty faced by traditional classifiers and can handle the CIP. The performance of 19 ensemble methods for 44 unbalanced datasets is assessed in this paper in order to observe the effects of the class imbalance ratio (CIR). For performance evaluation, we divide these datasets into three categories, i.e., Slightly Imbalance (SI), Moderately Imbalance (MI) and Highly Imbalance (HI) based on CIR. With the proposed perspective, we observe that different ensemble methods perform well in different categories suggesting that the percentage of minority or majority class could be a criterion for the selection of ensemble methods for class imbalance datasets. Moreover, visual representations and different non-parametric statistical tests are also used to have more reliable results. [ABSTRACT FROM AUTHOR]

Machine learning (ML) has been applied in civil engineering to predict the compressive strength of concrete with high accuracy. In this paper, five boosting ensemble algorithms, i.e., XGBoost, AdaBoost, GBDT, LightGBM, and CatBoost, were used to predict the compressive strength of high-performance concrete (HPC). The models were evaluated using performance indicators such as R2, root mean square error (RMSE), and mean absolute error (MAE). The results showed that the CatBoost model had the highest accuracy with a R2 (0.970) and a RMSE (2.916). The prediction accuracy of the model was increased through hyperparameter optimization, which got a higher with a R2 (0.975) and a RMSE (2.863). Meanwhile, the SHapley Additive exPlanations (SHAP) method was used to explain the output results of the optimal model (CatBoost), which generated explainable insights that further revealed the complex relationship between the prediction model parameters. The results showed that AGE, W/B, and W/C had the most impact on high-performance concrete compressive strength (HPCCS) prediction, which was similar to the results of sensitivity analysis. This study provided a theoretical basis and technical guidance for developing the mix design of a new high-performance concrete (HPC) system. In the future, the interpretable results of the model output should be iteratively checked and validated in the actual laboratory in order to provide guidance for engineering practice. [ABSTRACT FROM AUTHOR]

This paper disseminates an extra dimension of substantial analysis demonstrating the trade-offs between the performance of Parametric (P) and Non-Parametric (NP) classification algorithms when applied to classify faults occurring in pneumatic actuators. Owing to the criticality of the actuator failures, classifying faults accurately may lead to robust fault tolerant models. In most cases, when applying machine learning, the choice of existing classifier algorithms for an application is random. This work, addresses the issue and quantitatively supports the selection of appropriate algorithm for non-parametric datasets. For the case study, popular parametric classification algorithms namely: Naïve Bayes (NB), Logistic Regression (LR), Linear Discriminant Analysis (LDA), Perceptron (PER) and non-parametric algorithms namely: Multi-Layer Perceptron (MLP), k Nearest Neighbor (kNN), Support Vector Machine (SVM), Decision Tree (DT) and Random Forest (RF) are implemented over a non-parametric, imbalanced synthetic dataset of a benchmark actuator process. Upon using parametric classifiers, severe adultery in results is witnessed which misleads the interpretation towards the accuracy of the model. Experimentally, about 20% improvement in accuracy is obtained on using non-parametric classifiers over the parametric ones. The robustness of the models is evaluated by inducing label noise varying between 5% to 20%. Triptych analysis is applied to discuss the interpretability of each machine learning model. The trade-offs in choice and performance of algorithms and the evaluating metrics for each estimator are analyzed both quantitatively and qualitatively. For a more cogent reasoning through validation, the results obtained for the synthetic dataset are compared against the industrial dataset of the pneumatic actuator of the sugar refinery, Development and Application of Methods for Actuator Diagnosis in Industrial Control Systems (DAMADICS). The efficiency of non-parametric classifiers for the pneumatic actuator dataset is well proved. [ABSTRACT FROM AUTHOR]