Search

Herein, the challenge of accurately classifying the manufacturing origin of printing paper, including continent, country, and specific product, was addressed. One-dimensional convolutional neural network (1D CNN) models trained on infrared (IR) spectrum data acquired from printing paper samples were used for the task. The preprocessing of the IR spectra through a second-derivative transformation and the restriction of the spectral range to 1800 to 1200 cm-1 improved the classification performance of the model. The outcomes were highly promising. Models trained on second-derivative IR spectra in the 1800 to 1200-cm-1 range exhibited perfect classification for the manufacturing continent and country, with an impressive F1 score of 0.980 for product classification. Notably, the developed 1D CNN model outperformed traditional machine learning classifiers, such as support vector machines and feed-forward neural networks. In addition, the application of data point attribution enhanced the transparency of the decision-making process of the model, offering insights into the spectral patterns that affect classification. This study makes a considerable contribution to printing paper classification, with potential implications for accurate origin identification in various fields. [ABSTRACT FROM AUTHOR]

The evaluation and classification of chemical properties in different copypaper products could significantly help address document forgery. This study analyzes the feasibility of utilizing infrared spectroscopy in conjunction with machine learning algorithms for classifying copy-paper products. A dataset comprising 140 infrared spectra of copy-paper samples was collected. The classification models employed in this study include partial least squares-discriminant analysis, support vector machine, and K-nearest neighbors. The key findings indicate that a classification model based on the use of attenuated-total-reflection infrared spectroscopy demonstrated good performance, highlighting its potential as a valuable tool in accurately classifying paper products and ensuring assisting in solving criminal cases involving document forgery. [ABSTRACT FROM AUTHOR]

Handmade paper is a major carrier and restoration material of traditional Chinese ancient books, calligraphies, and paintings. In this study, we carried out a Raman spectroscopy analysis of 18 types of handmade paper samples. The main components of the handmade paper were cellulose and lignin, according to the wavenumber and Raman vibration assignment. We divided its Raman spectrum into eight subbands. Five machine learning models were employed: principal component analysis (PCA), partial least squares (PLS), support vector machine (SVM), k‐nearest neighbors (KNN), and random forest (RF). The Raman spectral data were normalized, and the fluorescence envelope was subtracted using the airPLS algorithm to obtain four types of data, raw, normalized, defluorescence, and fluorescence data. An RF variable importance analysis of data processing showed that data normalization eliminated the intensity differences of fluorescence signals caused by lignin, which contained important information of raw materials and papermaking technology, let alone the data defluorescence. The data processing also reduced the importance of the average variables in almost all spectral bands. Nevertheless, the data processing is worthwhile because it significantly improves the accuracy of machine learning, and the information loss does not affect the prediction. Using the machine learning models of PCA, PLS, and SVM combined with linear regression (LR), KNN, and RF, the classification and prediction of handmade paper samples were realized. For almost all processed data, including the fluorescence data, PCA‐LR had the highest classification and prediction accuracy (R2 = 1) in almost all spectral bands. PLS‐LR and SVM‐LR had the second‐highest accuracies (R2 = 0.4–0.9), whereas KNN and RF had the lowest accuracies (R2 = 0.1–0.4) for full band spectral data. Our results suggest that the abundant information contained in Raman spectroscopy combined with powerful machine learning models could inspire further studies on handmade paper and related cultural relics. [ABSTRACT FROM AUTHOR]

The paper reports the results of a comparative assessment concerned with the effectiveness of identifying the basic forms of partial discharges (PD) measured by the acoustic emission technique (AE), carried out by application of selected machine learning methods. As part of the re-search, the identification involved AE signals registered in laboratory conditions for eight basic classes of PDs that occur in paper-oil insulation systems of high-voltage power equipment. On the basis of acoustic signals emitted by PDs and by application of the frequency descriptor that took the form of a signal power density spectrum (PSD), the assessment involved the possibility of identifying individual types of PD by the analyzed classification algorithms. As part of the research, the results obtained with the use of five independent classification mechanisms were analyzed, namely: k-Nearest Neighbors method (kNN), Naive Bayes Classification, Support Vector Machine (SVM), Random Forests and Probabilistic Neural Network (PNN). The best results were achieved using the SVM classification tuned with polynomial core, which obtained 100% accuracy. Similar results were achieved with the kNN classifier. Random Forests and Naïve Bayes obtained high accuracy over 97%. Throughout the study, identification algorithms with the highest effectiveness in identifying specific forms of PD were established. [ABSTRACT FROM AUTHOR]

[Display omitted] • The 2-D correlation methods do not require external perturbation variables. • They are pure mathematical methods that utilize the tensor product of spectral data. • The R2 values of KNN and RF for TDACM are close to 1, indicating nearly 100% improvement. The paper introduces two new methods, namely the cross correlation method (CCM) and two-dimensional correlation method (TDCM), for preprocessing Raman spectroscopy data for analyzing Chinese handmade paper samples. CCM expands the spectral dimension from 1 × N to 1 × 2 N - 1 by taking cross-correlation between two spectral data of the same category. TDCM includes two-dimensional synchronous correlation method (TDSCM) and two-dimensional asynchronous correlation method (TDACM), which expand the spectral dimension from 1 × N to N × N by taking tensor products between two spectral data and between one spectral data and the Hilbert transformation of the other spectral data of the same category, respectively. The experimental data were preprocessed using baseline removal, CCM, TDSCM, and TDACM methods. Four machine learning models were employed to evaluate the effects of these methods: principal component analysis (PCA) combined with linear regression (LR), support vector machine (SVM) combined with LR, k-Nearest Neighbors (KNN), and random forest (RF). The results show that the R-squared values for the PCA model were nearly 1 for all types of data, indicating high accuracy. However, for SVM-LR, KNN, and RF models, the R-squared values were sorted in the order of raw data, baseline removal data, CCM, TDSCM, and TDACM preprocessed data. The R-squared values of KNN and RF machine learning models for TDACM preprocessed data were approaching 1, indicating that the accuracy of machine learning was significantly improved by nearly 100%. This has led to a remarkable improvement in the accuracy of supervised models such as KNN and RF, bringing them closer to the level of unsupervised models such as PCA. [ABSTRACT FROM AUTHOR]

Digital technologies sustain today's world. Every part of the world is working towards digital technologies, which none of us can eliminate. Enormous growth is achieved only by unexpected acceleration by digital technologies, including the Internet of Everything (IoE), Artificial Neural Networks (ANN), Machine Learning (ML), Internet of Things (IoT), Artificial Intelligence (AI), Deep Learning (DL), and many more. These technologies started occupying all the engineering sectors, including manufacturing. This paper focuses on tribology analysis related to manufacturing concerning various digital manufacturing technologies. The paper narration includes Tribology using digital technologies wherein the journals and patent landscape analysis abet them. In trend, Tribology utilizes all these technologies today and envisages its growth with the predominant technological invention in the border view. The survey of various literature reveals that only three digital technologies, including AI, ML, and ANN, are used by tribologists around the globe. Other Technologies like Evolutionary Algorithm (EA), Support Vector Machine (SVM), and Adaptive Neuro-Fuzzy Interference Systems (ANFIS) are not used predominantly. [ABSTRACT FROM AUTHOR]

It is critical to have an accurate prediction of surface roughness (Sa) in order to improve grinding productivity, reduce costs, and minimize the period of time required for trials and testing. Although many prediction methods have been developed, fewer studies have been conducted on the prediction of surface roughness in longitudinal ultrasonic vibration-assisted grinding (LUVAG). In this paper, a surface roughness prediction model algorithm based on ensemble learning of support vector machines (ELSVM) is proposed that can be used for surface roughness prediction of LUVAG alumina ceramics. This paper first details the development of the ELSVM surface roughness prediction model, which consists of four modules: the prepossessing module, the multi-algorithm regression module, the support vector machine algorithm (SVM) module, and the ensemble module. In addition, ELSVM was compared with four other machine learning methods based on experimental results for surface roughness prediction modeling. The error of ELSVM model was reduced by 6.3%, 7.9%, 8.9%, and 7.5%, respectively, compared to the individual prediction models such as I-AISPSO, I-AIS, SPSO, and KBaNN. Comparison results show that the ELSVM model has the lowest average ratio of Mean Absolute Error (MAE) for surface roughness prediction in LUVAG. • The artificial immune particle swarm optimization is improved. • The adaptive particle swarm optimization algorithm and the manual free algorithm are combined in parallel. • A surface roughness prediction model of support vector machine based on ensemble learning algorithm is proposed. • Longitudinal ultrasonic assisted grinding can reduce surface roughness. [ABSTRACT FROM AUTHOR]

Despite the complexity of thermodynamic models in predicting wax precipitation, they have not shown satisfactory results in the literature. This paper proposes the least-squares support vector machine optimized by the genetic algorithm to forecast wax precipitation based on the mole fractions, specific gravity, and temperature of crude oil samples. The genetic algorithm was used to prevent sticking in local optima in optimizing the parameters of the predictive model. A dataset of 88 experimental wax precipitation samples was used to evaluate the performance of the proposed method. The results revealed that the suggested algorithm could predict wax precipitation with an accuracy of 0.939 and 0.997 before and after sensitivity analysis, respectively. Furthermore, sensitivity analysis improved the Coefficient of Determination, Mean Squared Error, and Root Mean Squared Error from 0.939, 0.768, and 0.877 to 0.997, 0.041, and 0.202, respectively. The results were compared with the results of previous data-driven and mathematical models that showed the outperformance of the proposed method. The contribution of this paper can be summarized as demonstrating the ability of intelligent models to predict wax precipitation without a need for complex thermodynamic models. Also, it was shown that a proper feature selection could improve the model's performance. [ABSTRACT FROM AUTHOR]

While traveling, people need to utilize smart tourism service systems based on the Internet of Things (IoT) to enhance their journeys' convenience. However, existing IoT-based smart tourism service systems still possess certain shortcomings. In light of this, this paper delves into the integration of IoT and machine learning (ML) technologies to improve the design of smart tourism service systems and establish a platform for intelligent tourism services. Simulated datasets are employed to evaluate the performance and functionality of the smart tourism service system. The primary contributions, as inferred from the test results, are as follows: In area 1, the model achieves a congestion recognition rate of 92.6% with an error rate of only 1.5% in congestion judgment. In area 2, congestion is accurately identified 93.5% of the time, with a misjudgment rate of just 1.2%. In area 3, the model achieves a congestion identification rate of 94.2% along with a 1.3% misjudgment rate, effectively identifying congestion situations in scenic spots. When comparing the research and design system with the system based on the support vector machine (SVM) algorithm, the results demonstrate that the smart tourism service system designed in this paper, leveraging IoT technology and ML algorithms, achieves higher prediction accuracy than the SVM-based system. These findings can serve as a valuable guide for designing future smart tourism service systems. [ABSTRACT FROM AUTHOR]

In recent years, there has been a rapid increase in the application of machine learning methods about predicting the incidence of dengue fever. However, the predictive factors and models employed in different studies vary greatly. Hence, we conducted a systematic review to summarize machine learning methods and predictors in previous studies. We searched PubMed, ScienceDirect, and Web of Science databases for articles published up to July 2023. The selected papers included not only the forecast of dengue incidence but also machine learning methods. A total of 23 papers were included in this study. Predictive factors included meteorological factors (22, 95.7%), historical dengue data (14, 60.9%), environmental factors (4, 17.4%), socioeconomic factors (4, 17.4%), vector surveillance data (2, 8.7%), and internet search data (3, 13.0%). Among meteorological factors, temperature (20, 87.0%), rainfall (20, 87.0%), and relative humidity (14, 60.9%) were the most commonly used. We found that Support Vector Machine (SVM) (6, 26.1%), Long Short-Term Memory (LSTM) (5, 21.7%), Random Forest (RF) (4, 17.4%), Least Absolute Shrinkage and Selection Operator (LASSO) (2, 8.7%), ensemble model (2, 8.7%), and other models (4, 17.4%) were identified as the best models based on evaluation metrics used in each article. These results indicate that meteorological factors are important predictors that cannot be ignored and SVM and LSTM algorithms are the most commonly used models in dengue fever prediction with good predictive performance. This review will contribute to the development of more robust early dengue warning systems and promote the application of machine learning methods in predicting climate-related infectious diseases. [ABSTRACT FROM AUTHOR]

With the goal of "carbon peak and carbon neutrality," the need for environmentally friendly gases to replace SF6, a high greenhouse effect gas, is urgent. C4F7N, as an environmentally friendly gas with the greatest potential to replace SF6 as an arc extinguishing medium in circuit breakers, can be mixed with CO2 to greatly improve the shortcomings of its high liquefaction temperature, and the calculation of the physical parameters of the mixed gas plasma is a prerequisite for the computational simulation of the arc process in the opening of circuit breakers. Because solving the physical parameters is expensive, based on the system of differential equations, this paper adopts several machine learning algorithms by mining the relationship between the data using the known physical parameter data to predict the results of the physical parameters to be solved under certain conditions, which greatly reduces the cost of computation. The machine learning algorithms used in this paper are K-nearest-neighbor regression, decision tree, random forest, support vector machine, and gradient boosting regression, of which for the support vector machine, hyperparameters find it difficult to determine the problem of optimization using the gray wolf algorithm. The prediction results of several algorithms show that they are more accurate and that the problem can be solved better by using the method of machine learning. Finally, the comparison results show that the support vector machine exhibits better performance in most cases and that the gray wolf algorithm can make the results of the support vector machine more accurate. [ABSTRACT FROM AUTHOR]

Spectral data describing product samples are typically composed of a large number of noisy and irrelevant wavelengths that tends to undermine the performance of multivariate predictive techniques. This paper proposes a two‐phase framework that integrates a preselection wavelength step oriented by wavelength clustering to a wrapper‐based strategy. The first phase performs a pruning process in the data that removes the less informative wavelengths relying on the spectral clustering, a technique deemed suitable to the Fourier transform infrared (FTIR) spectroscopy and near‐infrared (NIR) spectroscopy data at hand. The preselected wavelengths undergo a second phase of selection efforts based on the combination of different wavelength importance indices (i.e., Bhattacharyya distance, Chi‐square, ReliefF, and Gini) and classification techniques (i.e., support vector machine, k‐nearest neighbors, and random forest). When applied to 11 FTIR datasets from different domains, the recommended combination of importance index and classifier increased the average accuracy by 6.37% (from 0.863 to 0.918), while retaining average 3.84% of the original spectra. The framework also improved the selection process regarding computational time. This paper introduces a two‐phase framework merging wavelength preselection through clustering and a wrapper strategy. Initial spectral clustering eliminates less informative wavelengths. Subsequently, diverse wavelength importance indices and classification methods are integrated. Applied to 11 spectral datasets, the proposed combination (spectral clustering [SC]‐random forest [RF]+Gini [GI]) enhances average accuracy by 6.37%, retaining 3.84% of the original spectra, and reduces computational time. [ABSTRACT FROM AUTHOR]

This paper presents an intelligent healthcare framework by incorporating modern computing technologies like machine learning and deep learning. The sole motivation of this paper is to predict diabetes status intelligently so that patients can be made aware of their diabetes status regularly. A novel ensemble machine learning-based diabetes prediction framework, namely "iDP", has been proposed in this paper. Six different machine learning approaches have been used for the iDP framework, namely random forest, decision tree, neural network, AdaBoost, support vector machine, and XGBoost. Training and testing of ensemble modeling have been performed based on these learning techniques. A comprehensive preliminary data analysis and screening of statistical analysis have been systematically demonstrated in this paper. The recursive feature elimination and fivefold cross-validation methods have been used to select the best model. All experiments have been performed using R-Studio 1.2.5 with the help of the Rattle library 5.4.0. The preliminary data analytic and Pearson correlation coefficient values have been computed to verify the linearity relationship among the data. Results have been reported in eight performance metrics, including accuracy, specificity, sensitivity, area under curve, area under convex hull, minimum error rate, minimum weighted loss, and precision. The proposed iDP framework improves the results on different aspects in order to compare them with individual learning approaches. Despite this, a comparative performance analysis of the iDP framework has also been performed with state-of-the-art prevailing models. As per experiment, the iDP framework gives better results in most cases, like accuracy: 95.26%, AUC: 91.15%, sensitivity: 96.81%, specificity: 97.72% and precision: 90.72%. [ABSTRACT FROM AUTHOR]

Borehole data are essential for conducting precise urban geological surveys and large-scale geological investigations. Traditionally, explicit modelling and implicit modelling have been the primary methods for visualizing borehole data and constructing 3D geological models. However, explicit modelling requires substantial manual labour, while implicit modelling faces problems related to uncertainty analysis. Recently, machine learning approaches have emerged as effective solutions for addressing these issues in 3D geological modelling. Nevertheless, the use of machine learning methods for constructing 3D geological models is often limited by insufficient training data. In this paper, we propose the semi-supervised deep learning using pseudo-labels (SDLP) algorithm to overcome the issue of insufficient training data. Specifically, we construct the pseudo-labels in the training dataset using the triangular irregular network (TIN) method. A 3D geological model is constructed using borehole data obtained from a real building engineering project in Shenyang, Liaoning Province, NE China. Then, we compare the results of the 3D geological model constructed based on SDLP with those constructed by a support vector machine (SVM) method and an implicit Hermite radial basis function (HRBF) modelling method. Compared to the 3D geological models constructed using the HRBF algorithm and the SVM algorithm, the 3D geological model constructed based on the SDLP algorithm better conforms to the sedimentation patterns of the region. The findings demonstrate that our proposed method effectively resolves the issues of insufficient training data when using machine learning methods and the inability to perform uncertainty analysis when using the implicit method. In conclusion, the semi-supervised deep learning method with pseudo-labelling proposed in this paper provides a solution for 3D geological modelling in engineering project areas with borehole data. [ABSTRACT FROM AUTHOR]

In the food industry, the increasing use of automatic processes in the production line is contributing to the higher probability of finding contaminants inside food packages. Detecting these contaminants before sending the products to market has become a critical necessity. This paper presents a pioneering real-time system for detecting contaminants within food and beverage products by integrating microwave (MW) sensing technology with machine learning (ML) tools. Considering the prevalence of water and oil as primary components in many food and beverage items, the proposed technique is applied to both media. The approach involves a thorough examination of the MW sensing system, from selecting appropriate frequency bands to characterizing the antenna in its near-field region. The process culminates in the collection of scattering parameters to create the datasets, followed by classification using the Support Vector Machine (SVM) learning algorithm. Binary and multiclass classifications are performed on two types of datasets, including those with complex numbers and amplitude data only. High accuracy is achieved for both water-based and oil-based products. [ABSTRACT FROM AUTHOR]

The development of fragility curves is an important step in seismic risk assessment within the scope of performance‐based earthquake engineering. The goal of this work is to use machine learning methods (regression‐based tools) to forecast the large‐span precast parking structural responses and fragility curves. This study proposes five predicting models based on machine learning to evaluate the seismic performance of the large‐span precast parking structures, including: neural networks, genetic algorithm‐based neural networks, support vector machine, decision tree and random forest. A database that includes 453 numerical synthetic results was used to train and test the machine learning models. The seismic performance of large‐span precast parking structures were predicted using the constructed machine learning models. Finally, the sensitivity analysis of input parameters was conducted. From this paper we can conclude that: (1) the genetic optimization‐based neural networks' predicting model has the most accurate predictive ability for seismic fragility estimation and (2) the structural responses and the fragility curves of parking structures are related to the differences of the stiffness of the connectors and the number of floors, of which the stiffness of the connectors should be given special attention. [ABSTRACT FROM AUTHOR]

This paper presents a decision-making approach grounded in rough set theory and evidential reasoning to address the demand for expert decision-making in greenhouse environmental control systems. Furthermore, a decision-making model is developed by integrating the D-S evidence theory with an expert knowledge table for greenhouse environmental control systems. The model's reasoning process encompasses continuous attribute discretization, expert decision table formation, attribute reduction, and evidence combination reasoning. Firstly, the fuzzy C-means clustering algorithm is employed to discretize the original environmental data and cluster it. Subsequently, an attribute reduction algorithm based on information entropy is utilized to optimize the decision table by eliminating unnecessary conditional attributes in expert knowledge. The reduced indicators are then combined using evidential theory. Finally, suitable greenhouse control methods are determined by the confidence decision proposed by the D-S evidence theory. To assess the efficacy of this intelligent decision-making algorithm based on rough set and D-S evidence theory, its performance is compared with traditional SVM algorithms and small-shot learning algorithms. The results indicate that this proposed method significantly enhances the credibility of control decision-making processes, with an average running time of 0.002378s for the fusion decision algorithm and 0.017939s for the support vector machine (SVM) algorithm, respectively. The SVM accuracy rate after testing and training stands at 90.34%. Moreover, retraining based on information entropy attribute reduction leads to a correct decision rate increase of up to 100%. This method notably improves confidence levels in decision-making processes while reducing uncertainty and demonstrates reliability when applied in making decisions regarding greenhouse environments. [ABSTRACT FROM AUTHOR]

The Internet of Things (IoTs) is a complex and large network of all kinds of equipment and things that covers various areas such as military networks, industrial networks, smart urban infrastructures, education, and many other areas, high volume of traffic, and the growing number of connected equipment. to these networks has made intrusion detection in these networks a challenging issue; Therefore, protecting these networks from various attacks is of particular importance and can be established through planning and establishing effective security controls. One of these important and effective methods of security control is the use of an intrusion detection system (IDS). Due to the ability of machine learning and deep learning methods to learn from existing real examples, they are used to prevent, predict, and intelligently and quickly track complex and unknown future examples. The most important ability and feature of these methods are to detect and predict new attacks, which in many cases are mutated or inspired by previous attacks. Therefore, IoTs control and security systems use and develop new methods in creating safe and intelligent communication between their devices and equipment, which are activated using advanced deep learning and machine methods. Also, the success and advancements of deep learning methods in various fields and fields with extensive data have made activists in the field of the internet interested in these methods. In this paper, to solve the mentioned problems and challenges, we also present a new and effective method of detection based on long short-term memory (LSTM)–recurrent neural network (RNN) and kernel principal component analysis (PCA). To achieve data preprocessing, high accuracy detection rate, feature extraction, and attack detection is embedded in an end-to-end or global detection method. We have used the NSL-KDD dataset to evaluate the results and check the presented idea. The results of our experiments and simulations show that the proposed IDS-LSTM attack detection strategy and idea has better performance than several detection and prediction strategies that use neural networks, support vector machines (SVM). [ABSTRACT FROM AUTHOR]

With the rapid development of quantum machine learning (QML), quantum convolutional neural networks (QCNN) have been proposed and shown advantages in classification problems. An intrusion detection system (IDS) based on the QML method is proven to have higher accuracy than IDS based on the traditional machine learning (ML) method. However, the multiple convolution pooling operations of QCNN will cause the loss of valuable data features, resulting in a large error in the final measurement results. In this paper, we design an IDS model of QCNN based on a variational quantum neural network (VQNN), which can effectively reduce data feature loss and improve detection accuracy. We compare this model with traditional ML models such as artificial neural network (ANN), logistic regression (LR), K-nearest neighbor (KNN) algorithm, support vector machine (SVM), and decision tree (DT). Experiment results show that the accuracy of our proposed model is 94.51%, which is higher than other classical IDS models. [ABSTRACT FROM AUTHOR]

In the past decades, a variety of learning-based algorithms have been emerged to try to explore a better solution for stereo matching by leveraging various machine learning algorithms. For enriching learning-based stereo matching algorithm's methodologies, we cast the disparity estimation as a regression problem by leveraging Structured Support Vector Machine (SSVM) in this paper. There are three categories of features have been extracted on account of disparity cues for training the SSVM. Particularly, one of the three feature is named as 'Coarse-to-Fine PatchMatch Filtering', which effectively exploits region and pixel disparity cues. For attaining region disparity cues, we adopt MeshStereo and MeshStereo with Cross-Scale algorithms; for attaining pixel disparity cues, PatchMatch and Cross-Scale PatchMatch stereo matching algorithms are utilized. Performance evaluations on Middlebury v.2 and v.3 stereo data sets demonstrate that the proposed algorithm reveals comparable accuracy with other challenging learning-based ones. It is worth pointing out that our proposal performs over several orders of magnitude faster than others on training time. [ABSTRACT FROM AUTHOR]

The classification of land use and land cover (LULC) from remotely sensed imagery in semi-arid Mediterranean areas is a challenging task due to the fragmentation of the landscape and the diversity of spatial patterns. Recently, the use of deep learning (DL) for image analysis has increased compared to commonly used machine learning (ML) methods. This paper compares the performance of four algorithms, Random Forest (RF), Support Vector Machine (SVM), Multilayer Perceptron (MLP) and Convolutional Network (CNN), using multi-source data, applying an exhaustive optimisation process of the hyperparameters. The usual approach in the optimisation process of a LULC classification model is to keep the best model in terms of accuracy without analysing the rest of the results. In this study, we have analysed such results, discovering noteworthy patterns in a space defined by the mean and standard deviation of the validation accuracy estimated in a 10-fold cross validation (CV). The point distributions in such a space do not appear to be completely random, but show clusters of points that facilitate the discovery of hyperparameter values that tend to increase the mean accuracy and decrease its standard deviation. RF is not the most accurate model, but it is the less sensitive to changes in hyperparameters. Neural Networks, tend to increase commission and omission errors of the less represented classes because their optimisation lead the model to learn better the most frequent classes. On the other hand, RF and MLP prediction layers are the most accurate from a general qualitative point of view. [ABSTRACT FROM AUTHOR]

The current paper presents helical gearbox defect detection models built from raw vibration signals measured using a triaxial accelerometer. Gear faults, such as localized pitting, localized wear on helical pinion tooth flanks, and low lubricant level, are under observation for three rotating velocities of the actuator and three load levels at the speed reducer output. The emphasis is on the strong connection between the gear faults and the fundamental meshing frequency GMF, its harmonics, and the sidebands found in the vibration spectrum as an effect of the amplitude modulation (AM) and phase modulation (PM). Several sets of features representing powers on selected frequency bands or/and associated peak amplitudes from the vibration spectrum, and also, for comparison, time-domain and frequency-domain statistical feature sets, are proposed as predictors in the defect detection task. The best performing detection model, with a testing accuracy of 99.73%, is based on SVM (Support Vector Machine) with a cubic kernel, and the features used are the band powers associated with six GMF harmonics and two sideband pairs for all three accelerometer axes, regardless of the rotation velocities and the load levels. [ABSTRACT FROM AUTHOR]

Diabetes is a persistent metabolic disorder linked to elevated levels of blood glucose, commonly referred to as blood sugar. This condition can have detrimental effects on the heart, blood vessels, eyes, kidneys, and nerves as time passes. It is a chronic ailment that arises when the body fails to produce enough insulin or is unable to effectively use the insulin it produces. When diabetes is not properly managed, it often leads to hyperglycemia, a condition characterized by elevated blood sugar levels or impaired glucose tolerance. This can result in significant harm to various body systems, including the nerves and blood vessels. In this paper, we propose a multiclass diabetes mellitus detection and classification approach using an extremely imbalanced Laboratory of Medical City Hospital data dynamics. We also formulate a new dataset that is moderately imbalanced based on the Laboratory of Medical City Hospital data dynamics. To correctly identify the multiclass diabetes mellitus, we employ three machine learning classifiers namely support vector machine, logistic regression, and k-nearest neighbor. We also focus on dimensionality reduction (feature selection—filter, wrapper, and embedded method) to prune the unnecessary features and to scale up the classification performance. To optimize the classification performance of classifiers, we tune the model by hyperparameter optimization with 10-fold grid search cross-validation. In the case of the original extremely imbalanced dataset with 70:30 partition and support vector machine classifier, we achieved maximum accuracy of 0.964, precision of 0.968, recall of 0.964, F1-score of 0.962, Cohen kappa of 0.835, and AUC of 0.99 by using top 4 feature according to filter method. By using the top 9 features according to wrapper-based sequential feature selection, the k-nearest neighbor provides an accuracy of 0.935 and 1.0 for the other performance metrics. For our created moderately imbalanced dataset with an 80:20 partition, the SVM classifier achieves a maximum accuracy of 0.938, and 1.0 for other performance metrics. For the multiclass diabetes mellitus detection and classification, our experiments outperformed conducted research based on the Laboratory of Medical City Hospital data dynamics. [ABSTRACT FROM AUTHOR]

In shallow water, Sentinel-2 multispectral imagery has only four visible bands and limited quantization levels, which easily leads to the occurrence of the same spectral profile but different depth (SSPBDD) phenomenon, resulting in a one-to-many relationship between water depth and spectral profile. Investigating the impact of this relationship on water depth inversion models is the main objective of this paper. The Stumpf model and three machine learning models (Random Forest, Support Vector Machine, and Mixture Density Network) are employed, and the performance of these models is analysed based on the spatial distribution of the training dataset and the input information composition of these models. The results show that the root mean square errors (RMSEs) of the depth inversion of Random Forest and Support Vector Machine are significantly affected by the spatial distribution of the training dataset, while minimal effects are observed for the Stumpf model and the Mixture Density Network model. The SSPBDD phenomenon is widespread in Sentinel-2 images at all depths, particularly between 5 m and 15 m, with most of the depth maximum difference of the SSPBDD pixels ranging from 0 to 5 m. The SSPBDDs phenomenon can significantly reduce the inversion accuracy of any model. The number and the depth maximum difference of the SSPBDDs pixels are the main influencing factors. However, by increasing the visible spectral information and the spatial neighbourhood information in the input layer of machine learning models, the inversion accuracy and stability of the models can be improved to a certain extent. Among the models, the Mixture Density Network achieves the best inversion accuracy and stability. [ABSTRACT FROM AUTHOR]

Machine learning models are used to identify crops in satellite data, which achieve high classification accuracy but do not necessarily have a high degree of transferability to new regions. This paper investigates the use of machine learning models for crop classification using Sentinel-2 imagery. It proposes a new testing methodology that systematically analyzes the quality of the spatial transfer of trained models. In this study, the classification results of Random Forest (RF), eXtreme Gradient Boosting (XGBoost), Stochastic Gradient Descent (SGD), Multilayer Perceptron (MLP), Support Vector Machines (SVM), and a Majority Voting of all models and their spatial transferability are assessed. The proposed testing methodology comprises 18 test scenarios to investigate phenological, temporal, spatial, and quantitative (quantitative regarding available training data) influences. Results show that the model accuracies tend to decrease with increasing time due to the differences in phenological phases in different regions, with a combined F1-score of 82% (XGBoost) when trained on a single day, 72% (XGBoost) when trained on the half-season, and 61% when trained over the entire growing season (Majority Voting). [ABSTRACT FROM AUTHOR]

We carry on a long term analysis for Bitcoin price, which is currently among the most renowned crypto assets available on markets other than Forex. In the last decade Bitcoin has been under spotlights among traders all world wide, both because of its nature of pseudo–currency and for the high volatility its price has frequently experienced. Considering that Bitcoin price has earned over five orders of magnitude since 2009, the interest of investors has been increasingly motivated by the necessity of accurately predicting its value, not to mention that a comparative analysis with other assets as silver and gold has been under investigation, too. This paper reports two approaches for a long term Bitcoin price prediction. The first one follows more standard paradigms from regression and least squares frameworks. Our main contribution in this regard fosters conclusions which are able to justify the cyclic performance of Bitcoin price, in terms of its Stock–to–Flow. Our second approach is definitely novel in the literature, and indicates guidelines for long term forecasts of Bitcoin price based on Machine Learning (ML) methods, with a specific reference to Support Vector Machines (SVMs). Both these approaches are inherently data–driven, and the second one does not require any of the assumptions typically needed by solvers for classic regression problems. [ABSTRACT FROM AUTHOR]

The heating of high-voltage isolating switches above 110 kV will cause serious safety accidents. To identify the heating faults of isolating switches accurately, this study uses natural language processing technology, knowledge graph (KG) technology and machine learning algorithm to mine the structured and unstructured mixed data. Firstly, based on bidirectional encoder representations (BERT) pre-training model, a bidirectional long short-term memory network and conditional random field model are introduced to identify entities related to high-voltage isolating switches and the thermal failures from the text data. Further, a convolutional neural network fusion attention mechanism model is leveraged to recognize the corresponding entity relationships from the text records. Then, the KGs of isolating switches and the heating faults are constructed, and a path ranking algorithm is proposed to deduce and identify the possible factors causing overheating on the KGs. Combined with the structured data, a support vector machine model based on focal loss function (FL-SVM) is proposed to recognize the heating faults of isolating switches. Experiments show that the performances of all six models used in this paper on the hybrid dataset are higher than those on the structured dataset. Such results suggest that joint text-structured data mining can compensate for insufficient structured data and thus, achieving a better heating failure recognition, especially for the infrequent malfunctions. Meanwhile, the proposed FL-SVM performs better than other models due to its excellent ability to solve the problem of imbalanced faults and normal samples. [ABSTRACT FROM AUTHOR]

To make wind power more competitive, it is necessary to reduce turbine downtime and reduce costs associated with wind turbine operation and maintenance (O&M). Incorporating machine learning in the development of condition-based predictive maintenance methodologies for wind turbines can enhance their efficiency and reliability. This paper presents a monitoring method that utilizes Density Based Support Vector Machines (DBSVM) and the evolutionary Fourier spectra of vibrations. This method allows for the smart monitoring of the function evolution of the turbine. A complex optimal function (FO) for 5-degree order has been developed that will be the boundary function of the DBSVM to be timely determined from the Fourier spectrum through the magnitude–frequency and place of the failure occurring in the wind turbine drivetrains. The trend of the failure was constructed with the maximal values of the optimal frequency function for both yesthe cases of the upwind and downwind parts of the gearbox. [ABSTRACT FROM AUTHOR]

The paper proposes the use of supervised machine learning (ML) methods for quickly predicting the seismic response of rocking systems when subjected to seismic excitations. Different supervised ML algorithms are discussed, while a relatively simple and a more sophisticated algorithm are examined in detail. Specifically, the two algorithms compared are the k-Nearest Neighbor (k-NN) and the Support Vector Machine (SVM). The performance of the ML models is demonstrated considering both sine pulses and different sets of natural ground motion records. The results are practically perfect for sine pulses, while accurate results were also obtained for the case of natural ground motions. The proposed ML-based tool allows to quickly assess the risk of damage for rocking systems, while it is also very important when a large number of rocking blocks have to be studied, e.g. in the case of a building's inventory. [ABSTRACT FROM AUTHOR]

It is important to implement detection and assessment of plant diseases based on remotely sensed data for disease monitoring and control. Hyperspectral data of healthy leaves, leaves in incubation period and leaves in diseased period of wheat stripe rust and wheat leaf rust were collected under in-field conditions using a black-paper-based measuring method developed in this study. After data preprocessing, the models to identify the diseases were built using distinguished partial least squares (DPLS) and support vector machine (SVM), and the disease severity inversion models of stripe rust and the disease severity inversion models of leaf rust were built using quantitative partial least squares (QPLS) and support vector regression (SVR). All the models were validated by using leave-one-out cross validation and external validation. The diseases could be discriminated using both distinguished partial least squares and support vector machine with the accuracies of more than 99%. For each wheat rust, disease severity levels were accurately retrieved using both the optimal QPLS models and the optimal SVR models with the coefficients of determination (R2) of more than 0.90 and the root mean square errors (RMSE) of less than 0.15. The results demonstrated that identification and severity evaluation of stripe rust and leaf rust at the leaf level could be implemented based on the hyperspectral data acquired using the developed method. A scientific basis was provided for implementing disease monitoring by using aerial and space remote sensing technologies. [ABSTRACT FROM AUTHOR]

The paper shows the feasibility of building closed-form and fast-to-evaluate surrogate models via supervised kernel-based machine learning regressions behaving as digital twins for computationally expensive multibody simulations. The aforementioned surrogate models are adopted to predict the railway vehicle dynamics safety indexes defined in the international standards, depending on the wheel-rail forces, directly from the results of longitudinal train dynamics simulations. The digital twin models are trained with the outputs of Simpack multibody simulations of a reference freight wagon, to which the in-train forces calculated by an in-house MATLAB longitudinal train dynamics simulator are applied. Two machine learning techniques are considered: the support vector machine and the least-squares support vector machine regressions. Both techniques ensure a good accuracy even with a limited number of training samples. The derivation of the surrogate models can strongly enhance the modelling capabilities of common longitudinal train dynamics simulators, that cannot evaluate the wheel-rail contact forces. At the same time, the method shown in the paper allows to strongly reduce the total computational times, as the evaluation of the closed-form surrogate models allows to effectively estimate the safety indexes with no need for computationally demanding multibody simulations. [ABSTRACT FROM AUTHOR]

This paper examines the use of manifold learning in the context of electric power system transient stability analysis. Since wide-area monitoring systems (WAMSs) introduced a big data paradigm into the power system operation, manifold learning can be seen as a means of condensing these high-dimensional data into an appropriate low-dimensional representation (i.e., embedding) which preserves as much information as possible. In this paper, we consider several embedding methods (principal component analysis (PCA) and its variants, singular value decomposition, isomap and spectral embedding, locally linear embedding (LLE) and its variants, multidimensional scaling (MDS), and others) and apply them to the dataset derived from the IEEE New England 39-bus power system transient simulations. We found that PCA with a radial basis function kernel is well suited to this type of power system data (where features are instances of three-phase phasor values). We also found that the LLE (including its variants) did not produce a good embedding with this particular kind of data. Furthermore, we found that a support vector machine, trained on top of the embedding produced by several different methods was able to detect power system disturbances from WAMS data. [ABSTRACT FROM AUTHOR]

The paper focuses on the hepatitis C virus (HCV) infection in Egypt, which has one of the highest rates of HCV in the world. The high prevalence is linked to several factors, including the use of injection drugs, poor sterilization practices in medical facilities, and low public awareness. This paper introduces a hyOPTGB model, which employs an optimized gradient boosting (GB) classifier to predict HCV disease in Egypt. The model's accuracy is enhanced by optimizing hyperparameters with the OPTUNA framework. Min-Max normalization is used as a preprocessing step for scaling the dataset values and using the forward selection (FS) wrapped method to identify essential features. The dataset used in the study contains 1385 instances and 29 features and is available at the UCI machine learning repository. The authors compare the performance of five machine learning models, including decision tree (DT), support vector machine (SVM), dummy classifier (DC), ridge classifier (RC), and bagging classifier (BC), with the hyOPTGB model. The system's efficacy is assessed using various metrics, including accuracy, recall, precision, and F1-score. The hyOPTGB model outperformed the other machine learning models, achieving a 95.3% accuracy rate. The authors also compared the hyOPTGB model against other models proposed by authors who used the same dataset. [ABSTRACT FROM AUTHOR]

Machine learning, powered by cloud servers, has found application in medical diagnosis, enhancing the capabilities of smart healthcare services. Research literature demonstrates that the support vector machine (SVM) consistently demonstrates remarkable accuracy in medical diagnosis. Nonetheless, safeguarding patients' health data privacy and preserving the intellectual property of diagnosis models is of paramount importance. This concern arises from the common practice of outsourcing these models to third-party cloud servers that may not be entirely trustworthy. Few studies in the literature have delved into addressing these issues within SVM-based diagnosis systems. These studies, however, typically demand substantial communication and computational resources and may fail to conceal classification results and protect model intellectual property. This paper aims to tackle these limitations within a multi-class SVM medical diagnosis system. To achieve this, we have introduced modifications to an inner product encryption cryptosystem and incorporated it into our medical diagnosis framework. Notably, our cryptosystem proves to be more efficient than the Paillier and multi-party computation cryptography methods employed in previous research. Although we focus on a medical application in this paper, our approach can also be used for other applications that need the evaluation of machine learning models in a privacy-preserving way such as electricity theft detection in the smart grid, electric vehicle charging coordination, and vehicular social networks. To assess the performance and security of our approach, we conducted comprehensive analyses and experiments. Our findings demonstrate that our proposed method successfully fulfills our security and privacy objectives while maintaining high classification accuracy and minimizing communication and computational overhead. [ABSTRACT FROM AUTHOR]

Coral reefs are an essential source of marine biodiversity, but they are declining at an alarming rate under the combined effects of global change and human pressure. A precise mapping of coral reef habitat with high spatial and time resolutions has become a necessary step for monitoring their health and evolution. This mapping can be achieved remotely thanks to satellite imagery coupled with machine-learning algorithms. In this paper, we review the different satellites used in recent literature, as well as the most common and efficient machine-learning methods. To account for the recent explosion of published research on coral reel mapping, we especially focus on the papers published between 2018 and 2020. Our review study indicates that object-based methods provide more accurate results than pixel-based ones, and that the most accurate methods are Support Vector Machine and Random Forest. We emphasize that the satellites with the highest spatial resolution provide the best images for benthic habitat mapping. We also highlight that preprocessing steps (water column correction, sunglint removal, etc.) and additional inputs (bathymetry data, aerial photographs, etc.) can significantly improve the mapping accuracy. [ABSTRACT FROM AUTHOR]

Mental workload refers to the cognitive effort required to perform tasks, and it is an important factor in various fields, including system design, clinical medicine, and industrial applications. In this paper, we propose innovative methods to assess mental workload from EEG data that use effective brain connectivity for the purpose of extracting features, a hierarchical feature selection algorithm to select the most significant features, and finally machine learning models. We have used the Simultaneous Task EEG Workload (STEW) dataset, an open-access collection of raw EEG data from 48 subjects. We extracted brain-effective connectivities by the direct directed transfer function and then selected the top 30 connectivities for each standard frequency band. Then we applied three feature selection algorithms (forward feature selection, Relief-F, and minimum-redundancy-maximum-relevance) on the top 150 features from all frequencies. Finally, we applied sevenfold cross-validation on four machine learning models (support vector machine (SVM), linear discriminant analysis, random forest, and decision tree). The results revealed that SVM as the machine learning model and forward feature selection as the feature selection method work better than others and could classify the mental workload levels with accuracy equal to 89.53% (± 1.36). [ABSTRACT FROM AUTHOR]

The respiratory disease of coronavirus disease 2019 (COVID-19) has wreaked havoc on the economy of every nation by infecting and killing millions of people. This deadly disease has taken a toll on the life of the entire human race, and an exact cure for it is still not developed. Thus, the control and cure of this disease mainly depend on restricting its transmission rate through early detection. The detection of coronavirus infection facilitates the isolation and exclusive care of infected patients. This research paper proposes a novel data mining system that combines the ensemble feature selection method and machine learning classifier for the effective identification of COVID-19 infection. Different feature selection approaches including chi-square test, recursive feature elimination (RFE), genetic algorithm (GA), particle swarm optimization (PSO), and random forest are evaluated for their effectiveness in enhancing the classification accuracy of the machine learning classifiers. The classifiers that are considered in this research work are decision tree, naïve Bayes, K -nearest neighbor (KNN), multilayer perceptron (MLP), and support vector machine (SVM). Two COVID-19 datasets were used for testing from which the best features supporting the dataset were extracted by the proposed system. The performance of the machine learning classifiers based on the ensemble feature selection methods is analyzed. [ABSTRACT FROM AUTHOR]

As is the case for many National Statistics Institutes, the United States Department of Agriculture's (USDA's) National Agricultural Statistics Service (NASS) has observed dwindling survey response rates, and the requests for more information at finer temporal and spatial scales have led to increased response burdens. Non-survey data are becoming increasingly abundant and accessible. Consequently, NASS is exploring the potential to complete some or all of a survey record using non-survey data, which would reduce respondent burden and potentially lead to increased response rates. In this paper, the focus is on a large set of records associated with potential farms, which are operations with undetermined farm status (farm/non-farm) and are referred to here as operations with unknown status (OUS). Although they usually have some agriculture, most OUS records are eventually classified as non-farms. Those OUS that are classified as farms tend to have higher proportions of producers from under-represented groups compared to other records. Determining the probability that an OUS record is a farm is an important step in the imputation process. The OUS records that responded to the 2017 U.S. Census of Agriculture were used to develop models to predict farm status using multiple data sources. Evaluated models include bootstrap random forest (RF), logistic regression (LR), neural network (NN), and support vector machine (SVM). Although the SVM had the best outcomes for three of the five metrics, the sensitivity for identifying farms was the lowest (13.8%). The NN model had a sensitivity of 80.5%, which was substantially higher than the other models, and its specificity of 45.3% was the lowest of all models. Because sensitivity was the primary metric of interest and the NN performed reasonably well on the other metrics, the NN was selected as the preferred model. [ABSTRACT FROM AUTHOR]

Landslide susceptibility mapping (LSM) is a major measure for disaster prevention and control. This paper proposes an incremental learning random forest model that uses random forests for incremental training of landslides. The 1652 landslides in Ganzhou, China from year 2015 to 2020 were divided into three equal parts (T1, T2 and T3) considering time series. And the data of T1 part is used to construct incremental learning random forest model ILRF_1, T2 and T3 part as the new part of incremental training. Landslide susceptibility maps were plotted using ILRF, batch learning random forests (BLRF), batch learning support vector machines (BLSVM), respectively. And the accuracy is verified using the receiver operating curve (ROC). The results showed that the ILRF was the most promising model(AUC = 0.937) for the LSM, followed by BLRF(AUC = 0.905), BLSVM(AUC = 0.865). ILRF has better predictive ability in the susceptibility evaluation of this region. It is very high-prone area accounts for the smallest proportion, mainly concentrated in the mountain front area in the northeast of Ganzhou City. The multi-year average rainfall, population density, and normalized difference vegetation index are the first three important factors that control the spatial possibility of landslides. [ABSTRACT FROM AUTHOR]

This work investigates the significance of Hilbert domain characterization of wavelet packets in classifying different emotion of speech signal. The goal of this paper is to create a new emotional speech database and introduce a new feature extraction approach that can recognize various emotions. The proposed feature, wavelet cepstral coefficients (WCC) are based on Hilbert spectrum analysis of the wavelet packet of the speech signal. The speaker-independent machine learning models are developed using multiclass support vector machine (SVM) and k-nearest neighbourhood (KNN) classifier. The approach is tested with newly developed Telugu Indian database and the EMOVO (Italian emotional speech) database. Our proposed wavelet features achieve a peak accuracy of 73.5%, further boosted by NCA feature selection by 3–5%, resulting in an improved unweighted average recall (UAR) of 78% for database 1 and 87.50% for database 2, employing optimal wavelet features in conjunction with SVM classification. The proposed features outperformed the baseline Mel-frequency cepstral coefficients (MFCC) feature. The performance of newly formulated features is better than other existing methodologies tested with different language databases. [ABSTRACT FROM AUTHOR]

Kernel-based learning algorithms have been extensively studied over the past two decades for their successful applications in scientific research and industrial problem-solving. In classical kernel methods, such as kernel ridge regression and support vector machines, an unregularized offset term naturally appears. While its importance can be defended in some situations, it is arguable in others. However, it is commonly agreed that the offset term introduces essential challenges to the optimization and theoretical analysis of the algorithms. In this paper, we demonstrate that Kernel Ridge Regression (KRR) with an offset is closely connected to regularization schemes involving centered reproducing kernels. With the aid of this connection and the theory of centered reproducing kernels, we will establish generalization error bounds for KRR with an offset. These bounds indicate that the algorithm can achieve minimax optimal rates. [ABSTRACT FROM AUTHOR]

The sandy conglomerate reservoir in layer Es3 of the Liaohe Eastern Depression has good potential for oil reservoir exploration and has been identified as a key area for future exploration. The low porosity and permeability, complex lithology, and strong heterogeneity of the target layer make it difficult to predict favorable reservoirs. The objective of this study is to analyze and process conventional logging data to extract feature parameters that affect lithology by establishing a decision tree lithology classifier. Principal component analysis is used to reduce data dimensionality, and the elbow method is applied to the clustering algorithm to establish the optimal number of clusters for the automatic classification of reservoir types. Further, support vector machines are used for lithology classification based on features with higher classification capabilities. The results show that the support vector machine lithology recognition method based on feature selection achieved an accuracy of 91.8%. The processing of actual well data has verified the feasibility of the method. Based on the combination of core experiments and oil testing results, the characteristics of three types of reservoirs were presented, and potential reservoir zones were proposed for drilling wells. The comprehensive analysis and the practical application of the developed method reveal that the class I reservoir has high hydrocarbon production and could be the most favorable reservoir in the Es3 sandy conglomerate. The processing data of lithology identification and reservoir classification evaluation are consistent with core data and hydrocarbon production data, verifying the effectiveness and practicability of the method proposed in this paper. The results of this study will serve as a reference for low porosity and permeability sandy conglomerate reservoir evaluation based on machine learning in the target area. [ABSTRACT FROM AUTHOR]

Ultrasonic diagnostics is the earliest way to predict industrial faults. Usually, a contact microphone is employed for detection, but the recording will be contaminated with noise. In this paper, a dataset that contains 10 main faults of pipelines and motors is analyzed from which 30 different features in the time and frequency domains are extracted. Afterward, for dimensionality reduction, principal component analysis (PCA), linear discriminant analysis (LDA), and t-distributed stochastic neighbor embedding (t-SNE) are performed. In the subsequent phase, recursive feature elimination (RFE) is employed as a strategic method to analyze and select the most relevant features for the classifiers. Next, predictive models consisting of k-Nearest Neighbor (KNN), Logistic Regression (LR), Decision Tree (DT), Gaussian Naive Bayes (GNB), and Support Vector Machine (SVM) are employed. Then, in order to solve the classification problem, a stacking classifier based on a meta-classifier which combines multiple classification models is introduced. Furthermore, the k-fold cross-validation technique is employed to assess the effectiveness of the model in handling new data for the evaluation of experimental results in ultrasonic fault detection. With the proposed method, the accuracy is around 5% higher over five cross folds with the least amount of variation. The timing evaluation of the meta model on the 64 MHz Cortex M4 microcontroller unit (MCU) revealed an execution time of 11 ms, indicating it could be a promising solution for real-time monitoring. [ABSTRACT FROM AUTHOR]

Major depressive disorder (MDD), a prevalent mental health issue, affects more than 8% of the US population, and almost 17% in the young group of 18–25 years old. Since Covid-19, its prevalence has become even more significant. However, the remission (being free of depression) rates of first-line antidepressant treatments on MDD are only about 30%. To improve treatment outcomes, researchers have built various predictive models for treatment responses and yet none of them have been adopted in clinical use. One reason is that most predictive models are based on data from subjective questionnaires, which are less reliable. Neuroimaging data are promising objective prognostic factors, but they are expensive to obtain and hence predictive models using neuroimaging data are limited and such studies were usually in small scale (N<100). In this paper, we proposed an advanced machine learning (ML) pipeline for small training dataset with large number of features. We implemented multiple imputation for missing data and repeated K-fold cross validation (CV) to robustly estimate predictive performances. Different feature selection methods and stacking methods using 6 general ML models including random forest, gradient boosting decision tree, XGBoost, penalized logistic regression, support vector machine (SVM), and neural network were examined to evaluate the model performances. All predictive models were compared using model performance metrics such as accuracy, balanced accuracy, area under ROC curve (AUC), sensitivity and specificity. Our proposed ML pipeline was applied to a training dataset and obtained an accuracy and AUC above 0.80. But such high performance failed while applying our ML pipeline using an external validation dataset from the EMBARC study which is a multi-center study. We further examined the possible reasons especially the site heterogeneity issue. [ABSTRACT FROM AUTHOR]

With the rise of ready-to-assemble furniture, driven by international giants like IKEA, assembly services were increasingly offered by the same retailers. When planning orders with assembly services, the estimation of the service time leads to additional difficulties compared to standard delivery planning. Assembling large wardrobes or kitchens can take hours or even days while assembling a chair can be done in a few minutes. Combined with the usually vast amounts of offered products, a lot of knowledge is required to plan efficient and exact delivery routes. This paper shows how an artificial neural network (ANN) can be used to accurately predict the service time of a delivery based on factors such as the goods to be delivered or the personnel providing the service. The data used include not only deliveries with assembly of furniture, but also deliveries of goods without assembly and delivery of goods requiring electrical installation. The goal is to create a solution that can predict the time needed based on criteria such the type of furniture, the weight of the goods, and the experiences of the service technicians. The findings show that ANNs can be applied to this scenario and outperform more classical approaches, such as multiple linear regression or support vector machines. Still existing problems are largely due to the provided data, e.g., a large difference between the number of short and longer duration orders, which made it harder to accurately predict orders with longer duration. [ABSTRACT FROM AUTHOR]

Mangroves grow in intertidal zones in tropical and subtropical regions, offering numerous advantages to humans and ecosystems. Mangrove monitoring is one of the important tasks to understand the current status of mangrove forests regarding their loss issues, including deforestation and degradation. Currently, satellite imagery is widely employed to monitor mangrove ecosystems. Sentinel-2 is an optical satellite imagery whose data are available for free, and which provides satellite imagery at a 5-day temporal resolution. Analyzing satellite images before and after loss can enhance our ability to detect mangrove loss. This paper introduces a LSST-Former model that considers the situation before and after mangrove loss to categorize non-mangrove areas, intact mangroves, and mangrove loss categories using Sentinel-2 images for a limited number of labels. The LSST-Former model was developed by integrating a fully convolutional network (FCN) and a transformer base with few-shot learning algorithms to extract information from spectral-spatial-temporal Sentinel-2 images. The attention mechanism in the transformer algorithm may effectively mitigate the issue of limited labeled samples and enhance the accuracy of learning correlations between samples, resulting in more successful classification. The experimental findings demonstrate that the LSST-Former model achieves an overall accuracy of 99.59% and an Intersection-over-Union (IoU) score of 98.84% for detecting mangrove loss, and the validation of universal applicability achieves an overall accuracy of more than 92% and a kappa accuracy of more than 89%. LSST-Former demonstrates superior performance compared to state-of-the-art deep-learning models such as random forest, Support Vector Machine, U-Net, LinkNet, Vision Transformer, SpectralFormer, MDPrePost-Net, and SST-Former, as evidenced by the experimental results and accuracy metrics. [ABSTRACT FROM AUTHOR]

Background: Cancer diagnosis based on machine learning has become a popular application direction. Support vector machine (SVM), as a classical machine learning algorithm, has been widely used in cancer diagnosis because of its advantages in high-dimensional and small sample data. However, due to the high-dimensional feature space and high feature redundancy of gene expression data, SVM faces the problem of poor classification effect when dealing with such data. Methods: Based on this, this paper proposes a hybrid feature selection algorithm combining information gain and grouping particle swarm optimization (IG-GPSO). The algorithm firstly calculates the information gain values of the features and ranks them in descending order according to the value. Then, ranked features are grouped according to the information index, so that the features in the group are close, and the features outside the group are sparse. Finally, grouped features are searched using grouping PSO and evaluated according to in-group and out-group. Results: Experimental results show that the average accuracy (ACC) of the SVM on the feature subset selected by the IG-GPSO is 98.50%, which is significantly better than the traditional feature selection algorithm. Compared with KNN, the classification effect of the feature subset selected by the IG-GPSO is still optimal. In addition, the results of multiple comparison tests show that the feature selection effect of the IG-GPSO is significantly better than that of traditional feature selection algorithms. Conclusion: The feature subset selected by IG-GPSO not only has the best classification effect, but also has the least feature scale (FS). More importantly, the IG-GPSO significantly improves the ACC of SVM in cancer diagnostic. [ABSTRACT FROM AUTHOR]

The contemporary real-world datasets often suffer from the problem of class imbalance as well as high dimensionality. For combating class imbalance, data resampling is a commonly used approach whereas for tackling high dimensionality feature selection is used. The aforesaid problems have been studied extensively as independent problems in the literature but the possible synergy between them is still not clear. This paper studies the effects of addressing both the issues in conjunction by using a combination of resampling and feature selection techniques on binary-class imbalance classification. In particular, the primary goal of this study is to prioritize the sequence or pipeline of using these techniques and to analyze the performance of the two opposite pipelines that apply feature selection before or after resampling techniques i.e., F + S or S + F. For this, a comprehensive empirical study is carried out by conducting a total of 34,560 tests on 30 publicly available datasets using a combination of 12 resampling techniques for class imbalance and 12 feature selection methods, evaluating the performance on 4 different classifiers. Through the experiments we conclude that there is no specific pipeline that proves better than the other and both the pipelines should be considered for obtaining the best classification results on high dimensional imbalanced data. Additionally, while using Decision Tree (DT) or Random Forest (RF) as base learner the predominance of S + F over F + S is observed whereas in case of Support Vector Machine (SVM) and Logistic Regression (LR), F + S outperforms S + F in most cases. According to the mean ranking obtained from Friedman test the best combination of resampling and feature selection techniques for DT, SVM, LR and RF are SMOTE + RFE (Synthetic Minority Oversampling Technique and Recursive Feature Elimination), Least Absolute Shrinkage and Selection Operator (LASSO) + SMOTE, SMOTE + Embedded feature selection using RF and SMOTE + RFE respectively. [ABSTRACT FROM AUTHOR]

In the ever-evolving world of cricket, the T20 format has captured the imaginations of fans worldwide, intensifying the anticipation for match outcomes with each passing delivery. This study explores the realm of predictive analytics, leveraging the power of machine learning to alleviate the suspense by forecasting T20 cricket match winners before the first ball is bowled. Drawing on a rich dataset encompassing factors such as past team performance and rankings, a diverse ensemble of predictive models, including logistic regression, support vector machine (SVM), random forest, decision tree, and XGBoost, is meticulously employed. Among these, the random forest Classifier emerges as the standout performer, boasting an impressive prediction accuracy rate of 84.06%. To assess the real-world applicability of our predictive framework, a post-case study is conducted, focusing on the high-stakes World Cup T20 matches of 2022, where England emerges as the triumphant team. The dataset underpinning this study is meticulously curated from ESPN CricInfo, ensuring the robustness of our analysis. Moreover, this paper extends its contribution by offering a comprehensive comparative analysis, scrutinizing performance metrics such as accuracy, precision, recall, and the F1-score across benchmark machine learning models for cricket match prediction. This in-depth evaluation not only validates the efficacy of our models but also sheds light on their superior execution time and statistical robustness, further bolstering their utility in the realm of cricket outcome forecasting. [ABSTRACT FROM AUTHOR]

Traditionally, real estate prices were determined based on demand and supply. As the real estate market was unregulated and underdeveloped, brokers and real estate builders had an upper hand in determining the unit prices of residential houses in Abu Dhabi. A pricing gap was eventually noticed. This was a challenge. There is a delay in updating the real estate websites and portal information. Therefore, the need for accurate forecasting of prices has become urgent. With a variety of use case scenarios for machine learning concepts, this paper is dedicated to using the concepts of machine learning to predict the real estate prices of Aldar in the Abu Dhabi region, which comprises 511 residential units, 15 retail shops, and one community center. Decision tree, random forest, support vector machines, and K-nearest neighbors (KNN) algorithms were used to identify which one is better for forecasting these real estate prices. Comparing the generated models, the random forest is the bestperforming model, followed by support vector regression, and the decision tree model is the least-performing model. [ABSTRACT FROM AUTHOR]