Search

Leptospirosis is a global disease that impacts people worldwide, particularly in humid and tropical regions, and is associated with significant socio-economic deficiencies. Its symptoms are often confused with other syndromes, which can compromise clinical diagnosis and the failure to carry out specific laboratory tests. In this respect, this paper presents a study of three algorithms (Decision Tree, Random Forest and Adaboost) for predicting the outcome (cure or death) of individuals with leptospirosis. Using the records contained in the government National System of Aggressions and Notification (SINAN, in portuguese) from 2007 to 2017, for the state of Pará, Brazil, where the temporal attributes of health care, symptoms (headache, vomiting, jaundice, calf pain) and clinical evolution (renal failure and respiratory changes) were used. In the performance evaluation of the selected models, it was observed that the Random Forest exhibited an accuracy of 90.81% for the training dataset, considering the attributes of experiment 8, and the Decision Tree presented an accuracy of 74.29 for the validation database. So, this result considers the best attributes pointed out by experiment 10: time first symptoms medical attention, time first symptoms ELISA sample collection, medical attention hospital admission time, headache, calf pain, vomiting, jaundice, renal insufficiency, and respiratory alterations. The contribution of this article is the confirmation that artificial intelligence, using the Decision Tree model algorithm, depicting the best choice as the final model to be used in future data for the prediction of human leptospirosis cases, helping in the diagnosis and course of the disease, aiming to avoid the evolution to death. [ABSTRACT FROM AUTHOR]

Tabular data analysis is a critical task in various domains, enabling us to uncover valuable insights from structured datasets. While traditional machine learning methods can be used for feature engineering and dimensionality reduction, they often struggle to capture the intricate relationships and dependencies within real-world datasets. In this paper, we present Multi-representation DeepInsight (MRep-DeepInsight), a novel extension of the DeepInsight method designed to enhance the analysis of tabular data. By generating multiple representations of samples using diverse feature extraction techniques, our approach is able to capture a broader range of features and reveal deeper insights. We demonstrate the effectiveness of MRep-DeepInsight on single-cell datasets, Alzheimer's data, and artificial data, showcasing an improved accuracy over the original DeepInsight approach and machine learning methods like random forest, XGBoost, LightGBM, FT-Transformer and L2-regularized logistic regression. Our results highlight the value of incorporating multiple representations for robust and accurate tabular data analysis. By leveraging the power of diverse representations, MRep-DeepInsight offers a promising new avenue for advancing decision-making and scientific discovery across a wide range of fields. [ABSTRACT FROM AUTHOR]

Bonica's (Am J Polit Sci 58(2):367–386, 2014) campaign finance-based ideology scores, or CFscores, create an ideological common space that allows researchers to compare a wide variety of actors. Because relatively few citizens donate to candidates, however, the public is not well represented in this common space. This paper addresses that gap. It uses random forest machine learning on data from the 2012 Cooperative Congressional Election Study to impute CFscores for respondents who did not donate to candidates, based on how their policy views compared to those who did. These new scores are robust to differences in issue importance between donors and non-donors, and they outperform other ideological measures in predicting vote choice. The scores are then applied to a substantive exercise. Past research shows that extreme candidates for governor are penalized more by voters than those in lower-profile races. The implied mechanism—that vote choice for governor is more ideologically-driven—can be directly tested with imputed CFscores, since they uniquely allow comparisons between voters and candidates across races. An analysis of voting behavior in 2012 confounds expectations. Ideology appears to factor no more into vote choice for governor than for US House. These novel findings underscore the value of extending CFscores to non-donating survey respondents, and while current efforts are limited by data availability, this study offers encouragement and a roadmap to that end. [ABSTRACT FROM AUTHOR]

The paper explores the possibilities of using data classification methods when forecasting time series of the geomagnetic Kp-index by machine learning methods. To classify categories of the Kp-index based on the degree of disturbance, linear and logistic regression, random forest, gradient boosting on top of decision trees, and artificial neural networks of various architectures are used. The results of these methods are compared with a trivial inertial forecast (the statistical indicators of which for problems of this type are always high) at horizons from 3 h to 1 day in 3-h increments. The problem of choosing a cross-validation scheme for selecting the model hyperparameters, ways to overcome the imbalance of categories, the relative importance of input features, as well as the dependence of the results on the test sample (beginning of the 25th solar activity cycle) on inclusion in the training sample of data from the 23rd and 24th cycles or only the 24th cycles are studied. Based on the results, conclusions are drawn about the preferred methods for classifying values of the Kp-index based on the level of geomagnetic disturbance. Ways for further research and possible improvement of the classification quality are outlined, including for determining the characteristic hidden states of Earth's magnetosphere as a dynamic system in order to improve the quality of forecasting geomagnetic indices. [ABSTRACT FROM AUTHOR]

In recent years, machine learning (ML) has become increasingly popular in various fields of activity. Cloud platforms have also grown in popularity, as they offer services that are more secure and accessible worldwide. In this context, cloud-based technologies emerged to support ML, giving rise to the machine learning as a service (MLaaS) concept. However, the clients accessing ML services in order to obtain classification results on private data may be reluctant to upload sensitive information to cloud. The model owners may also prefer not to outsource their models in order to prevent model inversion attacks and to protect intellectual property. The privacy-preserving evaluation of ML models is possible through multi-key homomorphic encryption (MKHE), that allows both the client data and the model to be encrypted under different keys. In this paper, we propose an MKHE evaluation method for decision trees and we extend the proposed method for random forests. Each decision tree is evaluated as a single lookup table, and voting is performed at the level of groups of decision trees in the random forest. We provide both theoretical and experimental evaluations for the proposed method. The aim is to minimize the performance degradation introduced by the encrypted model compared to a plaintext model while also obtaining practical classification times. In our experiments with the proposed MKHE random forest evaluation method, we obtained minimal (less than 0.6%) impact on the main ML performance metrics considered for each scenario, while also achieving reasonable classification times (of the order of seconds). [ABSTRACT FROM AUTHOR]

The classification of land use and land cover (LULC) from remotely sensed imagery in semi-arid Mediterranean areas is a challenging task due to the fragmentation of the landscape and the diversity of spatial patterns. Recently, the use of deep learning (DL) for image analysis has increased compared to commonly used machine learning (ML) methods. This paper compares the performance of four algorithms, Random Forest (RF), Support Vector Machine (SVM), Multilayer Perceptron (MLP) and Convolutional Network (CNN), using multi-source data, applying an exhaustive optimisation process of the hyperparameters. The usual approach in the optimisation process of a LULC classification model is to keep the best model in terms of accuracy without analysing the rest of the results. In this study, we have analysed such results, discovering noteworthy patterns in a space defined by the mean and standard deviation of the validation accuracy estimated in a 10-fold cross validation (CV). The point distributions in such a space do not appear to be completely random, but show clusters of points that facilitate the discovery of hyperparameter values that tend to increase the mean accuracy and decrease its standard deviation. RF is not the most accurate model, but it is the less sensitive to changes in hyperparameters. Neural Networks, tend to increase commission and omission errors of the less represented classes because their optimisation lead the model to learn better the most frequent classes. On the other hand, RF and MLP prediction layers are the most accurate from a general qualitative point of view. [ABSTRACT FROM AUTHOR]

Brønnøy Kalk AS operates an open pit mine in Norway producing marble, mainly used by the paper industry. The final product is used as filler and pigment for paper production. Therefore, the quality of the product has utmost importance. In the mine, the primary quality indicator, called TAPPI, is quantified through a laborious sampling process and laboratory experiments. As a part of digital transformation, measurement while drilling (MWD) data have been collected in the mine. The purpose of this paper is to use the recorded MWD data for the prediction of marble quality to facilitate quality blending in the pit. For this purpose, two supervised classification modelling algorithms such as conventional logistic regression and random forest have been employed. The results show that the random forest classification model presents significantly higher statistical performance, and it can be used as a tool for fast and efficient marble quality assessment. [ABSTRACT FROM AUTHOR]

Landslide susceptibility mapping (LSM) is a major measure for disaster prevention and control. This paper proposes an incremental learning random forest model that uses random forests for incremental training of landslides. The 1652 landslides in Ganzhou, China from year 2015 to 2020 were divided into three equal parts (T1, T2 and T3) considering time series. And the data of T1 part is used to construct incremental learning random forest model ILRF_1, T2 and T3 part as the new part of incremental training. Landslide susceptibility maps were plotted using ILRF, batch learning random forests (BLRF), batch learning support vector machines (BLSVM), respectively. And the accuracy is verified using the receiver operating curve (ROC). The results showed that the ILRF was the most promising model(AUC = 0.937) for the LSM, followed by BLRF(AUC = 0.905), BLSVM(AUC = 0.865). ILRF has better predictive ability in the susceptibility evaluation of this region. It is very high-prone area accounts for the smallest proportion, mainly concentrated in the mountain front area in the northeast of Ganzhou City. The multi-year average rainfall, population density, and normalized difference vegetation index are the first three important factors that control the spatial possibility of landslides. [ABSTRACT FROM AUTHOR]

Privacy and security are the most essential barriers preventing widespread public cloud adaptation. The data that is distributed within the cloud requires privacy protection which can be achieved through the implementation of a data anonymization process. However, there is a lack of privacy for the user data. Even though the differential privacy model minimizes the efficiency, it also leads to generate data loss and privacy is not enhanced. Data securing in a cloud environment is a complex task. The data that are distributed within the cloud requires privacy protection which can be achieved through the implementation of a data anonymization process. So in order to improve the efficiency the novel hybrid ABRF-Stacked Bi-GRU is proposed to secure the medical data. This proposed method diminished the leakage of data and also effectively improve security and privacy. Therefore, in this paper, the privacy-preserving hybrid attention-based random forest (ABRF) with stacked bidirectional gated recurrent unit (stacked Bi-GRU) model named hybrid ABRF-Stacked Bi-GRU is proposed in the cloud environment. This proposed model is used to preserve medical data in the cloud from private data leakage. The attention weights along with the trainable parameters are assigned by the ABRF model to the decision trees. The privacy leakage is reduced by combining Jarratt butterfly optimization algorithm with the Ebola optimization search algorithm. However, in various existing methods, the differential privacy model is applied but it does not minimize the efficiency. In such cases it leads to generate data loss and privacy is not enhanced. Data securing in a cloud environment is a complex task. So in order to improve the efficiency the novel hybrid ABRF-Stacked Bi-GRU is proposed to secure the medical data. This proposed method diminished the leakage of data and also effectively improve security and privacy. The ensemble of the ABRF and stacked Bi-GRU model enhances the security of data in a cloud environment. The proposed model is evaluated using Diabetes UCI Dataset and Obesity UCI ML Dataset. The obtained outcomes compared with existing methods showed that the proposed method achieves a high anonymization degree with less Information Loss and takes less time for computation and minimizes the complexity during computation. [ABSTRACT FROM AUTHOR]

One of the significant aspects of our digital world is that data are literally everywhere, and it is increasing. On the other hand, the number of cyberattacks aiming to seize this data and use it illegally is increasing at an exponential rate, and this is the challenge. Therefore, intrusion detection systems (IDS) have attracted considerable interest from researchers and industries. In this regard, machine learning (ML) techniques are playing a pivotal role as they put the responsibility of analyzing enormous amounts of data, finding patterns, classifying intrusions, and solving issues on computers instead of humans. This paper implements two separate classification layers of ML-based algorithms with the recently published NF-UQ-NIDS-v2 dataset, preprocessing two volumes of sample records (100 k and 10 million), utilizing MinMaxScaler, LabelEncoder, selecting superlative features by recursive feature elimination, normalizing the data, and optimizing hyper-parameters for classical algorithms and neural networks. With a small dataset volume, the results of the classical algorithms layer show high detection accuracy rates for support vector (98.26%), decision tree (98.78%), random forest (99.07%), K-nearest neighbors (98.16%), CatBoost (99.04%), and gradient boosting (98.80%). In addition, the layer of neural network algorithms has proven to be a very powerful technology when using deep learning, particularly due to its unique ability to effectively handle enormous amounts of data and detect hidden correlations and patterns; it showed high detection results, which were (98.87%) for long short-term memory and (98.56%) for convolutional neural networks. [ABSTRACT FROM AUTHOR]

Speech emotion recognition (SER) has gained an increased interest during the last decades as part of enriched affective computing. As a consequence, a variety of engineering approaches have been developed addressing the challenge of the SER problem, exploiting different features, learning algorithms, and datasets. In this paper, we propose the application of the graph theory for classifying emotionally-colored speech signals. Graph theory provides tools for extracting statistical as well as structural information from any time series. We propose to use the mentioned information as a novel feature set. Furthermore, we suggest setting a unique feature-based identity for each emotion belonging to each speaker. The emotion classification is performed by a Random Forest classifier in a Leave-One-Speaker-Out Cross Validation (LOSO-CV) scheme. The proposed method is compared with two state-of-the-art approaches involving well known hand-crafted features as well as deep learning architectures operating on mel-spectrograms. Experimental results on three datasets, EMODB (German, acted) and AESDD (Greek, acted), and DEMoS (Italian, in-the-wild), reveal that our proposed method outperforms the comparative methods in these datasets. Specifically, we observe an average UAR increase of almost 18 % , 8 % and 13 % , respectively. [ABSTRACT FROM AUTHOR]

Classification is a widely used supervised learning technique that enables models to discover the relationship between a set of features and a specified label using available data. Its applications span various fields such as engineering, telecommunication, astronomy, and medicine. In this paper, we propose a novel rule-based classifier called RUCIB (RUle-based Classifier Inspired by BRADO), which draws inspiration from the socio-inspired swarm intelligence algorithm known as BRADO. RUCIB introduces two key aspects: the ability to accommodate multiple values for features within a rule and the capability to explore all data features simultaneously. To evaluate the performance of RUCIB, we conducted experiments using ten databases sourced from the UCI machine learning database repository. In terms of classification accuracy, we compared RUCIB to ten well-known classifiers. Our results demonstrate that, on average, RUCIB outperforms Naive Bayes, SVM, PART, Hoeffding Tree, C4.5, ID3, Random Forest, CORER, CN2, and RACER by 9.32%, 8.97%, 7.58%, 7.4%, 7.34%, 7.34%, 7.22%, 5.06%, 5.01%, and 1.92%, respectively. [ABSTRACT FROM AUTHOR]

Since there has been concern about food security, accurate prediction of wheat yield prior to harvest is a key component. Random Forest (RF) has been used in many classification and regression applications, such as yield estimation, and the performance of RF has improved by tuning its hyperparameters. In this paper, different changes are made to traditional RF for yield estimation, and the performance of RF is evaluated. Accordingly, RFs constructed using various weak learners, as well as a combined RF consisting of different weak learners are assessed by growing weak Gaussian Process Regression (GPR), Decision Tree (DT), Neural Network (NN), and Stepwise Regression (SW) models in the forest. The input data to DTs are also partitioned into leaves in N (e.g., two) dimensional feature space by using clustering in each parent node. In addition, a subset of the training set is randomly sampled with replacement for training a learner in the forest, instead of randomly sampling the whole training set in traditional RF. Using clustering in DTs added flexibility while utilizing NN as a weak learner yielded the most favorable outcomes in our research. The number of input training samples (Itree) to each tree was also identified as a new hyperparameter to the forest, and the prediction results were more influenced by the Itree compared to the known hyperparameters, such as the number of trees in the forest (ntree) and the number of features for each tree (mtry). [ABSTRACT FROM AUTHOR]

With the increase interest and number of the users in Social media, the file handling has also increased. To manage the load, cloud servers are being used by the service providers. To identify and cluster file is a difficult task that is important in the domain of computer science. Various traditional approaches for identification exists that uses design features. The problem with these methods is get that they can be easily spoofed. To resolve the issue, in this paper, a hybrid algorithm combining the features of Random Forest with AdaBoost is proposed. The algorithm Internet of Thing (IoT) data file formatting (IDFF) classifies data as (text, image, audio and video) and gives better accuracy. Our proposed research obtains better Accuracy (93%), Precision (95%), Recall (95%), F-Measure (95%), and G-Mean (96%). [ABSTRACT FROM AUTHOR]

This paper analyzes the efficiency of various machine learning models (artificial neural networks, random forest, decision tree, AdaBoost and XGBoost) against the evolution of VBA-based (Visual Basic for Applications) malware over a large period of time (1995–2021). The file set used in our research is comprehensive—approximately 1.9 million files (out of which 944,595 are malicious and the rest are benign)—which allowed to gain insights on the resilience of various machine learning models against the diversity and the evolution of file features that reflect obfuscation techniques in VBA-based malware. In studying detection of VBA-based malware, we focus on characteristics of both the classifiers—proactivity (short-term detection efficiency against future malware), endurance (long-term detection robustness)—and of the detection-wise relevant file features—feature perishability (dynamics of feature relevance). We also describe in some detail—as a prerequisite of the study—various obfuscation techniques used by the malware under investigation during the last decade. [ABSTRACT FROM AUTHOR]

Intensity modulation/direct detection (IM/DD) optical interconnect systems are susceptible to waveform distortion caused by complex nonlinearities. To reduce the effect of waveform distortion on signal transmission accuracy, in this paper, a random forest (RF) equalization algorithm based on decision tree (DT) integration is proposed for cost-sensitive IM/DD systems, which has the characteristics of nonlinear classification and regression. The performance of the RF equalizer is verified by simulation experiments on a 120 Gbps 8-level pulse amplitude modulation (PAM8) transmission system using an electro-absorption-modulated laser (EML). Simulation studies show that whether it is a back-to-back (B2B) transmission system or a 10 km optical fiber transmission system, the RF equalization scheme can achieve much better bit error rate (BER) performance than the traditional equalization scheme. In addition, in both transmission cases, the RF equalization scheme enables efficient classification of signals and is much less simpler than the artificial neural network (ANN) equalization scheme. [ABSTRACT FROM AUTHOR]

Parkinson disease (PD) is a neurodegenerative disease that occurs due to insufficient level of dopamine in the human brain. This disease may occur predominantly in elder people. There exists no definite procedure to diagnose PD. It is diagnosed based on the symptoms, clinical trials, and number of laboratory tests. In this research paper, machine learning techniques are used to predict PD and help the medical practitioner to recommend personalized drugs for the patients. In this research paper, appropriate features are selected through rough set theory, and principal component analysis is used for dimensionality reduction. The performance is experimented using deep neural network, random forest, and SVM classifiers. The efficiency of the proposed approach is measured through confusion matrix, accuracy, precision, and recall. [ABSTRACT FROM AUTHOR]

This paper addresses the issue of the prediction of slope stability with machine learning (ML) applications. Five well-known and popular ML algorithms, namely neural network (NNet), decision tree (DT), support vector machine (SVM), k-nearest neighbor (kNN), and random forest (RF), are used to demonstrate the effectiveness of the ML algorithms for predicting binary classification of slope stability based on a case history dataset containing outliers. This study also evaluates the winsorization method used to treat outliers in the dataset by outlining the effect of outliers on the prediction performances of models. To this end, the performance of all the generated ML models is assessed and compared both for unwinsorized (e.g., raw) and winsorized datasets based on performance metrics (i.e., Recall, Precision, Accuracy, and F1-Score) obtained from the confusion matrix. The experimental outputs showed that the application of winsorization enhanced the prediction performance of the models, and thus, all ML models built with winsorized datasets outperformed the unwinsorized ones. In this paper, the RF model achieves the best prediction performance, especially in the case of the winsorized dataset used. Moreover, it is found that SVM is the most sensitive algorithm to outliers as against the other ML algorithms, while the kNN algorithm is the least among the applied algorithms. Results showed that the increment percentage of accuracy nearly reaches 20% for the SVM model and the following 18% for DT, 11% for NNet, 10% for RF, and 4% for kNN, respectively. Furthermore, the results of the study reveal not only the performance of ML algorithms for the slope stability problem but also show how the handling of outliers of a dataset affects the models' prediction performance. [ABSTRACT FROM AUTHOR]

Lithofacies identification is critical to energy exploration and reservoir evaluation. Machine learning provides a way to use logging data for lithofacies intelligence identification. However, labeled logging data are usually scarce, which makes the currently used supervised algorithms less effective, so semi-supervised methods have received attention from researchers. In this paper, we propose to apply Tri-Training to the field of lithofacies recognition. The framework used Random Forest (RF), Gradient-Boosted Decision Trees (GBDT), and Support Vector Machine (SVM), as the baseline supervised classifiers, and based on the idea of inductive semi-supervised methods and ensemble learning. Baseline classifiers are trained and iterated using unlabeled data to obtain effect improvement. The final results are output in an ensemble paradigm. We used seven logging parameters from two wells as input and divide the data randomly 10 times for training and testing. With only five samples of each lithology, the prediction accuracy improved by the average of 2.1% and 14.5% in both wells compared to the baseline methods. In addition, we also compared two commonly used semi-supervised methods, label propagation algorithm (LPA) and Co-Training. The experimental results also confirm that Tri-training has the better and more stable performance. The Tri-training method in this paper can be effectively applied to lithofacies identification under scarce labeled logging data. [ABSTRACT FROM AUTHOR]

One of the significant challenges in the sports industry is identifying the factors influencing match results and their respective weightage. For appropriate recommendations to the team management and the team players, there is a need to predict the match and quantify the important factors for which prediction models need to be developed. The second thing required is identifying talented and emerging players and performing an associative analysis of the important factors to the match-winning outcome. This paper formulates a hybrid machine learning-clustering-associative rules model. This paper also implements the framework for cricket matches, one of the most popular sports globally watched by billions around the world. We predict the match outcome for One day Internationals (ODIs) and Twenty 20 s (T20s) (two formats of Cricket representing fifty over and twenty over versions respectively) adopting state-of-the-art machine learning algorithms, Random Forest, Gradient Boosting, and Deep neural networks. The variable importance is computed using machine-learning techniques and further statistically validated through the regression model. The emerging talented players are identified by clustering. Association rules are generated for determining the best possible winning outcome. The results show that environmental conditions are equally crucial for determining a match result, as are internal quantitative factors. The model is thus helpful for both team management and for players to improve their winning strategy and also for discovering emerging players to form an unbeatable team. [ABSTRACT FROM AUTHOR]

Advancements in technology have led to a significant growth of agricultural data. The potential for forecasting crop yield depends on parameters such as climate, soil characteristics, and water factors has emerged as significant research area. Combining a comprehensive dataset from diverse sources like climate, soil and water parameters for precise time series forecasting in agricultural yield prediction is a significant challenge. Therefore, there is a need to integrate this data with agricultural processes to enhance crop production. In this paper, propose Genetic Algorithm based Autoregressive Integrated Moving Average (ARIMA) and Reinforced Random Forest Algorithm forecasting models for enhancing crop yield prediction. The genetic algorithm emulates the evolutionary process, simulating the selection of the strongest individuals over weaker ones through mechanisms such as selection, crossover, and mutation. The new approach incorporates reinforcement learning during the selection of attributes for tree construction by optimizing sample usage. By assessing variable significance, it identifies the most significant variables for node splitting improving model development and maximizing training data utilization. In addition to internal cross-validation, the method minimizes parameter tuning, mitigates overfitting, accelerates computations, and enhances transparency. The proposed model Genetic Algorithm based ARIMA achieves better results for enhancing crop yield forecasting on evaluation metrics, i.e., MAE (0.80%), RMSE (3.75%), RRSE (1.21%), RAE (0.82%), MSE (0.07%), R2 (0.54%) and accuracy (80.00%). For Reinforced Random Forest Algorithm model, i.e. MAE (1.28%), RMSE (2.48%), RRSE (0.54%), RAE (0.91%), MSE (0.55%), R2 (0.98%) and accuracy (78.00%). The analysis reveals that the genetic algorithm based ARIMA model outperforms the reinforced random forest algorithm in terms of efficiency and accuracy. Both proposed models better perform than machine learning classical models excelling not only in enhanced crop yield forecasting but also in terms of computational efficiency. [ABSTRACT FROM AUTHOR]

Predictive sports data analytics can be revolutionary for sports performance. Existing literature discusses players' or teams' performance, independently or in tandem. Using Machine Learning (ML), this paper aims to holistically evaluate player-, team-, and conference (season)-level performances in Division-1 Women's basketball. The players were monitored and tested through a full competitive year. The performance was quantified at the player level using the reactive strength index modified (RSImod), at the team level by the game score (GS) metric, and finally at the conference level through Player Efficiency Rating (PER). The data includes parameters from training, subjective stress, sleep, and recovery (WHOOP straps), in-game statistics (Polar monitors), and countermovement jumps. We used data balancing techniques and an Extreme Gradient Boosting (XGB) classifier to predict RSI and GS with greater than 90% accuracy and a 0.9 F1 score. The XGB regressor predicted PER with an MSE of 0.026 and an R2 of 0.680. Ensemble of Random Forest, XGB, and correlation finds feature importance at all levels. We used Partial Dependence Plots to understand the impact of each feature on the target variable. Quantifying and predicting performance at all levels will allow coaches to monitor athlete readiness and help improve training. [ABSTRACT FROM AUTHOR]

Post-processing using deep learning algorithms can be conducted to improve accuracy of hydrologic predictions and quantify their uncertainty. In this paper, a revised version of the Local uncertainty estimation model (LUEM-R) and the circular block bootstrap (CBB) method have been used to improve the accuracy of the Variable Infiltration Capacity's (VIC) streamflow simulation and quantify its uncertainty. We used the simulated and observed streamflow at the gauge located in North CAPE Fear basin, USA from the Dayflow dataset. In the LUEM-R method, a combination of Gaussian Mixture Model and Long Short-Term Memory (LSTM) networks, which are able to capture the dependencies in time series, were used to construct the upper and lower prediction limits (PLs) for the 90% confidence level. In the CBB method, a circular block resampling technique was used to account for the dependencies in the time series (CBB-LSTM). The improved streamflow, calculated as the mean of the LSTM outputs for 200 bootstrap realizations, showed a very high correlation with observations, with coefficient of determination values of 0.97 and 0.87 for the training and testing periods, compared to the 0.77 and 0.74 values for the initial VIC simulations. For the CBB-LSTM method, the 90% PLs were constructed by fitting the best distribution at each time step, accordingly. The PLs bracketed 90% and 70% of observations in the training and testing periods, while being significantly narrower than the LUEM-R bands, which contained 92 and 91 percent of observations in the training and testing periods. Ordinary bootstrapping was also conducted using the Random Forest model (OB-RF). Comparison of the results indicates the superiority of CBB-LSTM method to the OB-RF in improving the accuracy and quantifying the uncertainties in hydrological model simulations. Overall, the CBB-LSTM was successful in improving the deterministic accuracy of VIC model simulations and quantifying its uncertainty. Also, the LUEM-R method could be efficiently utilized in quantification of uncertainty of VIC model simulations. [ABSTRACT FROM AUTHOR]

This paper proposes experimental results and a modeling procedure to analyze the factors affecting the defects of centrifugal pumps. The centrifugal pump is an essential mechanical element. Pump malfunction can cause problems in the entire system because most production facilities are equipped with various centrifugal pumps. Therefore, the diagnosis of pump failure is essential, and several studies have proposed data-driven methodologies for detecting faults in pump systems. Most studies have performed fault classification using only the vibration signal of the pump. However, this study approached the problem in three ways to improve FDC performance. Firstly, this study tried to collect various signals such as pressure, flow, and motor current as well as vibration signals. That is because various signals are likely to indicate the performance of the pump system considering the mechanical characteristics of the centrifugal pump. Secondly, this study presented a methodology for extracting features that can be used in machine learning models from the signals. For objective analysis, not only various statistics were calculated, but also features in the frequency domain were extracted. Using the extracted features, random forest modeling was applied and higher performance was achieved in experiments. Lastly, variables that significantly affected the anomaly detection of the pump were suggested. In order to analyze experimental results of feature importance, we have presented a procedure to introduce a correlation matrix of cosine similarity, which is a new method that has not been attempted in previous research. [ABSTRACT FROM AUTHOR]

Economic progress has been founded on environmental pressure by generating all types of environmental harm, such as an increase in greenhouse gases in the atmosphere and significant climate change, which has forced people to reflect. Building a people-oriented, comprehensive, coordinated system to compile experience and lessons assists the government in formulating appropriate policies according to the meaning of the scientific development viewpoint. Based on the above, this research designs Cost–Benefit Decision Tree (CBDT) Algorithm for the economic protection development level using a Decision Tree (DT) and Ensemble Algorithm. In the design of ML Algorithm, this research work initially introduces the Decision Tree model for economic protection evaluation by emphasizing its value as a basic machine-learning framework for fully examining many aspects of economic protection development. Second, it investigates the critical role of Ensemble Algorithms, such as Random Forest in augmenting the capabilities of DT. Third, the paper focuses on the development of a complete Economic Protection Evaluation Index System using the DT Algorithm. To provide a robust, scientifically sound, and practicable framework for evaluating economic protection, this approach integrates scientificity, comparability, systematization, hierarchy, relative decoupling, and data availability principles. Finally, the study constructs the suggested ML Algorithm using the insights from the preceding parts. This algorithm combines the Decision Tree and Random Forest models to generate a single, effective tool for evaluating economic development levels. The experimental findings suggest that the proposed hybrid assessment technique is effective across several dimensions. The proposed CBDT demonstrated its capacity to adapt to changing data circumstances in evaluating low-carbon efficiency using real-world data from 30 major Chinese cities. Furthermore, the algorithm regularly beats rival techniques regarding efficiency improvements, with an average improvement of 12.5% across all cities. Notably, it outperforms other algorithms regarding computational efficiency, with a quicker execution time and an exceptional accuracy rate of 93.2%. The proposed ML Algorithm improves decision-making in the economic protection development level field by effectively balancing cost and benefit considerations. It will improve accuracy and efficiency to outperform existing approaches, thereby advancing economic protection evaluation and decision-making processes in this domain. [ABSTRACT FROM AUTHOR]

The lithology log, an integral component of the master log, graphically portrays the encountered lithological sequence during drilling operations. In addition to offering real-time cross-sectional insights, lithology logs greatly aid in correlating and evaluating multiple sections efficiently. This paper introduces a novel workflow reliant on an enhanced weighted average ensemble approach for producing high-resolution lithology logs. The research contends with a challenging multiclass imbalanced lithofacies distribution emerging from substantial heterogeneities within subsurface geological structures. Typically, methods to handle imbalanced data, e.g., cost-sensitive learning (CSL), are tailored for issues encountered in binary classification. Error correcting output code (ECOC) originates from decomposition strategies, effectively breaking down multiclass problems into numerous binary subproblems. The database comprises conventional well logs and lithology logs obtained from five proximate wells within a Middle Eastern oilfield. Utilizing well-known machine learning (ML) algorithms, such as support vector machine (SVM), random forest (RF), decision tree (DT), logistic regression (LR), and extreme gradient boosting (XGBoost), as baseline classifiers, this study aims to enhance the accurate prediction of underground lithofacies. Upon recognizing a blind well, the data from the remaining four wells are utilized to train the ML algorithms. After integrating ECOC and CSL techniques with the baseline classifiers, they undergo evaluation. In the initial assessment, both RF and SVM demonstrated superior performance, prompting the development of an enhanced weighted average ensemble based on them. The comprehensive numerical and visual analysis corroborates the outstanding performance of the developed ensemble. The average Kappa statistic of 84.50%, signifying almost-perfect agreement, and mean F-measures of 91.04% emphasize the robustness of the designed ensemble-based workflow during the evaluation of blind well data. [ABSTRACT FROM AUTHOR]

Topographic variables derived from digital elevation models (DEM) are the most commonly used predictor in soil organic carbon (SOC) prediction. The predictability of these variates for the spatial heterogenity of SOC is influenced by the size of DEM resolution. This paper aimed to investigate the resolution effect of the topography at multiple DEM resolutions and select the most important predictors and the optimal resolution for SOC prediction in a large-scale and morphologically complex area. The study area, covering 15 600 km2, was located in a mountainous province in China. A total of 3901 soil samples and three machine learning algorithms including random forest, gradient boosted regression tree, and artificial neural network were used to construct the SOC predictive models at resolutions of 30, 90, 150, 210, 270, 330, and 390 m. Topographic factors were derived from the DEM with an original resolution of 30 m and were subsequently resampled to varying resolutions by using the bilinear interpolation algorithm. The importance of each variate in each predictive model was computed for the most important predictor selection, and the determination coefficient (R2) and Root Mean Square Error (RMSE) of each predictive model were computed for the accuracy evaluation. Comparative analysis on point-based topographic representation, the accuracy of predictive models, and the variable importance was conducted among different resolutions to investigate the resolution effect on the SOC prediction and to select the optimal resolution for this study area. The results showed that topography was the key factor influencing the SOC distribution in this large-scale area due to the region's mountainous nature, and the relative contribution of the topography to predict SOC distribution varied with DEM resolutions. Elevation was the most important topographic factor at all DEM resolutions. Accuracies of predictive models built on the three machine learning algorithms were all dependent on DEM resolution, indicating that DEM resolution had an important effect on SOC prediction. Overall, the random forest predictive models outperformed the other two algorithms, and its most accurate result was obtained at the 210-m resolution with an R2 of 0.25 and an RMSE of 4.77 g kg–1. In conclusion, we found that finer resolutions did not necessarily produce more accurate SOC predictions even in a large-scale and morphologically complex area. Therefore, investigating the resolution effect is suggested to select an optimal resolution for the SOC prediction in other regions characterized by similar geomorphological conditions as this study area. [ABSTRACT FROM AUTHOR]

In the last few decades, technological improvements have had a considerable impact on education, much like many other fields of society and human endeavor. The applications of today's cutting-edge technology are numerous in education, but recently researchers focused on using these technologies, especially artificial intelligence (AI) and machine learning (ML), for students' performance prediction prior to the exam. It makes perfect sense to forecast student success to help all participants in the educational process. Student performance prediction may assist them in the selection of suitable courses and in creating their academic schedules. Keeping in mind the importance of student performance evaluation, this paper analyzes the prediction rate of college English level 4 by using one of the powerful ML algorithms called random forest (RF). RF uses numerous classifiers, or "ensembles", rather than just one classifier, and is based on the decision tree technique. To do this, we constructed input and output variables and collected data for these variables, including basic student information (gender, ethnicity, major), English scores on college admission exams, college English scores (total of four semesters), and extracurricular activities of college students. Preprocessing was performed on the collected data, which included the removal of unnecessary attributes, handling outliers, normalization, and data cleaning. After the preprocessing, the features were extracted and transformed into reduced dimensionality by the local-preserving projection (LPP) algorithm. From the extracted features, we selected only the most relevant in order to feed them as input to the RF model. The model is implemented in MATLAB in order to evaluate its performance. The efficiency of the proposed model is evaluated with the help of experiments in order to verify the effectiveness of the model. The performance of the RF algorithm-based college English IV pass rate prediction model is evaluated by computing the prediction accuracy, recall rate, and hit rate of the classification results. We achieved a prediction accuracy of 96.5%, a recall rate of 89.5%, and a hit rate of 93.3%. The results show that the random RF-based prediction model for college English level 4 has a good classification effect and that the prediction results are more accurate. [ABSTRACT FROM AUTHOR]

Personality reflects how people can behave in different situations and affects their decisions. Analyzing personality is useful in many fields, for example in the prediction of performance in a job. Emotion recognition is another important research topic due to the wide spread of social media. People express their feeling in form of Facebook posts, tweeter real reactions, and shares. Understanding both personality and emotions from the written text is much easier when it comes to humans. However, this task is impossible with the huge amount of data spread all other social media. The use of machine learning algorithms for personality and emotion recognition from text data is a new research field. In this paper, we propose an enhanced recognition system for personality recognition and emotion recognition. The proposed enhanced recognition system is composed of four main modules, namely data acquisition module, data preprocessing module, personality recognition module, and emotion recognition module. Several machine learning algorithms are used for the multiclass classification process. Gray wolf optimization (GWO) algorithm is used for hyperparameter optimization, while group GWO (GGWO) algorithm is used for feature selection. The proposed model could achieve an accuracy of 99.99% using the random forest algorithm for personality detection and 88.06% using a decision tree for emotion recognition, which outperforms other state-of-the-art studies. We can profit from social media despite some of its drawbacks by understanding people's emotions through their tweets, posts, etc. For instance, before someone commits suicide, we can tell what their intentions are. Most suicide committers, according to recent studies, leave suicide notes on their social media accounts, and these letters need to be taken seriously. [ABSTRACT FROM AUTHOR]

The cultivation of most crops depends upon the regional weather conditions. So, the analysis of the agro-climatic conditions of a zone contributes significantly to deciding the right crop for the right land in the right season to obtain a better yield. Machine learning algorithms facilitate this process to a great extent for better results. In this paper, the authors proposed an ML-based crop selection model based on the weather conditions and soil parameters, collectively. Weather analysis is done using LSTM RNN and the process of crop selection is completed using Random Forest Classifier. This model gives better results for weather prediction in comparison to ANN. With LSTM RNN, the RMSE observed in Min. Temp. prediction is 5.023%, Max. Temp. Prediction is 7.28%, and Rainfall Prediction is 8.24%. In the second phase, the Random Forest Classifier showed 97.235% accuracy for crop selection, 96.437% accuracy in predicting resource dependency, and 97.647 accuracies in giving the appropriate sowing time for the crop. The model construction time taken with a random forest classifier using mentioned data size is 5.34 s. The authors also suggested the future research direction to further improve this work. [ABSTRACT FROM AUTHOR]

With the increasing amount of digital data generated by Arabic speakers, the need for effective and efficient document classification techniques is more important than ever. In recent years, both quantum computing and machine learning have shown great promise in the field of document classification. However, there is a lack of research investigating the performance of these techniques on the Arabic language. This paper presents a comparative study of quantum computing and machine learning for two datasets of Arabic language document classification. In the first dataset of 213,465 Arabic tweets, both classic machine learning (ML) and quantum computing approaches achieve high accuracy in sentiment analysis, with quantum computing slightly outperforming classic ML. Quantum computing completes the task in approximately 59 min, slightly faster than classic ML, which takes around 1 h. The precision, recall, and F1 score metrics indicate the effectiveness of both approaches in predicting sentiment in Arabic tweets. Classic ML achieves precision, recall, and F1 score values of 0.8215, 0.8175, and 0.8121, respectively, while quantum computing achieves values of 0.8239, 0.8199, and 0.8147, respectively. In the second dataset of 44,000 tweets, both classic ML (using the Random Forest algorithm) and quantum computing demonstrate significantly reduced processing times compared to the first dataset, with no substantial difference between them. Classic ML completes the analysis in approximately 2 min, while quantum computing takes approximately 1 min and 53 s. The accuracy of classic ML is higher at 0.9241 compared to 0.9205 for quantum computing. However, both approaches achieve high precision, recall, and F1 scores, indicating their effectiveness in accurately predicting sentiment in the dataset. Classic ML achieves precision, recall, and F1 score values of 0.9286, 0.9241, and 0.9249, respectively, while quantum computing achieves values of 0.92456, 0.9205, and 0.9214, respectively. The analysis of the metrics indicates that quantum computing approaches are effective in identifying positive instances and capturing relevant sentiment information in large datasets. On the other hand, traditional machine learning techniques exhibit faster processing times when dealing with smaller dataset sizes. This study provides valuable insights into the strengths and limitations of quantum computing and machine learning for Arabic document classification, emphasizing the potential of quantum computing in achieving high accuracy, particularly in scenarios where traditional machine learning techniques may encounter difficulties. These findings contribute to the development of more accurate and efficient document classification systems for Arabic data. [ABSTRACT FROM AUTHOR]

As there is a constant trade-off between carbon dioxide emissions against economic growth for every government, carbon efficiency is a key indicator to guide sustainable development. However, the energy crisis and COVID-19 recovery (declined cases of COVID-19 infection, flight recovery, manufacturing restart, and increasing import and export trading) could affect carbon efficiency. Therefore, this paper combines the fuzzy regression discontinuity and random forest algorithm (RF-FRD method) to estimate the discontinuity of the energy crisis and COVID-19 recovery on carbon efficiency. The findings show that discontinuity points in carbon efficiency were induced by the energy crisis and COVID-19 recovery. The positive treatment effect at the first discontinuity point proves that the "zero-tolerance" policies effectively promote carbon efficiency. Besides, the negative treatment effect at the second discontinuity point proves that electricity rationing has not always improved carbon efficiency during the energy crisis. [ABSTRACT FROM AUTHOR]

In today's constantly advancing economy, fast and efficient load frequency control (LFC) schemes are imperative for stable power systems operation, whether conventional or new. Despite recent advances in this domain, professional engineers, to this day, face significant obstacles in dealing with parametric uncertainty and the rejection of external disturbances. To ensure high-quality, resilient, and consistent electrical power, the developed controllers must operate efficiently, i.e., counteract frequency and tie-line power deviations. In light of this, the current study presents a novel strategy employing several machine learning algorithms to remedy the LFC dilemma, estimating the optimal controller gain values in a real-time environment. A comprehensive case study incorporating random load perturbations exemplified the trained controllers' accuracy, robustness, and adaptability. The proposed online controllers, integrated into emerging power systems with several adjoining regions, renewable sources, and nonlinearities, outperform benchmark procedures. A rank-based statistical analysis implementing the Friedman test reveals Random Forest to be the most effective of the studied algorithms in terms of providing the lowest integral-criteria error values while preserving the minimal peak overshoot, undershoot, and settling duration. This paper demonstrates the significant potential of the suggested framework in addressing the LFC predicament in relevant sectors. [ABSTRACT FROM AUTHOR]

Insufficient data is always a challenge for developing an accurate machine learning or deep learning model in manufacturing processes, especially in tool wear monitoring under varied cutting conditions. This paper presents a Random Forest model for predicting tool wear under varied cutting conditions as well as studies extracted signal features. The Random Forest algorithm was chosen as the machine learning model, rather than the novel deep learning model. This was due to the feature importance investigation, which was embedded in the Random Forest algorithm, thereby making it easier to study the physical meanings of signal features. The frequency domain signals were rearranged as features related to spindle speeds and machine tool structure based on domain knowledge. This is the first paper to rearrange the frequency domain signals for observing the physical meanings of selected features. When data normalization was adopted, frequency domain signals related to spindle speeds were excluded from important features. Only spectrum energy related to structure vibration and time domain signals were important features. Data normalization enhanced the weighting of structure vibration features in a machine learning model. This study showed that feature normalization made the machine learning model more adaptable to different cutting conditions. Furthermore, prediction accuracy for cutting condition of spindle speed = 42,000 rpm and feed = 1.5 μm/rev (lowest prediction accuracy among cutting tests in this study) showed an increase from 68.0 to 84.1%. In addition, spindle speed had a more significant effect than feed on classification accuracy in tool wear monitoring based on experimental results. As a result, at least two data sets of the same spindle speed as in tool wear prediction were recommended to be used for model training. When there were at least two data sets in training data with the same spindle speed as in testing data, the study showed prediction accuracies were greater than 75% without data normalization and 81% with data normalization. [ABSTRACT FROM AUTHOR]

In this paper, the prediction of flexural strength was investigated using machine learning methods for concrete containing supplementary cementitious materials such as silica fume. First, based on a database of suitable characteristic parameters, the flexural strength prediction was carried out using linear (LR) model, random forest (RF) model, and extreme gradient boosting (XGB) model. Subsequently, the influence of each input parameter on the flexural strength was analyzed using the SHAP model based on the optimal prediction model. The results showed that LR, RF, and XGB enhanced the accuracy of forecasting sequentially. Among the characteristic parameters, the most significant effect on the flexural strength of concrete is the water-binder ratio, and the water-binder ratio shows a negative correlation with flexural strength. The effect of maintenance age on flexural strength is second only to the water-binder ratio, and it shows a positive trend. When the amount of fly ash is less than 40% and the amount of slag or silica fume is less than 30%, the correlation between the amount of supplementary cementitious materials and flexural strength fluctuates and a positive peak in flexural strength is observed. However, at a dosage greater than the above, the supplementary cementitious materials all reduce flexural strength. The interaction interval and the degree of interaction between the supplementary cementitious materials and the cement content also differ in predicting flexural strength. [ABSTRACT FROM AUTHOR]

With the increasing amount of digital data generated by Arabic speakers, the need for effective and efficient document classification techniques is more important than ever. In recent years, both quantum computing and machine learning have shown great promise in the field of document classification. However, there is a lack of research investigating the performance of these techniques on the Arabic language. This paper presents a comparative study of quantum computing and machine learning for two datasets of Arabic language document classification. In the first dataset of 213,465 Arabic tweets, both classic machine learning (ML) and quantum computing approaches achieve high accuracy in sentiment analysis, with quantum computing slightly outperforming classic ML. Quantum computing completes the task in approximately 59 min, slightly faster than classic ML, which takes around 1 h. The precision, recall, and F1 score metrics indicate the effectiveness of both approaches in predicting sentiment in Arabic tweets. Classic ML achieves precision, recall, and F1 score values of 0.8215, 0.8175, and 0.8121, respectively, while quantum computing achieves values of 0.8239, 0.8199, and 0.8147, respectively. In the second dataset of 44,000 tweets, both classic ML (using the Random Forest algorithm) and quantum computing demonstrate significantly reduced processing times compared to the first dataset, with no substantial difference between them. Classic ML completes the analysis in approximately 2 min, while quantum computing takes approximately 1 min and 53 s. The accuracy of classic ML is higher at 0.9241 compared to 0.9205 for quantum computing. However, both approaches achieve high precision, recall, and F1 scores, indicating their effectiveness in accurately predicting sentiment in the dataset. Classic ML achieves precision, recall, and F1 score values of 0.9286, 0.9241, and 0.9249, respectively, while quantum computing achieves values of 0.92456, 0.9205, and 0.9214, respectively. The analysis of the metrics indicates that quantum computing approaches are effective in identifying positive instances and capturing relevant sentiment information in large datasets. On the other hand, traditional machine learning techniques exhibit faster processing times when dealing with smaller dataset sizes. This study provides valuable insights into the strengths and limitations of quantum computing and machine learning for Arabic document classification, emphasizing the potential of quantum computing in achieving high accuracy, particularly in scenarios where traditional machine learning techniques may encounter difficulties. These findings contribute to the development of more accurate and efficient document classification systems for Arabic data. [ABSTRACT FROM AUTHOR]

We briefly review the state-of-the-art machine learning (ML) algorithms for mineral exploration, which mainly include random forest (RF), convolutional neural network (CNN), and graph convolutional network (GCN). In recent years, RF, a representative shallow machine learning algorithm, and CNN, a representative deep learning approach, have been proved to be powerful tools for ML-based mapping for mineral exploration. In the future, GCN deserves more attention for ML-based mapping for mineral exploration because of its ability to capture the spatial anisotropy of mineralization and its applicability within irregular study areas. Finally, we summarize the original contributions of the six papers comprising this special issue. [ABSTRACT FROM AUTHOR]

Machine learning approaches are increasingly being employed to forecast the key characteristics of strong ground motions, including the challenging classification of Pulse-Like (PL) ground motions. The PL ground motions are characterized by their impulsive nature and have the potential to cause significant damage to structures. The classification of PL ground motions continues to be a significant challenge due to the absence of consensus on their definition and categorization. This paper investigates the potential benefits of several Machine Learning Classifiers (MLCs) algorithms such as decision tree, random forest, logistic regression, naive Bayes, support vector machine, K-nearest neighbor, ensemble model, and artificial neural network models for predicting PL and Non-Pulse-Like (NPL) ground motions. In this regard, a dataset comprising 200 near-fault ground motions records compiled from active tectonic regions like Taiwan, Turkey, Iran, and Japan, was divided into 2 portions, with 75% used to train the model and the remaining 25% used for testing. Plots of performance metrics, confusion matrix, and receiver operating curve indicate that the ensemble classifier outperforms the other classifier with 86.2% accuracy and the lowest misclassification of PL and NPL ground motions. Additionally, the trained MLC has been compared with the existing ground motion classification models to further assess the accuracy of the different classifiers in the present study. [ABSTRACT FROM AUTHOR]

Phishing is a fraudulent tactic for attackers to obtain victims personal information, such as passwords, account details, credit card details, and other sensitive information. Existing anti-phishing detection methods using at the application layer and cannot be applied at the transport layer. A novel machine learning (ML) based phishing detection technique from transport layer security (TLS) 1.2 and TLS 1.3 encrypted traffic without decryption is proposed in this paper. Our proposed model detects phishing URLs at the transport layer and classifies them as legitimate or phishing. The features are extracted from TLS 1.2 and TLS 1.3 traffic, and phishing detection is performed using ML algorithms based on the extracted features. The datasets for legitimate and phishing sites are created using features derived from TLS 1.2 and TLS 1.3 traffic. According to the experimental results, the proposed model effectively detects phishing URLs in encrypted traffic. The proposed model achieves an accuracy of 93.63% for Random Forest (RF), 95.07% for XGBoost (XGB), and the highest accuracy of 95.40% for Light GBM (LGBM). [ABSTRACT FROM AUTHOR]

The cultivation of most crops depends upon the regional weather conditions. So, the analysis of the agro-climatic conditions of a zone contributes significantly to deciding the right crop for the right land in the right season to obtain a better yield. Machine learning algorithms facilitate this process to a great extent for better results. In this paper, the authors proposed an ML-based crop selection model based on the weather conditions and soil parameters, collectively. Weather analysis is done using LSTM RNN and the process of crop selection is completed using Random Forest Classifier. This model gives better results for weather prediction in comparison to ANN. With LSTM RNN, the RMSE observed in Min. Temp. prediction is 5.023%, Max. Temp. Prediction is 7.28%, and Rainfall Prediction is 8.24%. In the second phase, the Random Forest Classifier showed 97.235% accuracy for crop selection, 96.437% accuracy in predicting resource dependency, and 97.647 accuracies in giving the appropriate sowing time for the crop. The model construction time taken with a random forest classifier using mentioned data size is 5.34 s. The authors also suggested the future research direction to further improve this work. [ABSTRACT FROM AUTHOR]

Gastric Cancer is the most common malignancy of the digestive tract, which is the third leading cause of cancer-related mortality worldwide. The early prognosis methods, especially Machine Learning (ML)-based approaches are one of the main strategies against GC, which have become a necessity to identify and prognosticate the factors that affect the GC. They enable the specialists to accelerate the subsequent clinical management of patients, who suffer from the GC. This paper aims at creating an Ensemble Method inspired from ML to predict the most significant factors of the GC occurrence. The main objective of this research is to predict the probabilities of the GC occurrence and its associated deaths. To achieve this goal, the created EM benefits from some ML-based methods, including Least Absolute Shrinkage and Selection Operator (LASSO)/Ridge Regression, Elastic Net, Logistic Regression (LR), Random Forest (RF), Gradient Boosting Decision Trees (GBDTs), and Deep Neural Network (DNN). The purpose of the provided EM is to lessen the prediction errors for the large number of the patients' features. The main novelties of this research include: (i) A sequential EM created by a Stacking method to predict the probability of the GC and associated deaths; (ii) Benefiting from the significance level to make an accurate prediction; (iii) Employing two Chi-square tests to select the influent features; (iv) Tuning the parameters of the applied ML models to avoid over-fitting and intensifying the errors; (v) Applying different kinds of the regression methods to treat hyper-dimension cases; (vi) A new model for weighting the applied ML models. The outcomes of the implementation of the created EM in seven pioneer hospitals in the field of GC show that the designed EM generates more precise predictions with an accuracy of 97.9% and 76.3% to predict the GC and its associated deaths, respectively. Moreover, the obtained results from the Area Under Curve (AUC) validates and confirms the capability of the created EM to predict the probability of the GC and its related deaths with an accuracy of 98% and 90% to predict the GC and its associated deaths, respectively. [ABSTRACT FROM AUTHOR]

Molecular dynamics of charged particles in porous conductive media have received considerable attention in recent years due to their application in cutting-edge technologies such as batteries and supercapacitors. Due to the presence of long-range electrical interactions, induced charges present at the boundary, and the influence of boundary conditions, the simulation of these systems is more challenging than the simulation of typical molecular dynamic systems. Simulating these kinds of systems typically involves using a numerical solver to solve the Poisson equation, which is a very time-consuming procedure. Recently, Physics-Informed Neural Networks (PINNs) have been introduced as an alternative to numerical solutions of PDEs. In this paper, we present a new PINN-based model for predicting the potential of point-charged particles surrounded by conductive walls. As a result of the proposed PINN model, the mean square error is less than 7 % and R 2 score is more than 90 % for the corresponding example simulation. Results have been compared with typical neural networks and random forest as standard machine learning algorithms. The R 2 score of the random forest model was 70 % , and a standard neural network could not be trained well. [ABSTRACT FROM AUTHOR]

Web robots are automated computer programs that can be exploited for benign and malicious activities such as website indexing, monitoring, or unauthorized content scraping and scalping. Several methods are available to detect automated web robots through their footprints and behaviors. Although the accuracy and efficiency of existing methods depend highly on the labeled web log data, countless web requests are generated daily with the help of web robots. Exhaustive and accurate manual labeling of reconstructed sessions is time-consuming and challenging. Further, effective detection of web robots is more challenging with unlabeled or partially labeled data. To address the aforementioned issues, we reformulated web robot detection as a semi-supervised learning problem. In this paper, we propose a deep learning-based Semi-Supervised Stacked Sparse AutoEncoder (Web-S4AE) for web robot detection. The proposed model uses content-based features and features extracted from web access log data to effectively classify web robots. The experiments were conducted on publicly available web log data from a library and information portal to assess the performance of Web-S4AE. The Web-S4AE model was trained in two phases. The first phase; comprises training the model with unlabeled data to extract the hidden information, and in the second phase, the model is fine-tuned using labeled data. The results suggest that incorporating more unlabeled data can significantly improve the classifier's performance. The Web-S4AE model's performance was also compared with other models such as the Decision Tree (DT), Random Forest (RF), eXtreme Gradient Boosting (XGBoost), and Multi-Layer Perceptron (MLP). [ABSTRACT FROM AUTHOR]

The operation of large utility companies such as Consolidated Edison Company of New York, Inc. (Con Edison) typically rely on large quantities of regulation documents from external institutions which inform the company of upcoming or ongoing policy changes or new requirements the company might need to comply with if deemed applicable. As a concrete example, if a recent regulatory publication mentions that the timeframe for the Company to respond to a reported system emergency in its service territory changes from within X time to within Y time—then the affected operating groups will be notified, and internal Company operating procedures may need to be reviewed and updated accordingly to comply with the new regulatory requirement. Each such regulation document needs to be reviewed manually by an expert to determine if the document is relevant to the company and, if so, which department it is relevant to. In order to help enterprises improve the efficiency of their operation, we propose an automatic document classification pipeline that determines whether a document is important for the company or not, and if deemed important it forwards those documents to the departments within the company for further review. Binary classification task of determining the importance of a document is done via ensembling the Naive Bayes (NB), support vector machine (SVM), random forest (RF), and artificial neural network (ANN) together for the final prediction, whereas the multi-label classification problem of identifying the relevant departments for a document is executed by the transformer-based DocBERT model. We apply our pipeline to a large corpus of tens of thousands of text data provided by Con Edison and achieve an accuracy score over 80 % . Compared with existing solutions for document classification which rely on a single classifier, our paper i) ensemble multiple classifiers for better accuracy results and escaping from the problem of overfitting, ii) utilize pretrained transformer-based DocBERT model to achieve ideal performance for multi-label classification task and iii) introduce a bi-level structure to improve the performance of the whole pipeline where the binary classification module works as a rough filter before finally distributing the text to corresponding departments through the multi-label classification module. [ABSTRACT FROM AUTHOR]

Severe air pollution poses a significant threat to public safety and human health. Predicting future air quality conditions is crucial for implementing pollution control measures and guiding residents' activity choices. However, traditional single-module machine learning models suffer from long training times and low prediction accuracy. To improve the accuracy of air quality forecasting, this paper proposes a ISSA–LSTM model-based approach for predicting the air quality index (AQI). The model consists of three main components: random forest (RF) and mRMR, improved sparrow search algorithm (ISSA), and long short-term memory network (LSTM). Firstly, RF–mRMR is used to select the influential variables affecting AQI, thereby enhancing the model's performance. Next, ISSA algorithm is employed to optimize the hyperparameters of LSTM, further improving the model's performance. Finally, LSTM model is utilized to predict AQI concentrations. Through comparative experiments, it is demonstrated that the ISSA–LSTM model outperforms other models in terms of RMSE and R2, exhibiting higher prediction accuracy. The model's predictive performance is validated across different time steps, demonstrating minimal prediction errors. Therefore, the ISSA–LSTM model is a viable and effective approach for accurately predicting AQI. [ABSTRACT FROM AUTHOR]

This paper proposes an e-diagnosis system based on machine learning (ML) algorithms to be implemented on the Internet of Medical Things (IoMT) environment, particularly for diagnosing diabetes mellitus (type 2 diabetes). However, the ML applications tend to be mistrusted because of their inability to show the internal decision-making process, resulting in slow uptake by end-users within certain healthcare sectors. This research delineates the use of three interpretable supervised ML models: Naïve Bayes classifier, random forest classifier, and J48 decision tree models to be trained and tested using the Pima Indians diabetes dataset in R programming language. The performance of each algorithm is analyzed to determine the one with the best accuracy, precision, sensitivity, and specificity. An assessment of the decision process is also made to improve the model. It can be concluded that a Naïve Bayes model works well with a more fine-tuned selection of features for binary classification, while random forest works better with more features. [ABSTRACT FROM AUTHOR]

In this paper, laser-induced breakdown spectroscopy (LIBS) combined with machine learning algorithm was used to study the classification of Astragalus from 10 different origins. First, the spectrum of Astragalus from 10 different origins was collected based on LIBS technology, and support vector machine (SVM) and extreme learning machine (ELM) models were established, respectively. Their accuracy rates were 45% and 30%, respectively. After that, the feature variables were selected as the input vectors of SVM and ELM models using random forest (RF) feature importance ranking, and random forest-support vector machine (RF-SVM) and random forest-extreme learning machine (RF-ELM) models were established, respectively. Their accuracy rates were 83.33% and 58.33%, respectively. To improve classification accuracy, gray wolf optimizer (GWO) algorithm was used to optimize RF-SVM and RF-ELM, respectively, and two classification models of gray wolf optimizer-random forest-support vector machine (GWO-RF-SVM) and gray wolf optimizer-random forest-extreme learning machine (GWO-RF-ELM) were constructed. The accuracy rates of GWO-RF-SVM and GWO-RF-ELM models were 85% and 92%, respectively. The results show that the classification effect of GWO-RF-ELM is the best, and its macro-precision, macro-recall and macro-F1 score were 92%, 100%, 92.04% and 95.86%, respectively. It provides an effective method for the identification of Astragalus. [ABSTRACT FROM AUTHOR]

Phishing is one of the most dangerous threats in which a hacker imitates a person, company or government agency to lure and deceive their victims. Machine learning anti-phishing solutions are gaining popularity nowadays. However, most anti-phishing solutions rely heavily on features extracted from third-party services such as whois services, DNS search, and web traffic. As a result, they are slow and require a lot of computing resources. This paper introduces a machine-learning-based framework: Phish-Sight that detects phishing websites through a visual inspection strategy. Phish-Sight uses dominant color features and highly targeted popular brand names embedded in URLs' web pages with machine learning techniques to detect phishing web pages. Prediction performance of the dominant color features and popular brand names from web pages was investigated using five machine learning algorithms. The Random Forest algorithm surpassed the others, with a 98.43% true positive rate and 99.13% accuracy in detecting phishing frauds. The prediction run time per web page measured at 7.6 s suggests that Phish-Sight has potential for real-time applications. [ABSTRACT FROM AUTHOR]

This paper proposes to predict traffic accidents based on IoTs and deep learning to address the current problem of inaccurate traffic accident prediction. Since traditional traffic accident prediction often applies classical prediction algorithms to a small portion of data, the obtained models can only predict a small range of traffic accidents. Most accident prediction models are limited by the lack of data features, do not consider the problems of practical application scenarios, and do not incorporate regional heterogeneity, so the prediction accuracy of accident prediction models is poor. This paper analyzes and summarizes the relationship between traffic accidents and influencing factors from five aspects, such as people, vehicles, roads and environment, and proves the influence of regional heterogeneity on accidents, which paves the way for traffic accident prediction. The data and heterogeneous spatial data are preprocessed and feature selected, respectively. Logistic regression and random forest algorithm are used to train the corresponding prediction models. The results show that the prediction model combined with regional heterogeneity has better comprehensive performance than the original data. [ABSTRACT FROM AUTHOR]

Different modeling techniques must be applied to manage production and statistical estimation to predict the expected harvest. By calculating advanced production methods and the rational valuation of different factors, we can accurately capture the variety of growth characteristics and the expected yield. This paper obtained 32 feature variables related to melons, including phenological features, shape features, and color features. The Gradient Boosted Decision Tree (GBDT) network and the Grid Search (GS) hyperparameter seeking method was applied to calculate the degree of importance of all melon fruits' characteristics and construct prediction models for three expected harvest indexes of melon yield, sugar content, and endocarp hardness. To facilitate growers to carry out prediction and estimation in the field without destroying the melon fruits. The reduced feature variables were selected as inputs. The GBDT model was used to provide a significant advantage in prediction compared to both Random Forest (RF) and Support Vector Regression (SVR) methods. In addition, to verify the feasibility of using only reduced feature variables as input for the evaluation work, this study also compares the predictive effects of the model when all feature variables and only reduced feature variables are used. The GBDT prediction model proposed in this paper predicted melon yield, sugar content, and hardness using reduced features as input, and the model R2 could reach more than 90%. Therefore, this method can effectively help growers carry out early non-destructive inspection and growth prediction of melons in the field. [ABSTRACT FROM AUTHOR]