Search

In this paper, we modify the proof methods of some previously weakly consistent variants of random forest into strongly consistent proof methods, and improve the data utilization of these variants in order to obtain better theoretical properties and experimental performance. In addition, we propose the Data-driven Multinomial Random Forest (DMRF) algorithm, which has the same complexity with BreimanRF (proposed by Breiman) while satisfying strong consistency with probability 1. It has better performance in classification and regression tasks than previous RF variants that only satisfy weak consistency, and in most cases even surpasses BreimanRF in classification tasks. To the best of our knowledge, DMRF is currently a low-complexity and high-performing variation of random forest that achieves strong consistency with probability 1. [ABSTRACT FROM AUTHOR]

Automated disease diagnosis and prediction, powered by AI, play a crucial role in enabling medical professionals to deliver effective care to patients. While such predictive tools have been extensively explored in resource-rich languages like English, this manuscript focuses on predicting disease categories automatically from symptoms documented in the Afaan Oromo language, employing various classification algorithms. This study encompasses machine learning techniques such as support vector machines, random forests, logistic regression, and Naïve Bayes, as well as deep learning approaches including LSTM, GRU, and Bi-LSTM. Due to the unavailability of a standard corpus, we prepared three data sets with different numbers of patient symptoms arranged into 10 categories. The two feature representations, TF-IDF and word embedding, were employed. The performance of the proposed methodology has been evaluated using accuracy, recall, precision, and F1 score. The experimental results show that, among machine learning models, the SVM model using TF-IDF had the highest accuracy and F1 score of 94.7%, while the LSTM model using word2vec embedding showed an accuracy rate of 95.7% and F1 score of 96.0% from deep learning models. To enhance the optimal performance of each model, several hyper-parameter tuning settings were used. This study shows that the LSTM model verifies to be the best of all the other models over the entire dataset. [ABSTRACT FROM AUTHOR]

Classification is a widely used supervised learning technique that enables models to discover the relationship between a set of features and a specified label using available data. Its applications span various fields such as engineering, telecommunication, astronomy, and medicine. In this paper, we propose a novel rule-based classifier called RUCIB (RUle-based Classifier Inspired by BRADO), which draws inspiration from the socio-inspired swarm intelligence algorithm known as BRADO. RUCIB introduces two key aspects: the ability to accommodate multiple values for features within a rule and the capability to explore all data features simultaneously. To evaluate the performance of RUCIB, we conducted experiments using ten databases sourced from the UCI machine learning database repository. In terms of classification accuracy, we compared RUCIB to ten well-known classifiers. Our results demonstrate that, on average, RUCIB outperforms Naive Bayes, SVM, PART, Hoeffding Tree, C4.5, ID3, Random Forest, CORER, CN2, and RACER by 9.32%, 8.97%, 7.58%, 7.4%, 7.34%, 7.34%, 7.22%, 5.06%, 5.01%, and 1.92%, respectively. [ABSTRACT FROM AUTHOR]

Image recognition and classification in the domain of cultural heritage is a complex task that usually requires good image quality and a large dataset. Small dataset is an apparent problem when data availability is limited, often resulting in poor classification performance. The aim of this study is to analyze and compare the performance of four machine learning algorithms, namely random forest, multilayer perceptron classifier, Naïve Bayes, and decision tree, that are used to classify features extracted using eleven pre-trained deep learning architectures from a small set of images representing cultural heritage. The findings imply that random forest and multilayer perceptron classifiers are the most appropriate for the task of image classification of small cultural heritage datasets, as they obtained the highest performance compared to the other two algorithms, particularly when DenseNet121, EfficientNetB0 and NASNetMobile architectures are used for feature extraction. In addition, for the classification of features extracted using NASNetMobile all the four utilized machine learning algorithms obtained high accuracy ranging from 88.89 to 95.56%. [ABSTRACT FROM AUTHOR]

Skin lesion classification plays a crucial role in the early detection and diagnosis of various skin conditions. Recent advances in computer-aided diagnostic techniques have been instrumental in timely intervention, thereby improving patient outcomes, particularly in rural communities lacking specialized expertise. Despite the widespread adoption of convolutional neural networks (CNNs) in skin disease detection, their effectiveness has been hindered by the limited size and data imbalance of publicly accessible skin lesion datasets. In this context, a two-step hierarchical binary classification approach is proposed utilizing hybrid machine and deep learning (DL) techniques. Experiments conducted on the International Skin Imaging Collaboration (ISIC 2017) dataset demonstrate the effectiveness of the hierarchical approach in handling large class imbalances. Specifically, employing DenseNet121 (DNET) as a feature extractor and random forest (RF) as a classifier yielded the most promising results, achieving a balanced multiclass accuracy (BMA) of 91.07% compared to the pure deep-learning model (end-to-end DNET) with a BMA of 88.66%. The RF ensemble exhibited significantly greater efficiency than other machine-learning classifiers in aiding DL to address the challenge of learning with limited data. Furthermore, the implemented predictive hybrid hierarchical model demonstrated enhanced performance while significantly reducing computational time, indicating its potential efficiency in real-world applications for the classification of skin lesions. [ABSTRACT FROM AUTHOR]

Machine learning(ML) based techniques for Land Use Land Cover(LULC) classification is crucial for extracting valuable insights from satellite imagery. The impact of severe class imbalance problems on LULC datasets, added to the limited temporal coverage, incomplete spectral information, spatial resolution constraints, and limitations due to sensor characteristics of a single satellite, hinder the efficient capturing of complex image features. The object-based classification using Gray-level co-occurrence matrix(GLCM) and Simple Non-Iterative Clustering(SNIC) captures the textural and spectral information, respectively, to enhance the accuracy in heterogeneous landscapes and overcome the limitations of pixel-based classification, such as the sensitivity towards noise and spectral confusion in mixed pixels at the cost of increased additional computational steps. In this context, the proposed study leverages high-quality fused images with diverse temporal, spectral, and spatial information obtained by fusing Landsat-8 and Sentinel-2 satellite imageries using Spatial-and-Temporal-Adaptive-Reflectance-Fusion-Model(STARFM). Further, to solve the class imbalance problem, a Granular Computing(GrC) based Segmentation and Textural Analysis(GrCSTA) framework is proposed for reducing the number of image primitives and computations required for subsequent image analysis processes in the object-based classification. The GrCSTA framework focuses on extracting the Spatial Granules(Gs) from the fused imagery using Spatial neighborhood Granulation(SNGr), textural indices of the Gs using GLCM, and reduced textural indices using Principal Component Analysis(PCA). Gs and its reduced textural indices are input features to train the Random Forest(RF) classifier. Experimental results demonstrate that the proposed GrCSTA framework achieves comparably higher accuracy than the state-of-the-art models. [ABSTRACT FROM AUTHOR]

The Q-matrix, which specifies the relationship between items and attributes, is a crucial component of cognitive diagnostic models (CDMs). A precisely specified Q-matrix allows for valid cognitive diagnostic assessments. In practice, a Q-matrix is usually developed by domain experts, and noted as being subjective and potentially containing misspecifications which can decrease the classification accuracy of examinees. To overcome this, some promising validation methods have been proposed, such as the general discrimination index (GDI) method and the Hull method. In this article, we propose four new methods for Q-matrix validation based on random forest and feed-forward neural network techniques. Proportion of variance accounted for (PVAF) and coefficient of determination (i.e., the McFadden pseudo-R2) are used as input features for developing the machine learning models. Two simulation studies are carried out to examine the feasibility of the proposed methods. Finally, a sub-dataset of the PISA 2000 reading assessment is analyzed as illustration. [ABSTRACT FROM AUTHOR]

The surfaces produced by the machining process are sensitive to the type of machining process and the conditions under which it is performed. Thus, surface texture identification is crucial in quality assurance, as it acts as a feedback to the machining process. Machined surface identification using image processing and machine learning (ML)-based techniques is gaining much importance due to industrial automation. This investigation addresses the development of ML models using gray-level co-occurrence matrices (GLCM) features to classify the machined (turned, ground and shaped) surfaces. The influence of distance-based dimensionality reduction techniques (DRT) viz., Fisher's criterion, Separation index and Bhattacharya distance on the performance of the ML-based image classifiers is explored. The GLCM features extracted from the machined surface images are used as inputs to ML classifiers. A threshold criterion function (TCF) is used to select the sensitive features in the DRT. Among all the classifiers, the (Random Forest) RAF model could produce a better classification accuracy as high as 95.3%. Also, analysis results show that the proposed dimensionality reduction methodology with TCF effectively identifies the most sensitive features. A maximum dimensionality reduction of 62% is achieved. The proposed methodology showed a 7.2% improvement in classification accuracy over the techniques reported in the previous study. Thus, developed ML models successfully classify the machined surface images with a minimum time and computational burden on the computer. [ABSTRACT FROM AUTHOR]

Ensemble methods are supervised learning algorithms that provide highly accurate solutions by training many models. Random forest is probably the most widely used in regression and classification problems. It builds decision trees on different samples and takes their majority vote for classification and average in case of regression. However, such an algorithm suffers from a lack of explainability and thus does not allow users to understand how particular decisions are made. To improve on that, we propose a new way of interpreting an ensemble tree structure. Starting from a random forest model, our approach is able to explain graphically the relationship structure between the response variable and predictors. The proposed method appears to be useful in all real-world cases where model interpretation for predictive purposes is crucial. The proposal is evaluated by means of real data sets. [ABSTRACT FROM AUTHOR]