Search

This research highlights the underestimated significance of cigarette paper as evidence at crime scenes. The primary objective is to distinguish cigarette paper from similar-looking alternatives, addressing the first research objective. The second objective involves identifying cigarette paper brands using attenuated total reflectance Fourier transform infrared (ATR-FTIR) spectroscopy and machine learning (ML) algorithms. Accurate differentiation of cigarette paper from normal paper is emphasized. ATR-FTIR spectroscopy, coupled with principal component analysis (PCA) for dimensionality reduction, is employed for brand identification. Among fifteen ML algorithms compared, the CatBoost classifier excels for both objectives. This research presents a non-destructive, effective method for studying cigarette paper, contributing valuable insights to crime scene investigations. [Display omitted] • Forensic evaluation of cigarette paper utilizing ATR-FTIR spectroscopy and Machine learning algorithms. • Peak characterization and differentiation-distinguishing cigarette paper from other types. • Machine learning algorithm comparison: assessing discrimination across nine cigarette brands. • External validation of the dominant algorithm using unknown samples. [ABSTRACT FROM AUTHOR]

A critical aspect of software engineering is Software fault prediction which aims to identify and prevent errors in software systems before their release which can cause failures or issues for its users. Various techniques and tools have been developed to detect software faults, including static code analysis, dynamic testing, and machine learning-based approaches. In past few years, the world has seen a growing interest in the use of ML models for predicting software faults, as they can effectively analyse high dimensional datasets and detect complex patterns which are difficult for human experts to detect. However, developing accurate and reliable software fault detection models requires careful selection of data, feature engineering, and model evaluation. This purpose of this paper is to present a comprehensive analysis of potential applications and future research directions in the field of software fault detection. The study emphasizes the importance of identifying and addressing software faults to ensure the reliability and efficiency of software systems. Additionally, the paper outlines various approaches and techniques that can be employed for effective software fault detection. [ABSTRACT FROM AUTHOR]

One of the most dangerous threats in WSNs is botnet attacks, in which attackers use mutual communications between IoT devices to launch large-scale malicious activities. In this regard, developments in the field of effective and reliable means of defence against this type of threat, in particular, reliable methods for detecting, identifying, and countering botnet attacks, are becoming increasingly important and relevant. This paper presents a comprehensive study that applies machine learning techniques, namely Random Forest and XGBoost, to identify botnet attacks on IoT effectively. These algorithms are analyzed, compared, and shown to be highly effective in detecting complex patterns indicative of botnet activity, thus achieving a significant improvement in IoT security. The conducted research aims to make a useful contribution to the problem of securing WSNs and IoT in general. The results of the study demonstrated high accuracy in detecting attacks with an accuracy of 99.18% for XGBoost and Random Forest showed an accuracy of 99.21%. Thus, it was shown that the significance of applying machine learning techniques such as Random Forest and XGBoost can be one of the key approaches in combating botnet attacks and securing the IoT. The results of the work emphasize the promising application of machine learning techniques for effective defense against cyber threats and highlight the importance of further. [ABSTRACT FROM AUTHOR]

Product recommendation systems are an important aspect of retailing because of the improved shopping experience provided for customers. Due to the wide range of products offered by retailers, recommendation systems provide an optimal approach for displaying only relevant products to customers by forming associations that exist between products. Still, it is also important to understand the characteristics of customers connected to different product associations. Conventional approaches for product recommendation systems apply association algorithms and unsupervised classification of customers based on product ratings. However, it is not clear what demographic properties of customers are linked to which different product associations. This paper applies a hybrid system of machine learning (ML) association and clustering algorithms to implement a product recommendation system that shows associations that exist in products and unique customer profiles linked to these associations. The method described in this paper is evaluated with a case of a hygiene product retailer in Austria. [ABSTRACT FROM AUTHOR]

Techniques for classifying data using data mining are now a day prevalent in agriculture. The method of classifying seeds involves grouping various seed varieties according to their morphological characteristics. To accomplish categorization of the typical Charotar region (generally comprising Anand and Kheda districts of the Gujarat State of India) Gujarat Wheat (GW) varieties (TRITICUM – AESTIVUM) viz. GW 273, GW 496, GW 322, LOK-1, and GDW 1255 (TRITICUM – DURUM), Weka Explorer was used. The features used are area, perimeter, solidity, aspect ratio, major and minor axis of seed kernel, Hue, Saturation, Value, and SF1 (empirical). Features reduction was done using Information Gain (IG) and its modified version Gain Ratio (GR). This paper compares performance of Tree based data mining algorithms in classifying wheat varieties. For classification we used purely tree-based machine learning algorithms viz. J48, Random Forest, Hoeffding Tree, Logistic Model Tree (LMT), and REPTree. LMT- logistics regression method gives higher accuracy 96.4% compared to other classifiers. Hoeffding Tree classifiers stood second with 96% accuracy. For validation 10-fold cross validation was used. By reducing the number of folds in cross validation performance of most algorithms decreased except J48. The percentage of correctly classified instance increased for all algorithms when features were selected by GR except for J48. [ABSTRACT FROM AUTHOR]

Rao algorithms that include three algorithms are very simple and parameter-less algorithms with effective and desirable performance. This paper modifies these three algorithms, merges them, and establishes a powerful group algorithm. In the first optimization step, the suggested algorithm is tested on 30 standard CEC2014 functions with 50 dimensions to compare it with main algorithms, several well-known algorithms, and modified versions of RAO algorithm. It becomes evident in the first test that the suggested optimizer is effective, and reliable for optimization of real-parameter functions, and it has shown its superiority to original RAO algorithm and several modern and modified versions of RAO algorithms for most of the test functions and achieved more acceptable results than them. Moreover, the suggested algorithm benefits a faster convergence characteristic than original RAO algorithms. The proposed Colonial Competitive RAO (CCRAO) has been applied on five popular engineering problems and its results have been compared with those of recent papers. According to the results, CCRAO is an effective, robust, and reliable optimizer for engineering design problems and can contain all useful features of RAO algorithms altogether. CCRAO has succeeded to converge to the best solution for these engineering problems and surpasses most of the other algorithms. [ABSTRACT FROM AUTHOR]

Stock market trading is a major and predominant activity when one talks about the financial markets. With the inevitable uncertainty and volatility in the prices of the stocks, an investor keeps looking for ways to predict the future trends in order to dodge the losses and make the maximum possible profits. However, it cannot be denied that as of yet there is no such technique to predict the upcoming trends in the markets with complete accuracy, while multiple methods are being explored to improve the predictive performance of models to an extent as large as possible. With the advancement in Machine Learning (ML) and Deep Learning (DL) over the past few years, many algorithms are being deployed for stock price prediction. This paper researches 5 algorithms namely K-Nearest Neighbors, Linear Regression, Support Vector Regression, Decision Tree Regression, and Long Short-Term Memory for predicting stock prices of 12 leading companies of the Indian stock market. After exhaustive research of the various aspects related to the application of ML in stock market, a data extensive implementation has been carried out as a part of this research work wherein the stock price dataset of 12 companies over the last 7 years was collected and used. The paper also highlights some more efficient and robust techniques that are used to forecast trends in the stock market. In detail, the methodology followed, to acquire the results, has been talked about step-wise. Furthermore, a detailed comparative analysis of the performances of the aforementioned algorithms for stock price prediction has been carried out with the results displayed in a legible tabulated and graphical form to analyze them better. The conclusions from this novel, data comprehensive research work have been presented and it has been inferred that the DL algorithm outperforms all the other algorithms for stock price or time series prediction and provides results with extensive accuracy. [ABSTRACT FROM AUTHOR]

This paper considers the offline assignment of fixed priorities in partitioned preemptive real-time systems where tasks have precedence constraints. This problem is crucial in this type of systems, as having a good fixed priority assignment allows for an efficient use of the processing resources while meeting all the deadlines. In the literature, we can find several proposals to solve this problem, which offer varying trade-offs between the quality of their results and their computational complexities. In this paper , we propose a new approach, leveraging existing algorithms that are widely exploited in the field of Machine Learning: Gradient Descent, the Adam Optimizer, and Gradient Noise. We show how to adapt these algorithms to the problem of fixed priority assignment in conjunction with existing worst-case response time analyses. We demonstrate the performance of our proposal on synthetic task-sets with different sizes. This evaluation shows that our proposal is able to find more schedulable solutions than previous heuristics, approximating optimal but intractable algorithms such as MILP or brute-force, while requiring reasonable execution times. [ABSTRACT FROM AUTHOR]

The evolution and civilization development lead us to the progress next important step - the creation of AGI. More "intelligent" tasks are successfully solved by machine learning methods using neural network algorithms. Not only the solved problems quantitative increase in the number and accuracy are important, but also a qualitative transition to the tasks of obtaining "truly" new knowledge and building "truly" new goals on their basis. This transition can serve as a criterion for determining AGI. The paper shows necessity of using existing knowledge to advance into the field of more and more diverse "truly" new knowledge. Also, the paper shows usefulness of implementing proposed ideas on a scalable hierarchical structure which has two main modes of operation: "intuition" and "thinking", and structure of vector control of these and other operation modes, similar to animal hormonal control. [ABSTRACT FROM AUTHOR]

With the fast-moving deployment of IoT (Internet of Things) applications, a large amount of data is generated and the data is in need for processing to be able contribute to the user's requirements. All of the IoT applications require low latency and certain bandwidth to provide us with new features which are Time-Dependent. Thus, it would be advantageous to redesign the current IoT architecture by understanding the unique properties of communications and computational power to support intelligent processing of IoT data and its analysis. The paper is focused on topics such as characteristics of IoT data, trends in IoT network architecture, problems in IoT data analysis and their solutions. Thus, in particular, the paper is a discussion that Edge software-defined computing and CEP (Complex Event Processing) based fog computing as a architecture that promises to support the different requirements of IoT data analytics. And also, the paper is a discussion about how machine learning, deep learning are useful in removing data processing anomalies. The leader node election for data processing at cloud is also a time consuming task, the proposed genetic based Genetic based Leader Election Algorithm (GLEA) algorithm in the paper show promising results for the solution. [ABSTRACT FROM AUTHOR]

Clustering is one of the most common technologies in data mining. The size, dimension and sparsity of data are all different aspects that restrict clustering analysis. Clustering machine learning is called unsupervised learning, which is different from classification in that the data objects used in clustering analysis have no class marks, so they need to be calculated by the clustering learning algorithm, while the classified data objects need class marks. At present, most of the sparse data algorithms with high attribute dimensions are oriented to binary data, and there is no evaluation method of clustering results, which brings great limitations to their application. The BP neural network, RBF neural network and Elman neural network model with feedback function, which are mature and widely used in pest prediction models, are studied. The purpose of this paper is to study diseases and pests based on sparse clustering algorithm. In this paper, algorithm formulas, models and data graphs are established to study. From the research, it can be seen that the damage index of pests and diseases is very high, reaching about 50. 54%. Through the research in this paper, we can know that the future will lay a certain foundation for the research of diseases and pests. [ABSTRACT FROM AUTHOR]

The development of stereo matching algorithm is still one of the challenging problems, especially in ill-posed regions. Hence, this article presents a survey on the algorithm frameworks related to the stereo matching algorithm. Based on the early survey that had been conducted, two major frameworks available in current stereo matching algorithm development, they are traditional and artificial intelligence (AI) frameworks. Most of the traditional methods are very low accuracy compared to the AI-based approach. This can be observed in the standard benchmarking dataset, such as from the KITTI and the Middlebury, where AI methods rank at the top of the accuracy list. Additionally, the trend for solving computer vision problems uses AI or machine learning tools that become more apparent in recent years. Thus, this paper is focusing on the survey between the deep learning frameworks, which is one of the machine learning tools related to the convolutional neural network (CNN). Several mixed approaches between CNN based method and traditional handcraft method, as well as the end to end CNN method also discussed in this paper. [ABSTRACT FROM AUTHOR]

Semi-Supervised Graph Clustering (SSGC) has emerged as a pivotal field at the intersection of graph clustering and semi-supervised learning (SSL), offering innovative solutions to intricate data analysis problems. However, despite its significance and wide-ranging applications, there exists a notable void in the literature—a comprehensive survey specifically dedicated to SSGC techniques and their diverse applications remains conspicuously absent. Addressing this gap, this paper presents a systematic and comprehensive review of SSGC methodologies, spanning from well-established approaches to cutting-edge developments. Through a meticulous categorization, critical examination, and insightful discussion of these techniques, this survey not only illuminates the current landscape of SSGC but also identifies unexplored avenues for exploration and innovation. In this paper we present a comprehensive survey of conventional graph construction, graph clustering, SSL methods, evaluation metrics and their primary development process. We then provide a taxonomy of SSGC techniques based on their structures and principles and thoroughly analyze and discuss the related models. Furthermore, we review the applications of SSGC in various fields. Lastly, we summarize the limitations of current SSGC algorithms and discuss the future directions of the field. [ABSTRACT FROM AUTHOR]

Advances over the past decade at the intersection of information fusion methods and Semi-Supervised Learning (SSL) are investigated in this paper that grapple with challenges related to limited labelled data. To do so, a bibliographic review of papers published since 2013 is presented, in which ensemble methods are combined with new machine learning algorithms. A total of 128 new proposals using SSL algorithms for ensemble construction are identified and classified. All the methods are categorised by approach, ensemble type, and base classifier. Experimental protocols, pre-processing, dataset usage, unlabelled ratios, and statistical tests are also assessed, underlining the major trends, and some shortcomings of particular studies. It is evident from this literature review that foundational algorithms such as self-training and co-training are influencing current developments, and that innovative ensemble techniques are continuing to emerge. Additionally, valuable guidelines are identified in the review for improving research into intrinsically semi-supervised and unsupervised pre-processing methods, especially for regression tasks. • A set of 128 recent semi-supervised ensemble methods is identified and analysed. • Semi-supervised approach, ensemble, base and preprocessing methods are identified. • The experimental protocol, settings, and data set properties are also categorised. • Some trends and shortcomings are identified in these methods and studies. [ABSTRACT FROM AUTHOR]

• Distinct DG Output Modes Validation: The simulation validates distinct DG output modes, impacting prediction. • Mode-Based State Estimation: The paper proposes an innovative mode-based state estimation using IPSO-DBSCAN clustering, overcoming k-means limitations. • Enhanced Data Recovery using DBSCAN: Enhanced data recovery employs DBSCAN with improved secondary clustering, guided by similarity and homogeneity, outperforming traditional methods. • BiGRU-PF State Estimation: BiGRU-PF enhances state estimation accuracy and robustness in distribution networks by detecting DG output modes, addressing k-means limitations, and improving data recovery. This paper proposes a new forecasting-aided state estimation (FASE) method for distribution systems that mitigates issues with uncertain distributed generation (DG) and lost measurements. We utilize an Improved Particle Swarm Optimization (IPSO)-optimized Density-Based Spatial Clustering of Applications with Noise (DBSCAN) for examination of historical DG output data. Based on identified DG output modes, it facilitates precise state prediction and data reconstruction,. The proposed method employs a Bidirectional Gated Recurrent Unit (BiGRU) neural network for state prediction and a particle filter (PF) for final state filtering. The method verification is provided through Python simulations of the Distribution Transformer Unit (DTU)7k distribution network system, demonstrating improved accuracy and robustness against sudden load change and bad data in measurements. [ABSTRACT FROM AUTHOR]

Feature Selection (FS) is critically important for optimising the performance of Intrusion Detection Systems (IDSs) used in Wireless Sensor Networks (WSNs). However, selecting an optimal number of relevant features from massive IDS data sets has been an ongoing FS research problem. Many approaches use Machine Learning (ML), such as nature-inspired population-based and Differential Evolution (DE)-based algorithms for FS. However, the main drawback of DE is that it has a premature convergence issue, which leads to false convergence. In this paper, a novel mutation strategy is proposed to alleviate premature convergence and to develop a modified DE-based FS algorithm called DE with maturity extension (DE-ME). The novel mutation is achieved by changing the mutation factor in the DE\rnd\1 based on K-Nearest Neighbour (KNN) as the most efficient implementation without adding further complexity to the design process. The proposed DE-ME algorithm improves the FS operation with significant performance improvements in terms of overcoming premature convergence and increasing accuracy for selection. The DE-ME algorithm was used to select the most effective features from 41 features in the Network Security Laboratory Knowledge Discovery in Databases (NSL-KDD) dataset. The accuracy of DE-ME is high at 99.66 %, its False Positive Rate (FPR) is low at 0.464 %, and the true positive rate (TPR) achieved is 99.80 %. In addition, the number of features selected by DE-ME is 6 out of 41 features in the dataset. [ABSTRACT FROM AUTHOR]

• A feature selection method based on binary dandelion algorithm is proposed. • The algorithm applies a sine-cosine operator and a restart strategy. • Mutual information and quick bit mutation improve the performance of the algorithm. • The algorithm performs well on datasets with larger dimensions. Feature selection (FS) is an important data preprocessing technology for machine learning and data mining. Metaheuristic algorithm (MH) has been widely used in feature selection because of its powerful search function. This paper presents an improved Binary Dandelion Algorithm using Sine Cosine operator and Restart strategy (SCRBDA) for feature selection. First, the sine cosine operator is used in the radius formula of the core dandelions (CD), which significantly enhances the ability of algorithm development and exploration. Secondly, the algorithm uses a restart strategy to increase its ability to get rid of local optimum. Thirdly, mutual information is used to guide the generation of some dandelions, which pays more attention to the correlation between the selected features and categories. Finally, quick bit mutation is used as the mutation strategy to improve the diversity of the population. The SCRBDA proposed in this paper was tested on 18 datasets of different sizes from UCI machine learning database. The SCRBDA was compared with 8 other classical feature selection algorithms, and the performance of the proposed algorithm was evaluated through feature subset size, classification accuracy, fitness value, and F1-score. The experimental results show that SCRBDA achieves the best performance, which has stronger feature reduction ability and achieves better overall performance on most datasets. Especially on large-scale datasets, SCRBDA can obtain extremely smaller feature subsets while maintaining much higher classification accuracy, and satisfactory F1-score. [ABSTRACT FROM AUTHOR]

In the era of rapid paper publications in various venues, automatic citation recommendations would be highly useful to researchers when they write papers. Local citation recommendation aims to recommend possible papers to cite given local citation contexts. Previous work mainly computes the similarity score between citation contexts and cited papers on a one-to-one basis, which is quite time-consuming. We train a pair of neural network encoders that map citation contexts and all possible cited papers to the same vector space, respectively. After that, we index the positions of all cited papers in the vector space. This makes our process for searching recommended papers considerably faster. On the other hand, existing methods tend to recommend papers that are highly similar to each other, which makes recommendations lack diversity. Therefore, we extend our algorithm to perform multi-topic recommendations. We generate multi-topic training examples based on the index we mentioned earlier. Furthermore, we specially design a multi-group contrastive learning method to train our model so that it can distinguish different topics. Empirical experiments show that our model outperforms previous methods by a wide margin. Our model is also light weighted and has been deployed online so that researchers can use it to obtain recommended citations for their own paper in real-time. • Proposed FLCR algorithm with sentence-transformer & k-d tree. • Introduced multi-topic citation recommendation for diverse contexts. • Developed large-scale dataset with 1.7 million citation contexts for evaluation. • Demonstrated significant performance improvement over previous methods. • Deployed demo for real-time citation recommendations. [ABSTRACT FROM AUTHOR]

Intelligent Fault-Tolerant Control (IFTC) refers to the applications of machine learning algorithms for fault diagnosis and design of Fault-Tolerant Control (FTC). The overall goal of the FTC is to accommodate defects in the system components while they are in use and maintain stability with little to no performance reduction. These systems are crucial for mission-critical and safety-related applications where the safety of people is at stake and service continuity is crucial. In this review paper, a systematic study has been done for the development of FTC with machine learning, deep learning, and transfer learning algorithms. The challenges and limitations faced with their possible solutions through machine learning theories for the IFTC model are lined up. This paper guides researchers on the different possible types of machine learning algorithms and their advanced forms like deep learning and transfer learning. The differences among these are highlighted by the challenges and limitations of each. The paper is significant such that most of the important literature references from the Scopus database particularly related to important electrical and mechanical industrial problems have been discussed to guide the researchers who want to apply IFTC for specific industrial problems, being the research gap. Finally, future research directions for the development of IFTC are highlighted. [ABSTRACT FROM AUTHOR]

Federated learning (FL) is a distributed machine learning method to protect users' privacy and security. It currently faces the following two problems (McMahan et al., 2017): (1) The performance of the global model degrades when dealing with Non-Independent Identically Distributed (Non-IID) data. Other existing classical methods do not have a rigorous theory based on error processing ; (2) In the process of global model aggregation, the classical FL algorithm either directly averages local models or solely considers the proportion of local data to assign weights to the models, without accounting for the discrepancies between the local models. In this paper, a federated aggregation algorithm Federated Maximum Mean Discrepancy (FedMMD) is proposed to address the deviation between the local models and Non-IID. First of all, this paper utilizes the Dilated Convolution Meet Transformer (DCMT) model for local model feature extraction. This approach aims to capture more feature information and minimize the impact of Non-IID scenarios. Secondly, the learning stability of the local model data participating in the aggregation is compared with Maximum Mean Discrepancy (MMD). The weights of the local models involved in the aggregation are determined using the SKNQ (Student–Keuls–Newman-Q) method and the entropy weight method. The SKNQ method calculates and compares the MMD across multiple clients, while the entropy weight method assigns different weights to clients based on their deviations. On the standard dataset, the FedAvg algorithm (McMahan et al., 2017), the FedProx algorithm (Li et al., 2020) and the FedMMD algorithm are compared. The experimental results demonstrate that the FedMMD algorithm, used in training the global model, not only enhances the accuracy of learning IID and Non-IID data but also improves the generalization capability of the global model. • An DCMT model is proposed to alleviate the model fluctuations caused by NonIID data. • An MMD method is proposed to compared horizontally before the model is aggregated. • Entropy weight method and the SKNQ method are combined to allocate local models' weight when they are fused into global model. [ABSTRACT FROM AUTHOR]

Intelligent machines are an important carrier of artificial intelligence, which are widely used not only in the industrial field, but also in various fields of daily life and work. Path planning is an important research direction for studying machine intelligence. The main purpose is to search for a feasible path so that the robot can walk along the searched path in a complex environment. This paper aims to study the evolutionary algorithm of intelligent machines based on artificial intelligence. On the basis of introducing the characteristics of artificial potential field algorithm, the concept and characteristics of genetic algorithm, using genetic algorithm as the framework, the artificial potential field algorithm is combined with the crossover of genetic algorithm. In the operator, the optimization performance of the crossover operator is improved. The research results show that the length of the path obtained by the improved algorithm is shorter and better than that of the genetic algorithm of the single-point crossover operator. [ABSTRACT FROM AUTHOR]

This paper presents a Text similarity detection method based on artificial intelligence and natural language processing. The method combines statistical machine learning and deep learning techniques and designs six models from three perspectives: character-level, word-level, and semantic-level. These models include the diff model based on machine learning, cosine similarity model, Jaccard model, TF-IDF model, as well as the SimCSE and SBERT models based on deep learning methods. To fully leverage the characteristics of these models, three scenarios are designed to calculate the similarity scores based on experience and multiple experimental results. The results show that calculating the similarity scores using these three scenarios not only achieves high accuracy but also requires fewer computational resources. As deep learning and natural language processing technologies continue to advance, Text similarity detection methods based on artificial intelligence and natural language processing will continue to be improved and play a more significant role in practice. Future research can explore more models and algorithms to enhance the accuracy and robustness of plagiarism detection. [ABSTRACT FROM AUTHOR]

With the advancement of science and technology, metallographic research on metal materials has made remarkable progress. In this paper, the authors processed metallographic images using machine learning algorithms to classify the different elements in the images. The classification results divide the elements into three categories, which are metal elements, non-metal elements and metal-nonmetal combination elements. On the basis of this research, a metallographic compression algorithm based on adaptive threshold is also explored, and grayscale experiments are carried out on carbon steel samples. The recognition rate is 98.3%, and the compression rate is 1.06. Experimental results verify the effectiveness of the algorithm in processing metallographic compressed images of metal materials in power grids. [ABSTRACT FROM AUTHOR]

The paper presents a description of the research methodology dedicated to a two-step discretisation process applied to the input numeric data, with combining the characteristics of selected supervised and unsupervised algorithms, which leads to extended processing of some attributes in train and test sets. The methodology was illustrated with the investigations carried out in the domain of stylometric analysis of texts, for two datasets prepared for the task of binary authorship attribution. The several variants of transformed input data obtained were subjected to exploration using two selected machine learning methods capable of inducing knowledge from both continuous and categorical forms, namely the PART and J48 classifiers. The results from the experiments indicate that, as can be expected, supervised transformations of data work well enough, however, they do not always return the best outcome. The two-step processing of some attributes shows sufficient promise to warrant a closer study, as opposed to always unconditionally relying only on supervised algorithms as outperforming all other approaches. [ABSTRACT FROM AUTHOR]

In a dynamic world, data streams are continuously generated, which poses immense challenges for machine learning (ML) algorithms to adapt to changing statistical properties that are subject to a non-stationary context. The underlying scenario is defined as concept drift (CD), where changes in the relationship between response and prediction variables (real CD) or a change in input data (virtual CD) are accompanied by a significant degradation in the predictive performance of the models, causing ML models to reach unacceptable levels of system accuracy. In this paper, the state of the art for CD algorithms is analyzed and compared. For this purpose, a systematic literature review was performed. Then, the 10 most popular CD algorithms were extracted from the literature using a newly-developed metric. Subsequently, the algorithms were analyzed and compared with respect to their functionality and limitations. Based on these, the optimization potentials were systematically derived. This work presents a summarized overview of CD algorithms and provides the basis for algorithm optimization in this domain. [ABSTRACT FROM AUTHOR]

In this paper, the problem of imbalanced data stream classification is considered. To eliminate the problem of imbalanced data, over- and under-sampling procedures are implemented within a dedicated framework called Weighted Ensemble with one-class Classification and Over-sampling and Instance selection (WECOI). To increase the quality of synthetic instance generation (carried out under the umbrella of an over-sampling procedure), an agent-based population algorithm is proposed. The problem is defined, and the agent-based algorithm is presented. A discussion of selected computational results is also included. [ABSTRACT FROM AUTHOR]

The development of quantum machine learning (QML) has received a lot of interest recently thanks to developments in both quantum computing (QC) and machine learning (ML). One of the ML paradigms that can be utilized to address challenging sequential decision-making issues is reinforcement learning (RL). It has been demonstrated that classical RL can successfully complete many difficult tasks. A leading method of building quantum RL agents relies on the variational quantum circuits (VQC). However, training QRL algorithms with VQCs requires significant amount of computational resources. This issue hurdles the exploration of various QRL applications. In this paper, we approach this challenge through asynchronous training of QRL agents. Specifically, we choose the asynchronous training of advantage actor-critic variational quantum policies. We demonstrate the results via numerical simulations that within the tasks considered, the asynchronous training of QRL agents can reach performance comparable to or superior to classical agents with similar model sizes and architectures. [ABSTRACT FROM AUTHOR]

K-Nearest Neighbors (KNN) are very popular supervised machine learning algorithm which can be effectively used for both multi-class classification and regression utilizing multiple features of the dataset. It trains extremely fast, that is with time complexity of O(n). However, the time complexity for generating results with KNN is O(n3dk) (where k=number of neighbours, d=dimension of data, n=number of training points) and hence it becomes very difficult to work with larger dataset. Although there are parallelizing and distributed computing techniques available for speeding up KNN, it still have limitations on horizontal scalability, fault tolerance and incremental learning capabilities. To solve these issues, the paper presents a KNN inspired novel Supervised Machine Learning algorithm called Distributed Nearest Hash utilizing unique usage of hashmap and primary key clustering order with help of wide column store databases facilitating easy incremental near-realtime scalability to train unlimited datapoints with O(n) time complexity and also predict them in near realtime with O(1) time complexity considering n >> d. This can be readily integrated in any system that uses KNN as a base classifier or regressor. The experimental results shows that the proposed DNH model is 25% faster than state of the art distributed KNN algorithm. Integrating with fuzzy logic the algorithm can be used for several class classification. Using this could aid in building very powerful smart decision making systems with very little computational power. [ABSTRACT FROM AUTHOR]

In the 5G smart grid, battery liquid leakage negatively affects the safe storage and transportation of electricity. Image edge detection help locate the liquid leakage phenomenon. This paper proposes a digitalization-based algorithm that converts the image to the codeword and judges the edge by the code weight. Its main steps are image sampling, quantization, coding and judging. Compared with traditional Sobel and Canny operators, the algorithm dramatically enhances detection ability with machine learning. Moreover, this paper applies the algorithm to detect the leakage of infrared battery images in the 5G smart grid; The results show that it can accurately extract the liquid leakage location, improving fault diagnosis and early risk warning. [ABSTRACT FROM AUTHOR]

This paper presents a new training algorithm that can update the situation of layers' network, and therefore, connections, neurons, and firing rate of neurons based on FORCE (first-order reduced and controlled error) training algorithm. The Quantized Full FORCE algorithm (QFF) also updates the number of neurons and connections between different layers in the network per iteration in a way that the whole firing rate of each layer is updated via selecting the best neurons and combining strong features. The update method is sequential, so that with each instance passing through the network, the network structure is updated with the Full FORCE algorithm. The algorithm updates the structure of networks with a multiple/single middle layer of the supervised version of feed forward networks such as Multilayer perceptron (MLP), changing them into partially-connected networks. A combination of principal component analysis PCA and Linear Discriminant Analysis (LDA) algorithms has been used to cluster the network input features. The paper focuses on the deep supervised MLP network with backpropagation (BP) and various datasets and its comparison with other MLP based stat of art methods and hybrid evolutionary algorithms. We achieved 98.15 percent accuracy for facial expression 98.6 and 97.7 percent for Wisconsin breast Cancer and Iris Flower in respectively. The training algorithm employed in the study enjoys a lower computational complexity while yielding faster and more accurate convergence, starting with a very low level of errors of 0.009 in comparison with the full connection network and it solves the challenge of getting stuck in local minima and poor convergence of Gradient Decent with BP. • Providing the new training algorithm to update the connections and firing rate of neurons in each iteration. • The proposed training model is based on Quantized Full FORCE (first-order reduced and controlled error) training. • Providing an accurate framework to update the number of neurons, converting the network to a partial connection network. • In the new training model, the best features have the highest number of connections and neurons within the middle layers. • Being the decision speed of the network in the proposed method much faster than a fully connected network. • Cost-effectiveness and much lower resource requirements for implementation of deep networks on hardware such as FPGAs. [ABSTRACT FROM AUTHOR]

The amount of network traffic generated from the Internet of Things (IoT) devices is massive which leads to Big data. In present scenario, IoT devices has taken a leap ahead in terms of growing technology and insecure network traffic flow. The sensitivity of the data in the IoT network is becoming very high, which concern the security in legal and privacy issues. Traditional Intrusion Detection System (IDS) is used as a primary line security to differentiate between the attack and benign network traffic flow. As the size of the network traffic capture increases, it becomes more important to handle such big data. Similarly, when the number of classes and instances increases, the complexity of the data also increases. In this paper, we propose a big data platform based intrusion detection system which can differentiate between the types of network traffic flow generated from the IoT devices. We compared the performance of deep learning algorithms with machine learning algorithms on Apache Spark platform and found that machine learning algorithms outperform deep learning algorithms with greater accuracy and less training time for the model. We evaluated our research based on real world network traffic dataset BoT-IoT [1] for an improved intrusion detection system in IoT network traffic. [ABSTRACT FROM AUTHOR]

Printer source prediction is an important task when examining questioned documents. While some research has provided methods to predict the source printer of documents, with the advent of compatible consumables, printer prediction could become more complex and difficult. Predicting the source printer after replacing cartridges and identifying the source of printer cartridges are unresolved issues that are rarely addressed in current research. Herein, we introduce a novel technique to predict the manufacturer, model, and cartridges of laser printers (i.e., compatible, and original cartridges) used to produce a given document. Document samples produced using eight laser printers and 247 cartridges were collected to establish a dataset. Common manufacturers included HP, Canon, Lenovo, and Epson. After obtaining white-light images and three-dimensional profile images of printed characters, a morphological analysis was conducted by questioned document examiners (QDEs) using microscopy. Microscopic image features across a series of images were also extracted and analyzed using algorithms. Then, six high-dimensional reduction algorithms were used to obtain between- and within-printer variations as well as between- and within-cartridge variations. Finally, we conducted principal component analysis (PCA) and discriminant analysis. For 40 % of the samples, mixed discrimination analysis (MDA) and fixed discrimination analysis (FDA) were employed to predict the manufacturer, model and cartridge of laser printers used to produce the questioned printed document; the remaining 60 % samples comprised the training dataset. In the prediction of manufacturer, model and cartridge, our method achieved mean accuracies of 95.5 %, 97.5 %, and 90.2 %, respectively. Hence, this technique could reasonably aid in predicting the manufacturer, model, and cartridge of a laser printer, even if different cartridges are loaded into printers. [Display omitted] • A novel technique was provided to predict the manufacturer, model, and cartridges of laser printers. • Three-dimensional profiling combined with white-light microscopic images helps to improve the performance of the prediction. • This paper expands document examination from two dimensions to three dimensions. [ABSTRACT FROM AUTHOR]

This paper proposes a new, novel ranking method called Inverse-Reinforcement Learning Ranking. The main goal is to find a reward function representing the user's perceived utility after clicking on each result. It is necessary to utilize log information of all users' queries in the search engine dataset to reach this goal while assuming that the decisions (clicks) of the users are the best (optimal policy). The respective reward function is constructed using features extracted through a feature selection, and their corresponding weights are obtained by two optimization models, which are applicable for ranking results represented to the new users. In addition, new performance criteria were developed to illustrate the performance of the presented ranking method. To evaluate and test the proposed ranking algorithm, a real medium-sized dataset from a search engine is preprocessed and used in this research. Findings show promising results and decisive superiority over the default ranking method. It is illustrated that clicks on the top five results, top ten, and even the first results are remarkably improved by about 13–19% in all experiments, and the perplexity remarkably decreases by almost 23% after applying the ranking method. [ABSTRACT FROM AUTHOR]

In the field of machine learning, the issue of class imbalance is a common problem. It refers to an imbalance in the quantity of data collected, where one class has a significantly larger number of data compared to another class, which can negatively affect the classification efficiency of algorithms. Under-sampling methods address class imbalance by reducing the quantity of data in the majority class, thereby achieving a balanced dataset and mitigating the class imbalance problem. Traditional under-sampling methods based on k-means clustering either set the unified value of k (number of clusters) or determine it directly based on the quantity of data in the minority or majority class. This paper proposes an adaptive k-means clustering under-sampling algorithm that calculates an appropriate k for each dataset. After clustering the majority class dataset into k clusters, our algorithm calculates the distances between the data within each cluster and the cluster centroids from two perspectives and selects data based on these distances. Subsequently, the subset of the majority class dataset are combined with the minority class dataset to generate a new balanced dataset, which is then used for classification algorithms. The performance of our algorithm is evaluated on 45 datasets. Experimental results demonstrate that our algorithm can dynamically determine appropriate k for different datasets and output a balanced dataset, thus enhancing the classification efficiency of machine learning algorithms. This work can provide new algorithmic ensemble strategies for addressing class imbalance problem. [ABSTRACT FROM AUTHOR]

Due to the complex structure of the LFR fuel rod bundle, refined CFD simulation consumes significant computing resources and time, making it difficult to meet the immediate needs of engineering design and research. This paper introduces a method that integrates the sub-channel level thermal-hydraulic analysis code CorTAF-LBE with the BPNN algorithm to analyze the thermal-hydraulic phenomena within the LFR core. The method has been validated by refined simulation results of the THEADES test section, which indicate that the error is within an acceptable range. The feasibility of its application in LFR fuel assemblies was also evaluated. The flow characteristics and temperature distribution in unwrapped LFR rod bundles are investigated. Due to differences in fuel distribution and flow area, the temperature in the central channel is much higher than that in the side and trapezoidal channels. Three accident conditions, including inlet blockage, center blockage, and outlet blockage, were simulated. The corresponding peak temperatures of the fuel cladding were 670 K, 767 K, and 860 K, respectively, representing an increase of approximately 170 K compared to the nominal conditions. The analysis results effectively demonstrate the 3D temperature distribution of the fluid in the rod bundles, which is significant for reactor design and safety analysis of LFRs. [ABSTRACT FROM AUTHOR]

Drowsiness detection is a test designed to detect a person's reaction ability and speed while in a state of fatigue. This type of drowsiness detection has many practical applications in areas like driver monitoring, transportation industry, and workplace safety. In this paper, a new machine learning drowsiness detection algorithm based on hybrid brain network feature extraction is proposed. First, the raw electroencephalogram signals are segmented into 30 s epochs, which are decomposed with wavelet packet transform into 7 layers to extract 30 s sleep characteristic subbands and the 7-th layer subbands. After that, 30 s subbands are divided into 5 s subbands with 50% overlap. At the same time, 30 s subbands are reconstructed by phase space reconstruction (PSR), whose parameters are optimized through energy valley optimizer. Then, based on mutual information and horizontal visual graph, a hybrid brain network is constructed with the 7-th layer subbands, 5 s subbands and PSR subbands, respectively. Finally, network features and time–frequency features are extracted and input into random forest classifier. The performance of the algorithm is evaluated through two tests: subject-independent test and subject-non-independent test. The results show that in Sleep-EDF dataset, accuracy, κ coefficient, recall, precision and F1-score obtained by the proposed algorithm can reach 94.19%, 88.39%, 95.37%, 92.53% and 93.93%, respectively. In Sleep-EDF Expanded dataset, accuracy, κ coefficient, recall, precision and F1-score can reach 93.65%, 87.65%, 94.53%, 92.11%, and 92.89%, respectively. [ABSTRACT FROM AUTHOR]

Interpretation of the prediction is vital for mission critical tasks. Accurate interpretation relies upon the generalization accuracy of the model. In this paper, we propose a modified gradient descent learning algorithm to improve the generalization ability of a Spiking Neural Network with time-varying weights (SNN-t). This algorithm is referred to as GradST, can help towards improving the interpretation of multiclass classification problems. We have transformed the SNN-t to a Generalized Additive Model (GAM) to provide interpretation. The resultant Spiking Additive Model (SAM) has the generalization ability of SNN-t and the interpretable characteristics of GAM for multiclass problems. We also propose a post-processing method to enable better visualization of multiple shape functions of GAMs, towards better relative interpretation for multiclass classification problems. The post-processing method utilizes the properties of multiclass GAMs to visually modify the shape functions to establish the importance of the feature in multiclass setting. We first evaluate the performance of SNN-t, trained with GradST and the SAM generated from it, on large public datasets. The SNN-t trained with GradST has better generalization accuracy than other SNN-t classifier and consequently, the SAM generated from it has better generalization accuracy than other state-of-the-art multiclass GAMs. Improved accuracy in SAM implies more reliable interpretation. Then, we evaluate the proposed post-processing method for multiclass GAMs to provide relative interpretation. It is observed that relative interpretation of multiclass GAM is more meaningful and reliable. • Modified gradient descent-based learning algorithm for a spiking neural classifier. • Transformation of spiking neural classifier to an interpretable classifier. • Improve generalization ability for reliable interpretation. • Post-processing method for relative interpretation. [ABSTRACT FROM AUTHOR]

Accurate load forecasting is critical to guarantee the security, steadiness and economic operation of the power system. Therefore, in order to improve the load forecasting accuracy, improved coyote optimization (ICOA) was proposed in this paper to optimizing the Extreme learning machine for load forecasting, which is a novel load forecasting model. The ICOA algorithm effectively improves the accuracy and speed of convergence by introducing the sobol sequence and improving the pack culture trend, which is approved beneath a set of benchmark capacities from the Organized of Electrical and Hardware Engineers (IEEE) Congress on Developmental Computation (CEC) 2017. The result comparisons have moreover shown the exceptional execution of ICOA, since it could rank to begin with within the optimization of 16 benchmark. In addition, the ELM was optimized using to address the problem that the randomly formed weights and thresholds of the ELM lead to an unstable model, as well as experiment with different models using real electricity load data. The results show that the ICOA-ELM model possesses excellent accuracy and stability in short-term load forecasting. Its R2 and RMSE are 0.9970 and 0.3840 MW respectively, which are much better than ELM and LSTM. Thus, the proposed ICOA-ELM is a viable strategy for short-term load forecasting. [ABSTRACT FROM AUTHOR]

Detecting anomalies in telemetry data captured on-board a spacecraft is critical to ensure its safe operation. Although there exist various techniques for automatically detecting point, contextual, and collective anomalies from time-series data, quantifying their performance remains under-researched. In this paper, we thoroughly validate our approach for the task of anomalous event detection that is built upon a two-stage technique, in which the telemetry signal is predicted using a long short-term memory network based on the historical data, and then the prediction is compared with the actual (captured) data. If the difference between those two is sufficiently large, we can infer that an anomalous event has happened. To evaluate the capabilities of such detection techniques over the simulated and benchmark time-series data, we investigate a set of commonly used metrics obtained for a range of anomaly detection approaches, and present their shortcomings, especially related to their inability of capturing the temporal aspects of the detectors. We tackle this issue by introducing new quality metrics which enable us to objectively verify if the detectors can timely spot the anomalies in sequential data. The experimental study showed that inferring the conclusions based on a subset of metrics can lead to biased observations, as the best algorithms determined based on the overlap metrics, including the Dice coefficient, do not necessarily correspond to the algorithms that offer the fastest detection. Finally, we discuss the Antelope Toolbox—our software tool for simulating nominal telemetry data of given characteristics, alongside well-defined anomalous events, and to perform the quantitative and qualitative analysis of anomaly detection algorithms over such simulated events. • We investigate the quality metrics to verify anomaly detection in telemetry data. • We introduce new measures that capture temporal aspects of anomaly detectors. • We present an end-to-end machine learning pipeline for anomaly detection. • We objectively assess 15 anomaly detection algorithms using all metrics. • Exploiting only a subset of all metrics can easily lead to biased conclusions. [ABSTRACT FROM AUTHOR]

• The AES power system intelligent energy scheduling environment is built. • The BI-LSTM-Att action network is propose by combining BI-LSTM with attention mechanism. • The DQN-CE algorithm is proposed by improving the DQN algorithm. • The experiments on an all-electric ferry is conducted using a variety of methods. At present, Ship energy scheduling based on deep reinforcement learning (DRL) is an important research direction in which Deep Q learning algorithm (DQN) has been successfully applied in the field of energy scheduling. In terms of the shortcomings of DQN in all electric ships(AES) energy scheduling, such that, the insufficient performance of using multiplayer perceptron(MLP) as action network and the degradation of convergence performance due to over estimation of Q value, in this paper, we propose a DQN cross entropy(DQN-CE) energy scheduling algorithm combing bi-directional LSTM and attention mechanism(BI-LSTM-Att). Instead of using MLP, firstly, we use BI-LSTM-Att as action network of DQN, and then an improved DRL algorithm called DQN-CE is proposed, that is, we add cross-entropy loss of predicted action of the next time for the target network and the action network to DQN. Finally, we conduct simulation experiments on an all-electric ferry, and the experimental results show that the energy scheduling algorithm proposed in this paper reduces the economic consumption by 4.11%, increases the utilization rate of energy storage system by 24.4%, and reduces the exploration time of agent training by 31.3% compared with the original DQN energy scheduling algorithm. Finally, the effectiveness and superiority of the algorithm were further verified in the new case study. [ABSTRACT FROM AUTHOR]

The quest for learning more about the minute intricacies of the universe has fascinated mankind since ages. From stars to planets and asteroids to exoplanets, each research endeavor in astronomy has supplemented our knowledge about the cosmos. NASA's Kepler Mission is one monumental step in this direction wherein, telescopes conduct a survey of the Milky Way galaxy and try to identify thousands of earth-size and other smaller planets in or near the habitable zone, so as to determine the thousands or even millions of stars in our galaxy that might have such orbiting planets. Exoplanet is any new planet outside the solar system which orbits a star. Identifying new exoplanets gives us a chance to precisely understand the planet formation processes. Earlier, it was a laborious endeavour to mine the mission data using traditional algorithms and churn out the possible exoplanets. Ever since the advent of various machine learning algorithms, this process has become quite seamless. However, not all algorithms give equal and promising results when it comes to analysing different types of data. A comparative study of algorithms helps in this regard, thereby identifying the pros and cons of different algorithms for analysing certain forms of data. In this paper, we initially focus on feature set reduction using principal component analysis and thereafter make a detailed comparative analysis of ML algorithms for the identification of exoplanets, in the NASA Kepler mission data. [ABSTRACT FROM AUTHOR]

The lighting requirements are subjective and one light setting cannot work for all. However, there is little work on developing smart lighting algorithms that can adapt to user preferences. To address this gap, this paper uses fuzzy logic and reinforcement learning to develop an adaptive lighting algorithm. In particular, we develop a baseline fuzzy inference system (FIS) using the domain knowledge, generating light recommendation based on a set of intuitive rules. These rules, derived from existing literature, are based on environmental conditions i.e. daily glare index, and user information including age, activity, and chronotype. Through a feedback mechanism, the user interacts with the algorithm, correcting the algorithm output to their preferences. We interpret these corrections as rewards to a Q-learning algorithm, which tunes the FIS parameters online to match the user preferences. The Q-learning is a model-free learning algorithm that learns to act optimally by interacting with the user and the rewards it receives. This allows the proposed algorithm to work in a model-free manner, effectively handling the uncertainties that might arise from the individualistic preferences of users. To the authors' best knowledge, this algorithm is pioneering work in designing intelligent algorithms for personalized lighting control, featuring several elements of novelty, including the number of environmental and user-related inputs, the continuous control of light intensity as opposed to common on/off control, and the ability to learn user preferences. The algorithm is implemented in a real aircraft cabin and is evaluated in an extensive user study. The implementation results demonstrate that the developed algorithm possesses the capability to learn user preferences while successfully adapting to a wide range of environmental conditions and user characteristics. This underscores its viability as a potent solution for intelligent light management, featuring advanced learning capabilities. • Intelligent lighting algorithm with the ability to learn from and adapt to user preferences. • A fuzzy inference system tunes lighting based on environment and user traits. • The developed algorithm is tested and verified via an in-depth user study. [ABSTRACT FROM AUTHOR]

Grid-interactive building control poses a critical challenge in the context of grid modernization and decarbonization. Recently, various artificial intelligence-based optimal control approaches have been proposed, providing innovative solutions to optimal building control problems. However, researchers and practitioners are now confronted with a dilemma when selecting appropriate control strategies, ranging from model-based (knowledge-incorporating) to learning-based (data-driven) approaches, and hybrid methods combining them. Although each algorithm in existing literature claims superiority over specific baselines, their performance has never been systematically compared and analyzed, owing to the absence of a unified platform for comprehensive evaluation. To fill this knowledge gap, we identify and implement all state-of-the-art approaches within a modular training and evaluation framework, assessing their efficacy in a grid-interactive building control problem. In this paper, we also introduce a streamlined hybrid method that complements existing hybrid approaches. Our comparative study reveals and quantifies the advantages of hybrid methods: on average, they achieve near-optimal control while requiring less than 14% of the online computation of traditional model-based methods. To achieve this performance, they need as few as 2% of the training samples of purely learning-based methods. Finally, we provide insights into the merits, limitations, and implementation of each method to help researchers better understand the state of the art and future directions. The software framework implemented in this study is open-sourced to facilitate future research. [ABSTRACT FROM AUTHOR]

Topological data analysis (TDA) is a powerful mathematical framework that extracts valuable insights about the shape and structure of complex datasets by identifying and analyzing underlying topological features, including connected components, holes, voids, and higher-dimensional counterparts. TDA achieves this by constructing a simplicial complex from the data, comprising simple shapes like points, lines, triangles, and higher-dimensional counterparts. The Vietoris–Rips complex (VRC), a widely used method, constructs simplicial complexes by measuring the distances between data points in a metric space. While the link between Intuitionistic Fuzzy Sets (IFSs) and TDA is clear through intuitionistic fuzzy distance measures, the literature has not explored the application of TDA for extracting topological features from uncertain and vague datasets using IFSs. In this paper, we propose a novel approach that leverages Intuitionistic Fuzzy Distance Measures (IFDMs) to generate the Intuitionistic Fuzzy Vietoris–Rips Complex (IFVRC) of IFSs. Specifically, we investigate the persistence of invariant relations of topological features between IFVRCs constructed using different distances, including Atanassov's Euclidean distance (l 2 I F S), Boran and Akay's distance (D), and Liu's distance measure (d L), over artificially generated IFSs. Furthermore, we demonstrate that the generation of IFVRC can be viewed as a Natural Hierarchical Clustering Algorithm (NHCA) for IFSs. Finally, we apply the proposed IFVRC as a Natural Hierarchical Clustering Algorithm to cluster intuitionistic fuzzy datasets related to Car and Building materials. Moreover, we incorporate a relatively large dataset, the GTZAN dataset from the Kaggle datasets repository, to classify music genres based on their topological information. • Topological analysis of intuitionistic fuzzy distance measures (IFDMs) have been conducted. • Utilizing IFDMs, Intuition Fuzzy Vietoris Rips Complex (IFVRC) generated. • It is shown how to extract topological features from IFVRC. • The persistence relations of topological features between IFVRCs have been investigated. • Finally, IFVRC is treated as a natural hierarchical clustering algorithm. [ABSTRACT FROM AUTHOR]

Bayesian network (BN) structure learning is the basis of BN applications and plays a pivotal role in many machine learning tasks. Whereas remarkable progress in structure learning has been achieved in the past, making further improvements in the efficiency and accuracy of structure learning is a significant challenge. In this paper, we propose an efficient skeleton learning approach-based hybrid algorithm (ESLH), which consists of two phases. In the constraint-based phase, a dynamic threshold (DTH) strategy and a skeleton learning method based on triangle breaking (SLTB) are proposed to learn the skeleton of a BN structure efficiently. DTH designs a dynamic threshold to remove redundant edges in the initial skeleton with little time overhead. By the result of DTH, SLTB first finds, tests and breaks triangles in the initial skeleton to efficiently remove redundant edges and then removes the remaining redundant edges to discover the final skeleton. In the score-and-search phase, ESLH employs the hill-climbing algorithm to find the highest-scored structure. We propose a novel strategy to divide this phase into three steps, both utilizing the learned skeleton to constrain the search space and preventing the errors of the learned skeleton from reducing the quality of the final learned structure. Extensive experiments on benchmark BNs validate the effectiveness of DTH and SLTB and demonstrate that ESLH is more than five times faster than the state-of-the-art structure learning algorithms while maintaining the highest average accuracy. [ABSTRACT FROM AUTHOR]

Nowadays, the ASIC design is increasing in complexity, and PPA targets are pushed to the limit. The lack of physical information at the early design stages hinders precise timing predictions and may lead to design re-spins. In previous work, we successfully improved timing prediction at the post-placement stage using the Random Forest model, achieving 91.25% cell delay accuracy. Building upon this, we further investigate the potential of Ensemble Tree-based algorithms, specifically focusing on " Extremely Randomized Trees " and " Gradient Boosting ", to close the gap in cell delay accuracy. In this paper, we enrich the training dataset with new 16 nm industrial designs. The results demonstrate a substantial improvement, with an average cell delay accuracy of 92.01% and 84.26% on unseen data. The average Root-Mean-Square-Error is significantly reduced from 12.11 to 3.23 and 7.76 on unseen data. [ABSTRACT FROM AUTHOR]

Grassland restoration is a crucial method for preventing ecological degradation in grasslands. Unmanned Aerial Vehicles (UAVs) offer a promising solution to reduce extensive human labor and enhance restoration efficiency, given their fully automatic capabilities, yet their full potential remains exploited. This paper progresses this emerging technology for planning the grassland restoration. We undertake the first attempt to mathematically model the UAV-enabled restoration process as the maximization of restoration areas problem (MRAP). This model considers factors including limited UAV battery energy, grass seed weight, the number of restored areas, and their sizes. The MRAP is a composite problem involving trajectory design and area allocation, which are highly coupled and conflicting. Consequently, it requires solving two NP-hard subproblems: the variant Traveling Salesman Problem (TSP) and the Multidimensional Knapsack Problem (MKP) simultaneously. To address this complex problem, we introduce a novel cooperative memetic algorithm. The algorithm integrates an efficient heuristic algorithm, variant population-based incremental learning (PBIL), and a maximum-residual-energy-based local search (MRELS) strategy, referred to as CHAPBILM. The algorithm solves the two subproblems interlacedly by leveraging the interdependencies and inherent knowledge between them. The simulation results demonstrate that CHAPBILM successfully solves the MRAP on multiple instances in a near-optimal way. It also confirms the conflicts between trajectory design and area allocation. The effectiveness of CHAPBILM is further supported by comparisons with traditional optimization methods that do not exploit the interdependencies between the two subproblems. The proposed model and solution have the potential to be extended to other complex optimization problems in ecological protection and precision agriculture. • The maximization of restoration areas problem is first presented for the UAV-enabled grassland restoration method. • An energy-sensitive mathematical programming model is formulated for the maximization of restoration areas problem under the realistic constraints. • A novel cooperative memetic algorithm CHAPBILM is explored to effectively solve the maximization restoration areas problem, without ignoring the dependence between the two stages. • The simulation results demonstrate that CHAPBILM performs significantly better than the noncooperative optimization method for the problem, which also confirms the dependency relationship. [ABSTRACT FROM AUTHOR]

Multi-view clustering has achieved many applications in recent years. But the existing multi-view clustering methods face two problems, firstly, the traditional multi-view clustering uses a hard clustering method, which cannot describe the uncertainty between the samples and the clusters, and secondly how to perform effective incremental learning on multi-view data when the number of views increases. Therefore to address the above two problems, we firstly propose a three-way fuzzy spectral clustering algorithm based on fuzzy clustering, which can perform three-way clustering on multi-views and get soft clustering results, thus describing the uncertainty between samples and clusters. Then based on the sequential decision making approach, an incremental learning mechanism is designed for multi-view clustering when the number of views increases. Finally, these two works are combined to propose a multi-view clustering algorithm based on sequential three-way decision making. The experimental results demonstrate that the method proposed in this paper has better clustering accuracy and efficiency compared to the traditional multi-view clustering algorithm. • As incremental data comes in, the performance of the strategy goes up. • Methods can delay decisions when there is insufficient data for multiple views. • Methods are suitable for saving the results obtained by strategies when there is not enough information. • Strategies can be more time efficient than traditional methods. [ABSTRACT FROM AUTHOR]

The field of machine learning (ML) has witnessed significant advancements in recent years. However, many existing algorithms lack interpretability and struggle with high-dimensional and imbalanced data. This paper proposes SPINEX, a novel similarity-based interpretable neighbor exploration algorithm designed to address these limitations. This algorithm combines ensemble learning and feature interaction analysis to achieve accurate predictions and meaningful insights by quantifying each feature's contribution to predictions and identifying interactions between features, thereby enhancing the interpretability of the algorithm. To evaluate the performance of SPINEX, extensive experiments on 59 synthetic and real datasets were conducted for both regression and classification tasks. The results demonstrate that SPINEX achieves comparative performance and, in some scenarios, may outperform commonly adopted ML algorithms. The same findings demonstrate the effectiveness and competitiveness of SPINEX, making it a promising approach for various real-world applications. • SPINEX: An interpretable neighbor exploration algorithm is presented. • Combines ensemble learning and feature interaction for meaningful insights. • Quantifies feature contributions and interactions to enhance interpretability. • 59 experiments were conducted to validate SPINEX's comparative performance. [ABSTRACT FROM AUTHOR]

This paper introduces a deep learning method for image classification that leverages knowledge formalized as a graph created from information represented by pairs attribute/value. The proposed method investigates a loss function that adaptively combines the classical cross-entropy commonly used in deep learning with a novel penalty function. The novel loss function is derived from the representation of nodes after embedding the knowledge graph and incorporates the proximity between class and image nodes. Its formulation enables the model to focus on identifying the boundary between the most challenging classes to distinguish. Experimental results on several image databases demonstrate improved performance compared to state-of-the-art methods, including classical deep learning algorithms and recent algorithms that incorporate knowledge represented by a graph. [ABSTRACT FROM AUTHOR]