Search

This paper focuses on building a ground motion model (GMM) using artificial neural network technique driven by a synthetically generated database in a data poor region. A hybrid simulated method considering nonlinear site response is used to generate potential ground motions in Tianjin area. The synthetic database containing a total of 9267 ground motion records from 93 simulated earthquake events are utilized to develop the model. A back propagation neural network developed by genetic algorithm (GA-BPNN) is used to obtain the optimal weights and biases that most fit the target dataset without overfitting. The structure of GA-BPNN model consists of 322 unknowns including weights and biases that connect input and output parameters. The model is developed to predict PGA and 5% damped spectral acceleration (periods from 0.01 to 10 s). The input parameters consist of moment magnitude (Mw), strike (φ), dip (δ), rake angle (λ), focal depth (h), epicenter distance (R) and azimuth (θ). The model performance is observed to be within the appropriate error limits. It is found that the model has the ability to capture the parametric variation relationship. Additionally, the synthetically based model is compared with empirically based GMM relations derived from NGA-West2, finding it has similar performance and behavior to leading GMMs. The model application in Tianjin area demonstrates that this paper provides a scheme to utilize synthetic database and build GMMs in data poor regions. [ABSTRACT FROM AUTHOR]

Background: Accurate segmentation of lung nodules is crucial for the early diagnosis and treatment of lung cancer in clinical practice. However, the similarity between lung nodules and surrounding tissues has made their segmentation a longstanding challenge. Purpose: Existing deep learning and active contour models each have their limitations. This paper aims to integrate the strengths of both approaches while mitigating their respective shortcomings. Methods: In this paper, we propose a few‐shot segmentation framework that combines a deep neural network with an active contour model. We introduce heat kernel convolutions and high‐order total variation into the active contour model and solve the challenging nonsmooth optimization problem using the alternating direction method of multipliers. Additionally, we use the presegmentation results obtained from training a deep neural network on a small sample set as the initial contours for our optimized active contour model, addressing the difficulty of manually setting the initial contours. Results: We compared our proposed method with state‐of‐the‐art methods for segmentation effectiveness using clinical computed tomography (CT) images acquired from two different hospitals and the publicly available LIDC dataset. The results demonstrate that our proposed method achieved outstanding segmentation performance according to both visual and quantitative indicators. Conclusion: Our approach utilizes the output of few‐shot network training as prior information, avoiding the need to select the initial contour in the active contour model. Additionally, it provides mathematical interpretability to the deep learning, reducing its dependency on the quantity of training samples. [ABSTRACT FROM AUTHOR]

Recent research has revealed that subtle imperceptible perturbations can deceive well-trained neural network models, leading to inaccurate outcomes. These instances, known as adversarial examples, pose significant threats to the secure application of machine learning techniques in safety-critical systems. In this paper, we delve into the study of one-pixel attacks in deep neural networks, recently reported as a kind of adversarial examples. To identify such one-pixel attacks, most existing methodologies rely on the differential evolution method, which utilizes random selection from the current population to escape local optima. However, the differential evolution technique might waste search time and overlook good solutions if the number of iterations is insufficient. Hence, in this paper, we propose a gradient ascent with momentum approach to efficiently discover good solutions for the one-pixel attack problem. As our method takes a more direct route to the goal compared to existing methods relying on blind random walks, it can effectively identify one-pixel attacks. Our experiments conducted on popular CNNs demonstrate that, in comparison with existing methodologies, our technique can detect one-pixel attacks significantly faster. [ABSTRACT FROM AUTHOR]

This correction notice provides updates and corrections to a research paper on deep machine learning model-based cyber-attacks detection in smart power systems. The paper proposes a deep learning-based attack detection model that addresses system disturbances caused by natural events and cyber-attacks. It discusses the use of principal component analysis (PCA) for feature selection and the potential of deep learning-based and decision tree classifiers for detecting cyber-attacks in intelligent energy grids. The notice also includes updates to references, clarifications on the experimental data set, and feature selection based on PCA. The study evaluates the effectiveness of the proposed model using various assessment indexes and compares it to conventional methods, concluding that the proposed model is effective in detecting cyber-attacks and demonstrates good performance in detecting destructive attacks. [Extracted from the article]

Artificial Intelligence is quickly emerging as a technological solution for the agriculture industry to surmount its classical challenges. Artificial Intelligence is facilitating farmers to refine their products and alleviate unfavourable impacts due to the environment. The central concern of this paper is predictive analytics to develop a machine learning model to identify and predict crop yield based on multiple environmental factors. In this paper, a hybrid learner 'RaNN' is proposed that combines the feature sampling and majority voting technique of Random Forest in-combination with the multilayer Feedforward Neural Network to predict the crop yield. Research has also ascertained the essential features responsible for accurate yield prediction. The proposed model works for rice yield prediction, one of the chief grains of India. The region chosen for the work is Punjab, which is among the largest producer states of India for rice. The dataset consists of 15 attributes comprising the weather and agriculture data collected from the Indian Meteorological Department Pune, and Punjab Environment Information System (ENVIS) Center, Government of India. The study has also made a comparative assessment of 'RaNN' with machine learning methods like Multiple Linear Regression, Random Forest, Decision Tree, Boosting Regression, Support Vector Machine Regression, Ensemble Learner, and Artificial Neural Network. Our model RaNN has listed a better prediction accuracy with minimal error among the other techniques providing a 98% correlation between the actual and the predicted yield. Abbreviations: AI – Artificial Intelligence; ANN – Artificial Neural Network; BR – Boosting Regression; Chem Fert – chemical fertilisers; DT – Decision Tree; EL – Ensemble Learner; ENVIS – Punjab Environment Information System; GBM – Stochastic Gradient Boosting Method; GPS – Global Positioning System; HMAX – highest maximum temperature in degrees C; IMD – Indian Meteorological Department; L1 – Lasso regression; L2 – Ridge regression; LMIN – lowest minimum temperature; ML – Machine Learning; MAE – Mean Absolute Error; MEVP – mean evaporation in mm; MLR – Multiple Linear Regression; MMAX – mean maximum temperature in degrees C; MMIN – mean minimum temperature in degrees C; MSSH – Mean sunshine duration in hours; MWS – mean wind speed in km/h; P1 – number of days with precipitation (0.1–0.2 mm); P2 – number of days with precipitation (greater than or equal to 0.3 mm); RaNN – Hybrid RF-ANN model; RMSE – Root Mean Squared Error; $${R^2}$$ R 2 – Coefficient of determination; RD – number of rainy days; RF – Random Forest; SVM Reg – Support Vector Machine Regression; TMRF – total rainfall per month in mm [ABSTRACT FROM AUTHOR]

Electricity consumption in buildings is one of the major causes of energy usage and knowledge of this can help building owners and users increase energy efficiency and conservation efforts. For Pacific Island countries, building electricity demand data is not readily accessible or available for constructing models to predict electricity demand. This paper starts to fill this gap by studying the case of schools in Fiji. The aim of the paper is to assess the factors affecting electricity demand for grid-connected Fijian schools and use this assessment to build mathematical models (multiple linear regression (MLR) and artificial neural network (ANN)) to predict electricity consumption. The average grid-connected electricity demand in kWh/year was 1411 for early childhood education schools, 5403 for primary schools, and 23,895 for secondary schools. For predicting electricity demand (ED) for all grid-connected schools, the stepwise MLR model shows that taking logarithm transformations on both the dependent variable and independent variables (number of students, lights, and air conditioning systems) yields statistically significant independent variables with an R2 value of 73.3% and RMSE of 0.2248. To improve the predicting performance, ANN models were constructed on both the natural form of variables and transformed variables. The optimum ANN model had an R2 value of 95.3% and an RMSE of 59.4 kWh/year. The findings of this study can assist schools in putting measures in place to reduce their electricity demand, associated costs, and carbon footprint, as well as help government ministries make better-informed policies. [ABSTRACT FROM AUTHOR]

The digitization of distribution power systems has revolutionized the way data are collected and analyzed. In this paper, the critical task of harnessing this information to identify irregularities and anomalies in electricity consumption is tackled. The focus is on detecting non-technical losses (NTLs) and energy theft within distribution networks. A comprehensive overview of the methodologies employed to uncover NTLs and energy theft is presented, leveraging measurements of electricity consumption. The most common scenarios and prevalent cases of anomalies and theft among consumers are identified. Additionally, statistical indicators tailored to specific anomalies are proposed. In this research paper, the practical implementation of numerous artificial intelligence (AI) algorithms, including the artificial neural network (ANN), ANFIS, autoencoder neural network, and K-mean clustering, is highlighted. These algorithms play a central role in our research, and our primary objective is to showcase their effectiveness in identifying NTLs. Real-world data sourced directly from distribution networks are utilized. Additionally, we carefully assess how well statistical methods work and compare them to AI techniques by testing them with real data. The artificial neural network (ANN) accurately identifies various consumer types, exhibiting a frequency error of 7.62%. In contrast, the K-means algorithm shows a slightly higher frequency error of 9.26%, while the adaptive neuro-fuzzy inference system (ANFIS) fails to detect the initial anomaly type, resulting in a frequency error of 11.11%. Our research suggests that AI can make finding irregularities in electricity consumption even more effective. This approach, especially when using data from smart meters, can help us discover problems and safeguard distribution networks. [ABSTRACT FROM AUTHOR]

This paper presents a novel sound event detection (SED) system for rare events occurring in an open environment. Wavelet multiresolution analysis (MRA) is used to decompose the input audio clip of 30 seconds into five levels. Wavelet denoising is then applied on the third and fifth levels of MRA to filter out the background. Significant transitions, which may represent the onset of a rare event, are then estimated in these two levels by combining the peak-finding algorithm with the K-medoids clustering algorithm. The small portions of one-second duration, called 'chunks' are cropped from the input audio signal corresponding to the estimated locations of the significant transitions. Features from these chunks are extracted by the wavelet scattering network (WSN) and are given as input to a support vector machine (SVM) classifier, which classifies them. The proposed SED framework produces an error rate comparable to the SED systems based on convolutional neural network (CNN) architecture. Also, the proposed algorithm is computationally efficient and lightweight as compared to deep learning models, as it has no learnable parameter. It requires only a single epoch of training, which is 5, 10, 200, and 600 times lesser than the models based on CNNs and deep neural networks (DNNs), CNN with long short-term memory (LSTM) network, convolutional recurrent neural network (CRNN), and CNN respectively. The proposed model neither requires concatenation with previous frames for anomaly detection nor any additional training data creation needed for other comparative deep learning models. It needs to check almost 360 times fewer chunks for the presence of rare events than the other baseline systems used for comparison in this paper. All these characteristics make the proposed system suitable for real-time applications on resource-limited devices. [ABSTRACT FROM AUTHOR]

Despite the complex punching shear behavior of reinforced concrete slabs have been comprehensively addressed in the literature, it is further essential to develop a universal design model comprising high accuracy and the simplicity for design practicability, adaptable to diverse conditions encountered in practice. Artificial intelligence applications, artificial neural networks (ANN), and more recently, various machine learning (ML) and deep learning (DL) techniques veer off in a new direction in structural engineering context with improved accuracy and efficiency. The paper begins with the assessment of the capabilities of various artificial intelligence applications in predicting the punching shear strength of slab-column connections without shear reinforcement through the extensive database using 650 punching shear experiments from the literature. Critical parameters influencing the punching shear strength as well as the precision of the current code provisions in predicting this feature were then thoroughly examined in the paper. The results shown in this paper validated the competency of artificial intelligence applications in predicting the punching shear strength of such connections with increased accuracy and improved simplicity in practical terms. The proposed models utilizing the artificial intelligence applications encourage the ultimate rehabilitation policies to be proposed and improved code provisions to be developed for contemporary structures. [ABSTRACT FROM AUTHOR]

In this paper, we discuss the implementation of artificial self-awareness mechanisms and self-reflection abilities in deep neural networks. While the current limitations of research prevent achieving cognitive capabilities on par with natural biological entities, the incorporation of basic self-awareness and self-reflection mechanisms in deep learning architectures offers substantial advantages in tackling specific problems across various scientific fields, including geosciences. In the first section, we outline the foundational architecture of our deep learning approach termed Self-Aware Learning (SAL). The subsequent part of the paper highlights the practical benefits of this machine learning methodology through synthetic tests and applications addressed to automatic classification and image analysis of real petrological data sets. We show how Self-Aware Learning allows enhanced accuracy, reduced overfitting problems, and improved performances compared to other existing methods. [ABSTRACT FROM AUTHOR]

This paper is about the opposite of judgement and calculation. This opposition has been a traditional anchor of critiques concerned with the rise of AI decision making over human judgement. Contrary to these approaches, it is argued that human judgement is not and cannot be replaced by calculation, but that it is human judgement that contextualises computational structures and gives them meaning and purpose. The article focuses on the epistemic structure of algorithms and artificial neural networks to find that they always depend on human judgement to be related to real life objects or purposes. By introducing the philosophical concept of judgement, it becomes clear that the property of judgement to provide meaning and purposiveness is based on the temporality of human life and the ambiguity of language, which quantitative processes lack. A juxtaposition shows that calculations and clustering can be used and referred to in more or less prejudiced and reflecting as well as opaque and transparent ways, but thereby always depend on human judgement. The paper clearly asserts that the transparency of AI is necessary for their autonomous use. This transparency requires the explicitness of the judgements that constitute these computational structures, thereby creating an awareness of the conditionality of such epistemic entities. [ABSTRACT FROM AUTHOR]

Deep neural networks are extensively used in text mining and Natural Language Processing is to enable computers to understand, analyze, and generate natural language data, such as text or speech, but semantic resources, such as taxonomies and ontologies, are not fully included in deep learning. In this paper, we use Deep Convolutional Neural Network (Deep CNN) to classify research papers using the Computer Science Ontology, an ontology of research areas in the field of computer science. It takes as input the abstract and keywords of a particular research paper and returns the relevant research topic. To evaluate our ontology, we used a gold standard dataset that includes research articles. To further improve text classification results, we propose to design a Deep CNN model. We then used ontology matching to reduce the classes and get better results. Experimental results show that the proposed approach outperforms the one with the highest precision, recall, and F1-score. [ABSTRACT FROM AUTHOR]

The use of explosives to target civilian buildings and other structures around the world is becoming a growing problem in modern societies. This paper focuses on RC beams exposed to free air blast loads. The paper first presents a parametric study on the behavior of RC beams subjected to blast loads using finite element simulation and then proposes an Artificial Neural Network (ANN) model to predict that behavior in a simple and easy manner. The ABAQUS program is used to simulate RC beams under blast loads. Experimental data was collected from the literature and used to validate the ABAQUS models. Deflection, reaction forces, ultimate stress, ultimate strain, and failure mode of RC beams are investigated. The considered design parameters in the parametric study are the characteristic compressive strength of concrete (fcu), the transverse reinforcement ratio (ρT%), the longitudinal reinforcement ratio (ρL%), and the scaled distance (Z). In this paper, the proposed ANN model was trained and tested using datasets produced using ABAQUS. The input parameters of the ANN model are TNT weight, standoff distance (D), characteristic compressive strength of concrete, transverse reinforcement ratio, longitudinal reinforcement ratio, width-to-thickness ratio (b/t), and length-to-thickness ratio (L/t). The predicted behavior using the ANN model showed the credibility of the model. The results indicated that L/t, b/t, and Z have significant effects on the behavior of RC beams under blast loads compared with fcu, ρT%, and ρL%, the cracks area increases with the decrease in Z, fcu, and b/t and decreases with L/t decrease. [ABSTRACT FROM AUTHOR]

One key frontier of artificial intelligence (AI) is the ability to comprehend research articles and validate their findings, posing a magnanimous problem for AI systems to compete with human intelligence and intuition. As a benchmark of research validation, the existing peer-review system still stands strong despite being criticized at times by many. However, the paper vetting system has been severely strained due to an influx of research paper submissions and increased conferences/journals. As a result, problems, including having insufficient reviewers, finding the right experts, and maintaining review quality, are steadily and strongly surfacing. To ease the workload of the stakeholders associated with the peer-review process, we probed into what an AI-powered review system would look like. In this work, we leverage the interaction between the paper's full text and the corresponding peer-review text to predict the overall recommendation score and final decision. We do not envisage AI reviewing papers in the near future. Still, we intend to explore the possibility of a human–AI collaboration in the decision-making process to make the current system FAIR. The idea is to have an assistive decision-making tool for the chairs/editors to help them with an additional layer of confidence, especially with borderline and contrastive reviews. We use a deep attention network between the review text and paper to learn the interactions and predict the overall recommendation score and final decision. We also use sentiment information encoded within peer-review texts to guide the outcome further. Our proposed model outperforms the recent state-of-the-art competitive baselines. We release the code of our implementation here: https://github.com/PrabhatkrBharti/PEERRec.git. [ABSTRACT FROM AUTHOR]

Over the last few years, a plethora of papers presenting machine-learning-based approaches for intrusion detection have been published. However, the majority of those papers do not compare their results with a proper baseline of a signature-based intrusion detection system, thus violating good machine learning practices. In order to evaluate the pros and cons of the machine-learning-based approach, we replicated a research study that uses a deep neural network model for intrusion detection. The results of our replicated research study expose several systematic problems with the used datasets and evaluation methods. In our experiments, a signature-based intrusion detection system with a minimal setup was able to outperform the tested model even under small traffic changes. Testing the replicated neural network on a new dataset recorded in the same environment with the same attacks using the same tools showed that the accuracy of the neural network dropped to 54%. Furthermore, the often-claimed advantage of being able to detect zero-day attacks could not be seen in our experiments. [ABSTRACT FROM AUTHOR]

Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person's emotional state in an image or a video. This process, called "Facial Expression Recognition (FER)", has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed. [ABSTRACT FROM AUTHOR]

The purpose of this paper is to investigate the utilization of artificial neural networks (ANNs) in learning models that address the nonlinear anisotropic flow and hysteresis retention behavior of deformable porous materials. Herein, the micro‐geometries of various networks of porous Bentheimer Sandstones subjected to several degrees of strain from the literature are considered. For the generation of the database required for the training, validation, and testing of the machine learning (ML) models, single‐phase and biphasic lattice Boltzmann (LB) simulations are performed. The anisotropic nature of the intrinsic permeability is investigated for the single‐phase LB simulations. Thereafter, the database contains the computed average fluid velocities versus the pressure gradients. In this database, the range of applied fluid pressure gradients includes Darcy as well as non‐Darcy flows. The generated output from the single‐phase flow simulations is implemented in a feed‐forward neural network, representing a path‐independent informed graph‐based model. Concerning the two‐phase LB simulations, the Shan‐Chen multiphase LB model is used to generate the retention curves of the cyclic drying/wetting processes in the deformed porous networks. Consequently, two different ML path‐dependent approaches, that is, 1D convolutional neural network and the recurrent neural network, are used to model the biphasic flow through the deformable porous materials. A comparison in terms of accuracy and speed of training between the two approaches is presented. Conclusively, the outcomes of the papers show the capability of the ML models in representing constitutive relations for permeability and hysteretic retention curves accurately and efficiently. [ABSTRACT FROM AUTHOR]

Simple Summary: This paper presents a novel approach to produce virtual contrast enhanced (VCE) images for nasopharyngeal cancer (NPC) without the use of contrast agents, which carry certain risks. This model uses pixelwise gradient term to capture the shape and a GAN terms to capture the texture of the real contrast enhanced T1C images With similar accuracy to existing models, our method shows an advantage in reproducing texture closer to the realistic contrast-enhanced images. This results are tested by various measures, including mean absolute error (MAE), mean square error (MSE) and structural similarity index (SSIM) for similarity accuracy; total mean square variation per mean intensity (TMSVPMI), the total absolute vari-ation per mean intensity (TAVPMI), Tenengrad function per mean intensity (TFPMI) and variance function per mean intensity (VFPMI) Various variations of the model, including fine-tuning of the hyperparameters, normalization methods on the images and using single modality, have also been investigated to test the optimal performance. Background: The development of advanced computational models for medical imaging is crucial for improving diagnostic accuracy in healthcare. This paper introduces a novel approach for virtual contrast enhancement (VCE) in magnetic resonance imaging (MRI), particularly focusing on nasopharyngeal cancer (NPC). Methods: The proposed model, Pixelwise Gradient Model with GAN for Virtual Contrast Enhancement (PGMGVCE), makes use of pixelwise gradient methods with Generative Adversarial Networks (GANs) to enhance T1-weighted (T1-w) and T2-weighted (T2-w) MRI images. This approach combines the benefits of both modalities to simulate the effects of gadolinium-based contrast agents, thereby reducing associated risks. Various modifications of PGMGVCE, including changing hyperparameters, using normalization methods (z-score, Sigmoid and Tanh) and training the model with T1-w or T2-w images only, were tested to optimize the model's performance. Results: PGMGVCE demonstrated a similar accuracy to the existing model in terms of mean absolute error (MAE) (8.56 ± 0.45 for Li's model; 8.72 ± 0.48 for PGMGVCE), mean square error (MSE) (12.43 ± 0.67 for Li's model; 12.81 ± 0.73 for PGMGVCE) and structural similarity index (SSIM) (0.71 ± 0.08 for Li's model; 0.73 ± 0.12 for PGMGVCE). However, it showed improvements in texture representation, as indicated by total mean square variation per mean intensity (TMSVPMI) (0.124 ± 0.022 for ground truth; 0.079 ± 0.024 for Li's model; 0.120 ± 0.027 for PGMGVCE), total absolute variation per mean intensity (TAVPMI) (0.159 ± 0.031 for ground truth; 0.100 ± 0.032 for Li's model; 0.153 ± 0.029 for PGMGVCE), Tenengrad function per mean intensity (TFPMI) (1.222 ± 0.241 for ground truth; 0.981 ± 0.213 for Li's model; 1.194 ± 0.223 for PGMGVCE) and variance function per mean intensity (VFPMI) (0.0811 ± 0.005 for ground truth; 0.0667   ± 0.006 for Li's model; 0.0761   ± 0.006 for PGMGVCE). Conclusions: PGMGVCE presents an innovative and safe approach to VCE in MRI, demonstrating the power of deep learning in enhancing medical imaging. This model paves the way for more accurate and risk-free diagnostic tools in medical imaging. [ABSTRACT FROM AUTHOR]

This paper presents a model for determining the availability of continuous systems at open pits using the neuro-fuzzy system. The concept of availability is divided into partial indicators (synthetic indicators and sub-indicators). The presented model in relation to already existing models for determining availability uses a combination of the advantages of artificial neural networks and fuzzy logic. The case study addressed the I ECC (bucket wheel excavator–conveyors–crushing plant) system of the open pit Drmno, Kostolac. In this paper, in addition to the ANFIS model for determining the availability of continuous systems, a simulation model was developed. The obtained results of the ANFIS model were verified with the help of a simulation model that uses certain assumptions about the distribution of failures. This paper was created as a result of several years of field and theoretical research into the availability of continuous systems in open pits, and completes a cycle that consists of several published articles on the subject of modeling the behavior of these systems in real time using a time picture of the state, expert assessment, simulation and AI models, while respecting the multidisciplinarity of the problem (mining technological, mechanical, and information technological aspects). The developed ANFIS model is a key instrument for improving operational efficiency and resource management in the mining sector. Its ability to accurately predict the availability of the ECC system brings not only operational benefits through reduced downtime and optimized maintenance, but also a potential reduction in overall costs at coal open pits. Such an innovative model marks a significant step forward in the mining industry, especially when it comes to continuous systems in coal open pits. [ABSTRACT FROM AUTHOR]

Accurate prediction of sea level height is critically important for the government in assessing sea level risk in coastal areas. However, due to the nonlinear, time-varying and highly uncertain characteristics of sea level change data, sea level prediction is challenging. To improve the accuracy of sea level prediction, this paper uses a new swarm intelligence algorithm named the sparrow search algorithm (SSA), which can imitate the foraging behavior and antipredation behavior of sparrows, to determine optimal solutions. To avoid the algorithm falling into a local optimal situation, this paper integrates the sine–cosine algorithm and the Cauchy variation strategy into the SSA to obtain an algorithm named the SCSSA. The SCSSA is used to optimize the parameter values of the CNN-BiLSTM (convolutional neural network combined with bidirectional long short-term memory neural network) model; finally, a combined neural network model (named SCSSA-CNN-BiLSTM) is proposed. In this paper, the time series data of seven tidal stations located in coastal China are used for experimental analysis. First, the SCSSA-CNN-BiLSTM model is compared with the CNN-BiLSTM model to predict the time series data of SHANWEI Station. With respect to the training and test sets of data, the SCSSA-CNN-BiLSTM model outperforms the other models on all the evaluation metrics. In addition, the remaining six tide station datasets and five neural network models, including the SCSSA-CNN-BiLSTM model, are used to further study the performance of the proposed prediction model. Four evaluation indices including the root mean squared error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE) and coefficient of determination (R2) are adopted. For six stations, the RMSE, MAE, MAPE and R2 of SCSSA-CNN-BiLSTM model are ranged from 20.9217 ~ 27.8427 mm, 9.4770 ~ 17.8603 mm, 0.1322% ~ 0.2482% and 0.9119 ~ 0.9759, respectively. The experimental analysis results show that the SCSSA-CNN-BiLSTM model makes effective predictions at all stations, and the prediction performance is better than that of the other models. Even though the combination of SCSSA algorithm may increase the complexity of the model, indeed the proposed model is a new prediction method with good accuracy and robustness for predicting sea level change. [ABSTRACT FROM AUTHOR]

Matrix factorization is an inference problem that has acquired importance due to its vast range of applications that go from dictionary learning to recommendation systems and machine learning with deep networks. The study of its fundamental statistical limits represents a true challenge, and despite a decade-long history of efforts in the community, there is still no closed formula able to describe its optimal performances in the case where the rank of the matrix scales linearly with its size. In the present paper, we study this extensive rank problem, extending the alternative 'decimation' procedure that was recently introduced by Camilli and Mézard, and carry out a thorough study of its performance. Decimation aims at recovering one column/line of the factors at a time, by mapping the problem into a sequence of neural network models of associative memory at a tunable temperature. The main advantage of decimation is that its theoretical performance can be studied using statistical physics techniques. In this paper we provide the general analysis applying to a large class of compactly supported priors and we show that the replica symmetric free entropy of the neural network models takes a universal form in the low temperature limit. We then study the decimation phase diagrams in two concrete cases, the sparse Ising prior and the uniform prior, for which we show that matrix factorization is theoretically possible when the ration P / N of rank to variable is below a certain threshold. This suggest that a possible route to solving algorithmically the matrix factorization problem could be to find efficient decimation algorithms; in this respect, we show that simple simulated annealing, though being effective for limited signal sizes, is not scalable. [ABSTRACT FROM AUTHOR]

With the ongoing integration of information technology and industrialization, strategic emerging industries are becoming an increasingly important force in guiding future economic and social development. As one of the strategic emerging industries' development priorities and a replacement for scarce labor resources, industrial robots will be widely used in labor-intensive industries. It is a contentious topic how to evaluate and improve robot knowledge education. There are modular features introduced in this paper, which builds a modular network for the evaluation of robot knowledge education quality and enhances the cognitive computing ability of artificial neural networks and their ability to process complex information. A modular neural network-based model of feature combination robot knowledge education quality evaluation is developed based on the three aspects of module division method, subnet structure selection, and feature combination output. The following are some of the paper's most important contributions: K-OD algorithm of density clustering optimized by K-means is proposed. Because of its high level of modularized partition simulating, this method has an excellent clustering effect, and it identifies the core points, boundary points, as well as outliers. Using K-OD algorithm, the calculation of density radius and threshold is optimized by using density clustering, which reduces the overall computational complexity. Find out how SOM neural networks learn from competition. SOM network's competition layer neuron weights are prone to falling into local optimal solutions, so an SASOM neural network with weight adjustment simulated by an annealing algorithm is proposed to address this issue. It is more accurate in terms of prediction and error, and it is better at identifying sample attribute features. This work builds a modular neural network for evaluating robot knowledge education quality using K-OD clustering algorithm and SASOM neural network, which introduces the simulated annealing mechanism. [ABSTRACT FROM AUTHOR]

This paper presents an investigation into the performance of radial distribution systems (DS) with the installation of series capacitors in feeder sections. While the use of shunt capacitors to enhance voltage profile in DS has been acknowledged, the benefits of series capacitors have only been explored to a limited extent. Load flow analysis, while commonly used for offline evaluation of DS, can at times yield inconclusive results due to convergence issues. To mitigate this, an alternative approach is proposed using Artificial Neural Networks (ANN) to directly determine system performance. The viability of the proposed technique is evaluated for IEEE 12 and IEEE 33 bus DS's having series capacitor in feeder section for voltage improvement and line loss minimization. Therefore, this paper serves to contributes to the two main novelties namely, (1) Development of efficient ANN model to directly determine the maximum voltage regulation and line losses and (2) improvement of voltage and line losses reduction through series capacitor installation in feeder section of the DS. The results show that the utilization of an ANN model enhances accuracy and speeds up predictions, while the installation of series capacitors in feeder sections improves voltage regulation and reduces line losses. [ABSTRACT FROM AUTHOR]

The paramount concern of highly accurate energy-efficient computing in machines with significant cognitive capabilities aims to enhance the accuracy and efficiency of bio-inspired Spiking Neural Networks (SNNs). This paper addresses this main objective by introducing a novel spatial power spike-timing-dependent plasticity (Spatial-Pow-STDP) learning rule as a digital block with high accuracy in a bio-inspired SNN model. Motivated by the demand for precise and accelerated computation that reduces high-cost resources in neural network applications, this paper presents a methodology based on COordinate Rotation DIgital Computer (CORDIC) definitions. The proposed designs of CORDIC algorithms for exponential (Exp CORDIC), natural logarithm (Ln CORDIC), and arbitrary power function (Pow CORDIC) are meticulously detailed and evaluated to ensure optimal acceleration and accuracy, which respectively show average errors near 10–9, 10–6, and 10–5 with 4, 4, and 6 iterations. The engineered architectures for the Exp, Ln, and Pow CORDIC implementations are illustrated and assessed, showcasing the efficiency achieved through high frequency, leading to the introduction of a Spatial-Pow-STDP learning block design based on Pow CORDIC that facilitates efficient and accurate hardware computation with 6.93 × 10–3 average error with 9 iterations. The proposed learning mechanism integrates this structure into a large-scale spatiotemporal SNN consisting of three layers with reduced hyper-parameters, enabling unsupervised training in an event-based paradigm using excitatory and inhibitory synapses. As a result, the application of the developed methodology and equations in the computational SNN model for image classification reveals superior accuracy and convergence speed compared to existing spiking networks by achieving up to 97.5%, 97.6%, 93.4%, and 93% accuracy, respectively, when trained on the MNIST, EMNIST digits, EMNIST letters, and CIFAR10 datasets with 6, 2, 2, and 6 training epochs. [ABSTRACT FROM AUTHOR]

The number of papers on machine learning and deep neural networks applied to intrusion detection systems (IDS) is ever-increasing. Differently from existing work on the topic, this paper explores the effect of training-time randomness of deep neural networks, which is overlooked by the related literature. Training-time randomness is regulated by the seed of the pseudorandom number generator, and affects the performance of IDS models. The seed selection is studied in conjunction with other critical learning parameters: to the best of our knowledge, there are no similar studies in IDS. The experiments are done with a recent and widely consolidated intrusion detection benchmark, which is used to train and test a neural network under different combinations of seeds and parameters both in supervised and semi-supervised learning modes. The results are inferred by a mixture of explorative analysis, design of experiments, and analysis of variance. According to the results, the choice of the seed yields either excellent or scarce detection metrics; more importantly, the seed selection might be as relevant as the other major learning parameters assessed. [ABSTRACT FROM AUTHOR]

Due to the low thickness of cold-formed steel (CFS) sections, welding of traditional studs on them is not recommended; and there is a need to use shear connectors suitable for this type of sections. In this paper, the behavior of U-shaped shear connectors as connectors compatible with CFS composite beams has been investigated, to offer practical relationships for predicting the ultimate strength of this type of connectors. Accordingly, after the development of finite element (FE) models with the ability to predict the ultimate strength of U-shaped connectors, their performance against experimental results was validated. Then, an extensive parametric study, consisting of 216 numerical samples, was accomplished to provide a reliable database. As the main and most important of this study, two methods of artificial neural networks and stepwise regression were developed, and practical formulations were proposed to predict the ultimate strength of U-shaped shear connectors in CFS composite beams. Finally, in addition to evaluating the accuracy of the proposed formulas, a comparison was made between them and the relationships proposed by AISI, AS/NZS and EC3 codes for CFS screw connections. The relationships presented in this paper can be used by practical engineers in the design process of CFS composite beams. [ABSTRACT FROM AUTHOR]

Previously, single classification models were mainly studied to classify human protein cell images, i.e., to identify a certain protein based on a set of different cells. However, a classifier can identify only one protein, in fact, a single cell usually consists of multiple proteins, and the proteins are not completely independent of each other. In this paper, we build a human protein cell classification model by multi-label learning. The logical relationship and distribution characteristics among the labels are analyzed to determine the different proteins contained in a set of different cells (i.e., containing multiple elements in the output space). In this paper, using human protein image data, we conducted comparison experiments on pre-trained Xception and InceptionResnet V2 to optimize the two models in terms of data augmentation, channel settings, and model structure. The results show that the Optimized InceptionResnet V2 model achieves high performance in the classification task. The final accuracy of the Optimized InceptionResnet V2 model we obtained reached 96.1%, which is a 2.82% improvement relative to that before the optimized model. [ABSTRACT FROM AUTHOR]

Super-computing or HPC clusters are built to provide services to execute computationally complex applications. Generally, these HPC applications involve large scale IO (input/output) processing over the networked parallel file system disks. They are commonly developed on top of the C/C++ based MPI standard library. The HPC clusters MPI–IO performance significantly depends on the particular parameter value configurations, not generally considered when writing the algorithms or programs. Therefore, this leads to poor IO and overall program performance degradation. The IO is mostly left to individual practitioners to be optimised at code level. This usually leads to unexpected consequences due to IO bandwidth degradation which becomes inevitable as the file data scales in size to petabytes. To overcome the poor IO performance, this research paper presents an approach for auto-tuning of the configuration parameters by forecasting the MPI–IO bandwidth via artificial neural networks (ANNs), a machine learning (ML) technique. These parameters are related to MPI–IO library and lustre (parallel) file system. In addition to this, we have identified a number of common configurations out of numerous possibilities, selected in the auto-tuning process of READ/WRITE operations. These configurations caused an overall READ bandwidth improvement of 65.7% with almost 83% test cases improved. In addition, the overall WRITE bandwidth improved by 83% with number of test cases improved by almost 93%. This paper demonstrates that by using auto-tuning parameters via ANNs predictions, this can significantly impact overall IO bandwidth performance. [ABSTRACT FROM AUTHOR]

Autonomous spacecraft relative navigation via monocular images became a hot topic in the past few years and, recently, received a further push thanks to the constantly growing field of artificial neural networks and the publication of several spaceborne image datasets. Despite the proliferation of spacecraft relative-state initialization algorithms developed, most architectures adopt computationally expensive solutions relying on convolutional neural networks (CNNs) that provide accurate output at the cost of a high computational burden that seems unfeasible for current spaceborne hardware. The paper addresses this issue by proposing a novel pose initialization algorithm based on lightweight CNNs. Inspired by previous state-of-the-art algorithms, the developed architecture leverages a fast and accurate target detection CNN followed by a line segment detection CNN capable of running with low inference time on mobile devices. The line segments and their junctions are grouped into complex geometrical groups, reducing the solution search space, and subsequently, they are adopted to extract the final pose estimate. As a main outcome, the analyses demonstrate that the lightweight architecture developed scores high accuracy in the pose estimation task, with a mean estimation error of less than 10 cm in translation and 2.5°in rotation. The baseline algorithm scores a mean SLAB error of 0.04552 with a standard deviation of 0.22972 in the test dataset. Detailed analyses demonstrate that the uncertainties on the overall pose score are driven mainly by errors in the relative attitude, which gives the highest contribution to the pose error metric adopted. The analyses on the error distributions point out that the uncertainties on the estimated relative position are higher in the camera boresight axis direction. Concerning the relative attitude, the algorithm proposed has higher uncertainties in estimating directions of the target x and y axes due to ambiguities related to the target geometry. Notably, the target detection CNN trained in this work outperforms the previous top scores in the benchmark dataset. The performances of the proposed algorithm have been investigated further by analyzing the effects on the accuracy due to the relative distance and the presence of background in the images. Lastly, the paper delves into the possibility of adopting a sub-portion of the 2D-to-3D match matrix made by the most complex perceptual groups identified that positively affects the overall run-time, pointing out the performances in terms of accuracy of the estimates and providing a comparison of both the baseline and the reduced match matrix versions against state-of-the-art algorithms concerning relative position and attitude errors and solution availability, highlighting the high accuracy and solution availability of the proposed architectures. • New relative pose initialization algorithm based on the detection of line segments. • Detailed literature review and description of available spaceborne image datasets. • Improvement of state of the art in spacecraft detection using lightweight CNN. • Assessment of accuracy of the proposed architecture and error sources analyses. • Proven feasibility of the approach via comparison with other architectures. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the journal IET Radar, Sonar & Navigation. It discusses the advances in AI-assisted radar sensing applications and the challenges that hinder its adoption in this field. The special issue of the journal features nine papers that address these challenges and offer innovative ideas and experimental results. The papers cover a range of topics, including health monitoring, human activity recognition, voice identification, elderly care health monitoring, track-to-track association, signal pre-processing, traffic congestion alleviation, and target recognition. The authors express their gratitude to the contributors and reviewers and believe that the research presented will inspire further exploration and innovation in this field. [Extracted from the article]

ANNs have become a cornerstone in efficiently managing building energy management systems (BEMSs) as they offer advanced capabilities for prediction, control, and optimization. This paper offers a detailed review of recent, significant research in this domain, highlighting the use of ANNs in optimizing key energy systems, such as HVAC systems, domestic water heating (DHW) systems, lighting systems (LSs), and renewable energy sources (RESs), which have been integrated into the building environment. After illustrating the conceptual background of the most common ANN architectures for controlling BEMSs, the current work dives deep into relative research applications, thereby exhibiting their methodology and outcomes. By summarizing the numerous impactful applications during 2015–2023, this paper categorizes the predominant ANN-based techniques according to their methodological approach, specific energy equipment, and experimental setups. Grounded in the different perspectives that the integrated studies illustrate, the primary focus of this paper is to evaluate the overall status of ANN-driven control in building energy management, as well as to offer a deep understanding of the prevailing trends at the building level. Leveraging detailed graphical depictions and comparisons between different concepts, future directions, and fruitful conclusions are drawn, and the upcoming innovations of ANN-based control frameworks in BEMSs are highlighted. [ABSTRACT FROM AUTHOR]

This paper discusses the problem of recognizing defective epoxy drop images for the purpose of performing vision-based die attachment inspection in integrated circuit (IC) manufacturing based on deep neural networks. Two supervised and two unsupervised recognition models are considered. The supervised models examined are an autoencoder (AE) network together with a multi-layer perceptron network (MLP) and a VGG16 network, while the unsupervised models examined are an autoencoder (AE) network together with k-means clustering and a VGG16 network together with k-means clustering. Since in practice very few defective epoxy drop images are available on an actual IC production line, the emphasis in this paper is placed on the impact of data augmentation on the recognition outcome. The data augmentation is achieved by generating synthesized defective epoxy drop images via our previously developed enhanced loss function CycleGAN generative network. The experimental results indicate that when using data augmentation, the supervised and unsupervised models of VGG16 generate perfect or near perfect accuracies for recognition of defective epoxy drop images for the dataset examined. More specifically, for the supervised models of AE+MLP and VGG16, the recognition accuracy is improved by 47% and 1%, respectively, and for the unsupervised models of AE+Kmeans and VGG+Kmeans, the recognition accuracy is improved by 37% and 15%, respectively, due to the data augmentation. [ABSTRACT FROM AUTHOR]

This document serves as a preface to a special issue of the International Journal on Artificial Intelligence Tools (IJAIT). The articles in this issue build upon papers presented at the 36th International Florida AI Research Society Conferences in May 2023. The lead article introduces the theme of the special issue, which is explainable, fair, and Trustworthy AI. Other articles in the issue cover topics such as improving the bounds of a neuron's Boolean function, ethical explanations and transparency in AI systems, fairness measurement and mitigation in deep learning systems, and the dynamics of human-agent collaboration in ad hoc teams. The paper emphasizes the importance of positive and negative contrastive explanations in enhancing motivation and performance. It also addresses the challenges of fairness and reliability in predictive policing systems, with a focus on reducing bias related to race, age, and sex. The authors propose tailoring predictive models to specific causal queries and utilizing causal structure instead of relying solely on pre-trained models. The paper also explores how machine learning models can balance accuracy and understandability, as well as ensure fairness. The findings indicate that more complex models tend to outperform current guidelines, but fair models have lower complexity. The paper concludes by expressing gratitude to the reviewers for their contributions and support. [Extracted from the article]

This paper trains a multilayered neural network (MLNN) for solving fractional delay differential equations (FDDEs), including nonlinear and singular types. The proposed methodology involves replacing the unknown functions in the equations with a truncated power series expansion. Subsequently, a collection of algebraic equations is solved utilizing an iterative minimization technique that leverages the capabilities of the MLNN architecture. The outcomes demonstrate that the MLNN architecture provides the required accuracy and strong stability compared to several numerical methods. [ABSTRACT FROM AUTHOR]

Many studies suggest that probabilistic spiking in biological neural systems is beneficial as it aids learning and provides Bayesian inference-like dynamics. If appropriately utilised, noise and stochasticity in nanoscale devices can benefit neuromorphic systems. In this paper, we build a stochastic leaky integrate and fire (LIF) neuron, utilising a Mott memristor's inherent stochastic switching dynamics. We demonstrate that the developed LIF neuron is capable of biological neural dynamics. We leverage these characteristics of the proposed LIF neuron by integrating it into a population-coded spiking neural network and a spiking restricted Boltzmann machine (sRBM), thereby showcasing its ability to implement probabilistic learning and inference. The sRBM achieves a software-comparable accuracy of 87.13%. Unlike CMOS-based probabilistic neurons, our design does not require any external noise sources. The designed neurons are highly energy efficient and ultra-compact, requiring only three components: a resistor, a capacitor and a memristor device. [ABSTRACT FROM AUTHOR]