Search

The pulp and paper industry is critical to global industrial and economic development. Recently, India's pulp and paper industries have been facing severe competitive challenges. The challenges have impaired the environmental performance and resulted in the closure of several operations. Assessment and prediction of the performance of the Indian pulp and paper industry using various parameters is a critical task for researchers. This study proposes a framework for performance assessment and prediction based on Data Envelopment Analysis (DEA), Artificial Neural Networks, and Deep Learning (DL) to assist industry administration and decision-making. We presented a case study based on eight industries to demonstrate the methodology's applicability. This study analyses and predicts industry performance based on sample data observations over 30 years. The result suggests the DEA-DL-based efficiency prediction has an overall MSE of 0.08 compared with the actual efficiency. Furthermore, the efficiency rankings are compared between the three techniques. The results suggest that the integrated DEA-DL method is primarily accurate in most scenarios with the actual values. The findings of this study provide a comprehensive analysis of environmental performance for policymakers. [ABSTRACT FROM AUTHOR]

Background: In low-middle income countries, healthcare providers primarily use paper health records for capturing data. Paper health records are utilized predominately due to the prohibitive cost of acquisition and maintenance of automated data capture devices and electronic medical records. Data recorded on paper health records is not easily accessible in a digital format to healthcare providers. The lack of real time accessible digital data limits healthcare providers, researchers, and quality improvement champions to leverage data to improve patient outcomes. In this project, we demonstrate the novel use of computer vision software to digitize handwritten intraoperative data elements from smartphone photographs of paper anesthesia charts from the University Teaching Hospital of Kigali. We specifically report our approach to digitize checkbox data, symbol-denoted systolic and diastolic blood pressure, and physiological data. Methods: We implemented approaches for removing perspective distortions from smartphone photographs, removing shadows, and improving image readability through morphological operations. YOLOv8 models were used to deconstruct the anesthesia paper chart into specific data sections. Handwritten blood pressure symbols and physiological data were identified, and values were assigned using deep neural networks. Our work builds upon the contributions of previous research by improving upon their methods, updating the deep learning models to newer architectures, as well as consolidating them into a single piece of software. Results: The model for extracting the sections of the anesthesia paper chart achieved an average box precision of 0.99, an average box recall of 0.99, and an mAP0.5-95 of 0.97. Our software digitizes checkbox data with greater than 99% accuracy and digitizes blood pressure data with a mean average error of 1.0 and 1.36 mmHg for systolic and diastolic blood pressure respectively. Overall accuracy for physiological data which includes oxygen saturation, inspired oxygen concentration and end tidal carbon dioxide concentration was 85.2%. Conclusions: We demonstrate that under normal photography conditions we can digitize checkbox, blood pressure and physiological data to within human accuracy when provided legible handwriting. Our contributions provide improved access to digital data to healthcare practitioners in low-middle income countries. [ABSTRACT FROM AUTHOR]

Avoiding financial losses requires preventing catastrophic oil‐filled power transformer breakdowns. Continuous online transformer monitoring is needed. The authors use paper insulation to evaluate transformer health for continuous online transformer monitoring. The study suggests a new artificial intelligence method for estimating paper insulation residual life in oil‐immersed power transformers. The four artificial intelligence models use backpropagation‐based neural networks to predict paper insulation lifespan. Four primary transformer insulating paper failure indices—degree of polymerisation, 2‐furfuraldehyde, carbon monoxide, and carbon dioxide—form the basis of these models. Each model, including the backpropagation‐based neural networks, estimates paper insulation life using one failure index, along with moisture and temperature data. Optimisation techniques enhance hidden layer neurons and epoch count for improved performance. Results are validated against literature‐based life models, establishing a precise input–output correlation. This method accurately predicts the remaining useable life of power transformer paper insulation, enabling utilities to take proactive measures for safe and efficient transformer operation. [ABSTRACT FROM AUTHOR]

This document is a summary of a special issue of the journal Sensors, titled "Emerging AI+X-Based Sensor and Networking Technologies including Selected Papers from ICGHIT 2022–2023." The special issue features selected papers from the 10th and 11th International Conferences on Green and Human Information Technology (ICGHITs), which were held in Korea and Thailand. The conferences focused on the theme of "Emerging Artificial Intelligent (AI)+X technology" and "Hyper Automation + Human AI" respectively. The selected papers cover various topics such as network security, routing protocols, signal detection, and clustering mechanisms, all incorporating AI-based methods. The issue also includes papers on topics like secure authentication, distance estimation in RFID systems, energy optimization in smart homes, blockchain technology, and radar signal detection. The authors emphasize the importance of both technology and humanity in advancing green and information technologies. [Extracted from the article]

The significant risk associated with fault reactivation often necessitates slip tendency analyses for effective risk assessment. However, such analyses are challenging, particularly in large areas with limited or absent reliable stress measurements and where the cost of extensive geomechanical analyses or simulations is prohibitive. In this paper, we propose a novel approach using a physics‐informed neural network that integrates stress orientation and satellite displacement observations in a top‐down multi‐scale framework to estimate two‐dimensional slip tendency analyses even in regions lacking comprehensive stress data. Our study demonstrates that velocities derived from a continental scale analysis, combined with reliable stress orientation averages, can effectively guide models at smaller scales to generate qualitative slip tendency maps. By offering customizable data selection and stress resolution options, this method presents a robust solution to address data scarcity issues, as exemplified through a case study of the South Australian Eyre Peninsula. Plain Language Summary: Fault reactivation poses significant risks, often requiring slip tendency analyses for thorough risk assessment. Yet, such analyses face challenges, especially in large areas lacking reliable stress measurements or where extensive geomechanical analyses are too costly. Our paper suggests a new method using a physics‐based neural network. This approach combines compressive direction and satellite displacement observations to estimate slip tendencies in two dimensions, even where stress data is lacking. Our study shows that by using displacements from a continental scale analysis and reliable averages of compressive directions, we can guide models to create smaller‐scale maps indicating where faults are more likely to reactivate. This method allows for customizable data selection and stress resolution, offering a strong solution to data scarcity issues. We demonstrate its effectiveness through a case study of South Australia's Eyre Peninsula. Key Points: Physics‐based neural networks allow two‐dimensional slip tendency analyses without prior full‐stress informationA multi‐scale approach provides required displacement constraints when inferring full stresses from global navigation satellite system (GNSS) and stress orientation dataWe present a new application for GNSS data that would welcome more stations, even in seismically stable areas [ABSTRACT FROM AUTHOR]

Forest biomass estimation is undoubtedly one of the most pressing research subjects at present. Combining multi-source remote sensing information can give full play to the advantages of different remote sensing technologies, providing more comprehensive and rich information for aboveground biomass (AGB) estimation research. Based on Landsat 8, Sentinel-2A, and ALOS2 PALSAR data, this paper takes the artificial coniferous forests in the Saihanba Forest of Hebei Province as the object of study, fully explores and establishes remote sensing factors and information related to forest structure, gives full play to the advantages of spectral signals in detecting the horizontal structure and multi-dimensional synthetic aperture radar (SAR) data in detecting the vertical structure, and combines environmental factors to carry out multivariate synergistic methods of estimating the AGB. This paper uses three variable selection methods (Pearson correlation coefficient, random forest significance, and the least absolute shrinkage and selection operator (LASSO)) to establish the variable sets, combining them with three typical non-parametric models to estimate AGB, namely, random forest (RF), support vector regression (SVR), and artificial neural network (ANN), to analyze the effect of forest structure on biomass estimation, explore the suitable AGB of artificial coniferous forests estimation of machine learning models, and develop the method of quantifying saturation value of the combined variables. The results show that the horizontal structure is more capable of explaining the AGB compared to the vertical structure information, and that combining the multi-structure information can improve the model results and the saturation value to a great extent. In this study, different sets of variables can produce relatively superior results in different models. The variable set selected using LASSO gives the best results in the SVR model, with an R 2 values of 0.9998 and 0.8792 for the training and the test set, respectively, and the highest saturation value obtained is 185.73 t/ha, which is beyond the range of the measured data. The problem of saturation in biomass estimation in boreal medium- and high-density forests was overcome to a certain extent, and the AGB of the Saihanba area was better estimated. [ABSTRACT FROM AUTHOR]

This paper introduces a novel one-dimensional convolutional neural network that utilizes clinical data to accurately detect choledocholithiasis, where gallstones obstruct the common bile duct. Swift and precise detection of this condition is critical to preventing severe complications, such as biliary colic, jaundice, and pancreatitis. This cutting-edge model was rigorously compared with other machine learning methods commonly used in similar problems, such as logistic regression, linear discriminant analysis, and a state-of-the-art random forest, using a dataset derived from endoscopic retrograde cholangiopancreatography scans performed at Olive View–University of California, Los Angeles Medical Center. The one-dimensional convolutional neural network model demonstrated exceptional performance, achieving 90.77% accuracy and 92.86% specificity, with an area under the curve of 0.9270. While the paper acknowledges potential areas for improvement, it emphasizes the effectiveness of the one-dimensional convolutional neural network architecture. The results suggest that this one-dimensional convolutional neural network approach could serve as a plausible alternative to endoscopic retrograde cholangiopancreatography, considering its disadvantages, such as the need for specialized equipment and skilled personnel and the risk of postoperative complications. The potential of the one-dimensional convolutional neural network model to significantly advance the clinical diagnosis of this gallstone-related condition is notable, offering a less invasive, potentially safer, and more accessible alternative. [ABSTRACT FROM AUTHOR]

In this paper, the effect evaluation and production prediction of staged fracturing for horizontal wells in tight reservoirs are studied. Firstly, the basic characteristics and value of horizontal wells in tight reservoirs are introduced, their geological characteristics, flow mechanism and permeability model are analyzed and the application of grey theory in effect analysis is discussed. Considering the problems of staged fracturing effect evaluation and the production prediction of horizontal wells in tight reservoirs, a BP neural network model based on deep learning is proposed. Due to the interference of multiple physical parameters and the complex functional relationship in the development of tight reservoir fracturing, the traditional prediction method has low accuracy and it is difficult to establish an accurate mapping relationship. In this paper, a BP neural network is used to simulate multivariable nonlinear mapping by modifying the model, and its advantages in solving the coupling relationship of complex functions are brought into play. A neural network model with fracturing parameters as input and oil and gas production as output is designed. Through the training and testing of data sets, the accuracy and applicability of the proposed model for effect evaluation and yield prediction are verified. The research results show that the model can fit the complex mapping relationship between fracturing information and production and provide an effective evaluation and prediction tool for the development of the staged fracturing of horizontal wells in tight reservoirs. [ABSTRACT FROM AUTHOR]

Background: MicroRNAs (miRNAs) emerge in various organisms, ranging from viruses to humans, and play crucial regulatory roles within cells, participating in a variety of biological processes. In numerous prediction methods for miRNA-disease associations, the issue of over-dependence on both similarity measurement data and the association matrix still hasn't been improved. In this paper, a miRNA-Disease association prediction model (called TP-MDA) based on tree path global feature extraction and fully connected artificial neural network (FANN) with multi-head self-attention mechanism is proposed. The TP-MDA model utilizes an association tree structure to represent the data relationships, multi-head self-attention mechanism for extracting feature vectors, and fully connected artificial neural network with 5-fold cross-validation for model training. Results: The experimental results indicate that the TP-MDA model outperforms the other comparative models, AUC is 0.9714. In the case studies of miRNAs associated with colorectal cancer and lung cancer, among the top 15 miRNAs predicted by the model, 12 in colorectal cancer and 15 in lung cancer were validated respectively, the accuracy is as high as 0.9227. Conclusions: The model proposed in this paper can accurately predict the miRNA-disease association, and can serve as a valuable reference for data mining and association prediction in the fields of life sciences, biology, and disease genetics, among others. [ABSTRACT FROM AUTHOR]

Numerous advanced and lightweight signal processing methods have been presented for single-channel speech enhancement (SE). It is imperative to carefully explore how to efficiently combine, integrate, and balance these methods. This paper proposes a more effective and less resource-intensive SE system, focused on the integration and adaptation of several approaches, especially the temporal cepstrum smoothing (TCS). First, a more robust fundamental frequency estimator is employed within TCS, mitigating the performance limitations caused by the inaccuracy of the original estimator. Additionally, a harmonic enhancement mechanism is introduced, effectively recovering the weak harmonic components. By incorporation of the modified TCS in the a posteriori speech presence probability estimation, the unbiased minimum mean square error noise power spectral density estimator can be refined. The modified TCS is also utilized for the a priori signal-to-noise ratio estimation. Moreover, this paper enhances the log-spectral amplitude estimator by applying both super-Gaussian speech priors and speech presence uncertainty for further improvement. Experimental evaluations demonstrate that the proposed method yields an improvement in speech quality while maintaining modest computational and storage requirements. Furthermore, the proposed system exhibits comparable performance to several baseline systems based on lightweight deep neural networks. [ABSTRACT FROM AUTHOR]

This document is a summary of a journal article titled "Artificial Intelligence in Modeling and Simulation." The article discusses the integration of artificial intelligence (AI) into modeling and simulation (M&S) processes. It highlights the various applications of AI in fields such as engineering, physics, social sciences, and biology. The article also provides an overview of 11 selected papers from a special issue on AI and M&S, covering topics such as AI techniques for simulation and optimization, AI in agent-based modeling, AI for data processing and classification models, and artificial neural network (ANN) methods for improved M&S. The papers explore different methodologies and approaches to enhance the efficiency and validity of modeling and simulation using AI. The article concludes by emphasizing the progress and diverse uses of AI in M&S and expressing gratitude to the authors, reviewers, and editorial team involved in the special issue. [Extracted from the article]

Visual information is important in final approach and landing phases for an approaching aircraft, it presents supplementary source for navigation system, and provides backup guidance when radio navigation fails, or even supports a complete vision‐based landing. Relative position and attitude can be solved from the runway features in the image. Traditional runway detection methods have high latency and low accuracy, which is unable to satisfy the requirements for a safe landing. This paper proposes a real‐time runway detection model, efficient runway feature extractor (ERFE), based on deep convolutional neural network, generating semantic segmentation and feature lines output. In order to evaluate the model's effectiveness, a benchmark is proposed to calculate the actual error between predicted feature line and ground truth one. A novel runway dataset which is based on pictures from Microsoft Flight Simulator 2020 (FS2020), is also proposed in this paper to train and test the model. The dataset will be released at https://www.kaggle.com/datasets/relufrank/fs2020‐runway‐dataset. ERFE shows excellent performance in FS2020 dataset, it gives satisfactory results even for real runway images excluded from our dataset. [ABSTRACT FROM AUTHOR]

• A model to explore the multiphysics characteristic of semiconductors is presented. • The model determines the thermal and mechanical properties of complex patterns. • Results show a strong correlation between thermal and mechanical properties. • Dielectric bands asymmetrically affect thermal and mechanical behavior. • Machine learning can predict one property from another. As semiconductor performance improves through advanced package designs, it becomes important to consider both thermal and mechanical properties. Better understanding their relationship enhances system design and optimization. This study has introduced a numerical method that takes into account both thermal and mechanical fluxes to construct thermal and mechanical property maps for practical application in semiconductor engineering. Furthermore, this paper investigated the relationship between the two properties using the constructed property maps in commercially available semiconductor packages. Owing to the complexity of packaging design patterns, a coupled isoparametric mapping and machine learning (ML) method was introduced to investigate their effects. The model then determines and investigates the anisotropic equivalent thermal and mechanical properties of the commercialized semiconductor packages with complex pattern designs, according to the package materials, volume fractions of each material, and design patterns. This approach pursues more sophistication and practicality compared to simplified composite structure property evaluation models. Additionally, all processes in the algorithm are automated based on ML methods, making them practically applicable in the semiconductor industry. The study shows that there is a strong correlation between the thermal and mechanical characteristics in the complex package patterns. This relationship was able to form a fairly clear category based on the shape of the dielectric band because the dielectric band had significantly different effects on the thermal and mechanical fluxes. The study discussed the physical implications of the similarities and differences between the two behaviors and validated the results of the equivalent properties through finite element (FE) analysis. Finally, the study cross-validates the relationship by showing that information from one flux behavior can be used to predict the other based on the ML method. Based on the results, this paper can provide a better understanding of thermal and mechanical fluxes in semiconductor package patterns for package design and optimization. [ABSTRACT FROM AUTHOR]

In order to accurately estimate the period of X-ray pulsars to improve navigation performance, this paper proposes a pulsar period estimation method based on photon energy using reverse Hilbert coding and double Convolutional Neural Networks (CNNs) discrimination. This method uses photon energy information to perform epoch folding. It converts one-dimensional contour information into two-dimensional image signals through reverse Hilbert curve and recognizes contour image features through CNN models to determine the optimal period. According to the simulation results, the period estimation accuracy of this method is 0.5350 ns, which is 65.71% higher than the χ 2 epoch folding method. The contour phase accuracy is 0.0004767, which is 41.93% higher than the χ 2 epoch folding method. At the same time, the observation time and noise interference that may affect the accuracy of period estimation are also quantitatively analyzed. In addition, in order to simulate real navigation scenarios, this paper also conducts dynamic period estimation experiments on PSR B0531+21 pulsar in a specific period of time. The method proposed in this paper has the advantages of high precision, fast calculation speed, strong anti-interference ability and accurate dynamic period estimation, which can significantly improve the navigation performance of X-ray pulsars. • The proposed period estimation method uses photon energy information for contour weighted folding. • The proposed method uses reverse Hilbert curve to convert one-dimensional contour information into two-dimensional image information. • Convolutional Neural Network models are used to optimize pulsar period estimation. [Display omitted] [ABSTRACT FROM AUTHOR]

Convolutional Neural Networks (CNNs) are a kind of artificial neural network designed to extract features and find out patterns for tasks such as segmentation, recognizing objects, and drawing up classification. Within a CNNs architecture, pooling operations are used until the number of parameters and the computational complexity are reduced. Numerous papers have focused on investigating the impact of pooling on the performance of Convolutional Neural Networks (CNNs), leading to the development of various pooling models. Recently, a fuzzy pooling operation based on type-1 fuzzy sets was introduced to cope with the local imprecision of the feature maps. However, in fuzzy set theory, it is not always accurate to assume that the degree of non-membership of an element in a fuzzy set is simply the complement of the degree of membership. This is due to the potential existence of a hesitation degree, which implies a certain level of uncertainty. To overcome this limitation, intuitionistic fuzzy sets (IFS) were introduced to incorporate the concept of a degree of hesitation. In this paper, we introduce a novel pooling operation based on intuitionistic fuzzy sets to incorporate the degree of hesitation heretofore neglected by a fuzzy pooling operation based on classical fuzzy sets, and we investigate its performance in the context of image classification. Intuitionistic pooling is performed in four steps: bifuzzification (by the transformation of data through the use of membership and non-membership maps), first aggregation (through the transformation of the IFS into a standard fuzzy set, second aggregation (through the transformation and use of a sum operator), and the defuzzification of feature map neighborhoods by using a max operator. IFS pooling is used for the construction of an intuitionistic pooling layer that can be applied as a drop-in replacement for the current, fuzzy (type-1) and crisp, pooling layers of CNN architectures. Various experiments involving multiple datasets demonstrate that an IFS-based pooling can enhance the classification performance of a CNN. A benchmarking study reveals that this significantly outperforms even the most recent pooling models, especially in stochastic environments. [ABSTRACT FROM AUTHOR]

This document discusses the degradation and failure mechanisms of dielectric insulation in medium- and high-voltage power equipment. It highlights the importance of controlling insulation material degradation to prevent equipment failures and reduce the risk of environmental pollution. The document includes several research papers that address various topics related to the measurement, monitoring, and improvement of power equipment components. These papers cover issues such as winding breakdown faults in transformers, overvoltages caused by vacuum circuit breaker interruptions, insulation resistance degradation in cables, temperature rise in composite insulators, partial discharges and their effects on insulation, and acoustic inspection for detecting partial discharges. The document also presents studies on the technical condition of on-load tap changers, the behavior of silicone elastomers under electrical and mechanical stress, and the percolation phenomenon in square matrices. [Extracted from the article]

Aiming at the shortcomings of single-sensor sensing information characterization ability, which is easily interfered with by external environmental factors, a method of intelligent perception is proposed in this paper. This method integrates multi-source and multi-level information, including spindle temperature field, spindle thermal deformation, operating parameters, and motor current. Firstly, the internal and external thermal-error-related signals of the spindle system are collected by sensors, and the feature parameters are extracted; then, the radial basis function (RBF) neural network is utilized to realize the preliminary integration of the feature parameters because of the advantages of the RBF neural network, which offers strong multi-dimensional solid nonlinear mapping ability and generalization ability. Thermal-error decision values are then generated by a weighted fusion of different pieces of evidence by considering uncertain information from multiple sources. The spindle thermal-error sensing experiment was based on the spindle system of the VMC850 (Yunnan Machine Tool Group Co., LTD, Yunnan, China) vertical machining center of the Yunnan Machine Tool Factory. Experiments were designed for thermal-error sensing of the spindle under constant speed (2000 r/min and 4000 r/min), standard variable speed, and stepped variable speed conditions. The experiment's results show that the prediction accuracy of the intelligent-sensing model with multi-source information fusion can reach 98.1%, 99.3%, 98.6%, and 98.8% under the above working conditions, respectively. The intelligent-perception model proposed in this paper has higher accuracy and lower residual error than the traditional BP neural network perception and wavelet neural network models. The research in this paper provides a theoretical basis for the operation, maintenance management, and performance optimization of machine tool spindle systems. [ABSTRACT FROM AUTHOR]

This paper addresses issues concerning biometric authentication based on handwritten signatures. Our research aimed to check whether a handwritten signature acquired with a mobile device can effectively verify a user's identity. We present a novel online signature verification method using coordinates of points and pressure values at each point collected with a mobile device. Convolutional neural networks are used for signature verification. In this paper, three neural network models are investigated, i.e., two self-made light SigNet and SigNetExt models and the VGG-16 model commonly used in image processing. The convolutional neural networks aim to determine whether the acquired signature sample matches the class declared by the signer. Thus, the scenario of closed set verification is performed. The effectiveness of our method was tested on signatures acquired with mobile phones. We used the subset of the multimodal database, MobiBits, that was captured using a custom-made application and consists of samples acquired from 53 people of diverse ages. The experimental results on accurate data demonstrate that developed architectures of deep neural networks can be successfully used for online handwritten signature verification. We achieved an equal error rate (EER) of 0.63% for random forgeries and 6.66% for skilled forgeries. [ABSTRACT FROM AUTHOR]

Radio frequency interference (RFI) significantly hampers the target detection performance of frequency-modulated continuous-wave radar. To address the problem and maintain the target echo signal, this paper proposes a priori assumption on the interference component nature in the radar received signal, as well as a method for interference estimation and mitigation via time–frequency analysis. The solution employs Fourier synchrosqueezed transform to implement the radar's beat signal transformation from time domain to time–frequency domain, thus converting the interference mitigation to the task of time–frequency distribution image restoration. The solution proposes the use of image processing based on the dual-tree complex wavelet transform and combines it with the spatial domain-based approach, thereby establishing a dual-domain fusion interference filter for time–frequency distribution images. This paper also presents a convolutional neural network model of structurally improved UNet++, which serves as the interference estimator. The proposed solution demonstrated its capability against various forms of RFI through the simulation experiment and showed a superior interference mitigation performance over other CNN model-based approaches. [ABSTRACT FROM AUTHOR]

Giga-casting, a revolutionary approach for manufacturing large, single-piece car body components from aluminium, has emerged as a potential game-changer in the automotive industry. However, these large, thin-walled castings are prone to distortions during solidification and heat treatment processes. Straightening these distortions is crucial to ensure structural integrity, facilitate downstream assembly, and maintain aesthetic qualities. This paper proposes a novel method for straightening giga-cast components using a multi-pin straightening machine. The machine's versatility stems from its ability to adapt to various geometries through multiple strategically controlled straightening pins. This paper introduces the concept of a "straightening stroke decision algorithm" to achieve precise straightening and overcome the challenges of complex shapes. This algorithm determines the stroke length for each pin, combining a polynomial model representing the global stiffness of the component with a machine learning model that captures the stiffness changes arising from the current geometry. The effectiveness of the proposed approach is evaluated through comprehensive numerical experiments using finite element analyses. The straightening performance is assessed for the straightening algorithm with different machine learning models (deep neural network and XGBoost) and compared to a traditional optimisation method. The proposed surrogate models decided the straightening strokes so that the maximum remaining distortion became 0.02% of the largest dimension of each target geometry. The results of the numerical experiment showed that the proposed straightening method is suitable for straightening distortion in large thin-walled components. [ABSTRACT FROM AUTHOR]

Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out. [ABSTRACT FROM AUTHOR]

Pattern recognition systems always misclassify anomalies, which can be dangerous for uninformed users. Therefore, anomalies must be filtered out from each classification. The main challenge for the anomaly filter design is the huge number of possible anomaly samples compared with the number of samples in the training set. Tailoring the filter for the given classifier is just the first step in this reduction. Paper tests the hypothesis that the filter trained in avoiding "near" anomalies will also refuse the "far" anomalies, and the anomaly detector is then just a classifier distinguishing between "far real" and "near anomaly" samples. As a "far real" samples generator was used, a Generative Adversarial Network (GAN) fake generator that transforms normally distributed random seeds into fakes similar to the training samples. The paper proves the assumption that seeds unused in fake training will generate anomalies. These seeds are distinguished according to their Chebyshev norms. While the fakes have seeds within the hypersphere with a given radius, the near anomalies have seeds within the sphere near cover. Experiments with various anomaly test sets have shown that GAN-based anomaly detectors create a reliable anti-anomaly shield using the abovementioned assumptions. The proposed anomaly detector is tailored to the given classifier, but its limitation is due to the need for the availability of the database on which the classifier was trained. [ABSTRACT FROM AUTHOR]

De-mining operations are of critical importance for humanitarian efforts and safety in conflict-affected regions. In this paper, we address the challenge of enhancing the accuracy and efficiency of mine detection systems. We present an innovative Deep Learning architecture tailored for pulse induction-based Metallic Mine Detectors (MMD), so called DL-MMD. Our methodology leverages deep neural networks to distinguish amongst nine distinct materials with an exceptional validation accuracy of 93.5%. This high level of precision enables us not only to differentiate between anti-personnel mines, without metal plates but also to detect minuscule 0.2-g vertical paper pins in both mineralized soil and non-mineralized environments. Moreover, through comparative analysis, we demonstrate a substantial 3% and 7% improvement (approx.) in accuracy performance compared to the traditional K-Nearest Neighbors and Support Vector Machine classifiers, respectively. The fusion of deep neural networks with the pulse induction-based MMD not only presents a cost-effective solution but also significantly expedites decision-making processes in de-mining operations, ultimately contributing to improved safety and effectiveness in these critical endeavors. [ABSTRACT FROM AUTHOR]

The research on baggage flow plays a pivotal role in achieving the efficient and intelligent allocation and scheduling of airport service resources, as well as serving as a fundamental element in determining the design, development, and process optimization of airport baggage handling systems. This paper examines baggage checked in by departing passengers at airports. The crrent state of the research on baggage flow demand is first reviewed and analyzed. Then, using examples of objective data, it is concluded that while there is a significant correlation between airport passenger flow and baggage flow, an increase in passenger flow does not necessarily result in a proportional increase in baggage flow. According to the existing research results on the influencing factors of baggage flow sorting and classification, the main influencing factors of baggage flow are divided into two categories: macro-influencing factors and micro-influencing factors. When studying the relationship between the economy and baggage flow, it is recommended to use a comprehensive analysis that includes multiple economic indicators, rather than relying solely on GDP. This paper provides a brief overview of prevalent transportation flow prediction methods, categorizing algorithmic models into three groups: based on mathematical and statistical models, intelligent algorithmic-based models, and combined algorithmic models utilizing artificial neural networks. The structures, strengths, and weaknesses of various transportation flow prediction algorithms are analyzed, as well as their application scenarios. The potential advantages of using artificial neural network-based combined prediction models for baggage flow forecasting are explained. It concludes with an outlook on research regarding the demand for baggage flow. This review may provide further research assistance to scholars in airport management and baggage handling system development. [ABSTRACT FROM AUTHOR]

To investigate how the petroleum industry evaluates and selects powerful cloud service providers, first, an evaluation index system including 25 indices such as scalability and private data protection is built. This index system can systematically examine the comprehensive strengths of cloud service providers. Aiming to solve the problems that the traditional expert evaluation method has high requirements on expert experience and is easily affected by subjective factors, a novel artificial intelligence evaluation model named TentISSA-BPNN is proposed. The objective evaluation ability of this model can be effectively used in evaluation research on cloud service providers for petroleum enterprises. In this model, the SSA algorithm is optimized by Tent chaotic mapping and adaptive inertia weight; an algorithm, TentISSA, that has good stability and fast convergence speed is designed and proposed; and the BPNN is improved with TentISSA to obtain more accurate evaluation results. To evaluate the performance of the TentISSA algorithm, nine unimodal and multimodal functions are selected in this paper to test the convergence accuracy. Then, seven models are selected as the control groups to validate the effectiveness and performance of the TentISSA-BPNN evaluation model proposed in this paper. Finally, the preprocessed data of the candidate cloud service providers are input into the trained neural network model proposed in this paper for evaluation. Based on the ranking of the evaluation scores, the comprehensive strengths of the cloud service providers are obtained to provide a decision-making reference for managers of petroleum enterprises in the process of choosing cloud service providers. [ABSTRACT FROM AUTHOR]

With the continuous development and progress of wireless self-organizing network communication technology, how to carry out long-distance cooperative control of multiple intelligences under the framework of an air–ground integrated wireless high-mobility self-organizing network has become a hot and difficult topic that needs to be solved urgently. This paper takes the air–ground integrated wireless high-mobility self-organizing network system as the basic framework and focuses on solving the long-distance cooperative fault-tolerant control of multi-intelligent bodies and the topological stability of a wireless mobile self-organizing network. To solve the above problems, a direct neural network with a robust adaptive fault-tolerant controller is designed in this paper. By constructing a symmetric population neural network model and combining it with the Lyapunov stabilization criterion, the system feedback matrix K has the ability of autonomous adaptive learning, and symmetrically distorts, rotates, or scales the training data to instantly adjust the system's fault-tolerant corrections and adaptive adjusting factors to resist the unknown disturbances and faults, to achieve the goals of multi-intelligent body stable control and the stable operation of a wireless high-mobility self-organizing network topology. Simulation results show that with the feedback adjustment of the multi-system under the designed controller, the multi-system as a whole has good fault-tolerant performance and autonomous learning approximation performance, and the tracking error asymptotically converges to zero. The experimental results show that the multi-flight subsystems fly stably, the air–ground integrated wireless high-mobility self-organizing network topology has good stability performance, and the maximum relative improvement of the topology stability performance is 50%. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) are increasingly important in the medical diagnosis of electrocardiogram (ECG) signals. However, research has shown that DNNs are highly vulnerable to adversarial examples, which can be created by carefully crafted perturbations. This vulnerability can lead to potential medical accidents. This poses new challenges for the application of DNNs in the medical diagnosis of ECG signals. This paper proposes a novel network Channel Activation Suppression with Lipschitz Constraints Net (CASLCNet), which employs the Channel-wise Activation Suppressing (CAS) strategy to dynamically adjust the contribution of different channels to the class prediction and uses the 1-Lipschitz's ℓ∞ distance network as a robust classifier to reduce the impact of adversarial perturbations on the model itself in order to increase the adversarial robustness of the model. The experimental results demonstrate that CASLCNet achieves A C C r o b u s t scores of 91.03% and 83.01% when subjected to PGD attacks on the MIT-BIH and CPSC2018 datasets, respectively, which proves that the proposed method in this paper enhances the model's adversarial robustness while maintaining a high accuracy rate. [ABSTRACT FROM AUTHOR]

This document is an editorial for a special issue titled "Machine Learning in Computer Vision and Image Sensing: Theory and Applications." The editorial highlights the diverse applications of machine learning (ML) models in various domains such as medical imaging, signal processing, remote sensing, and human activity detection. The special issue includes 11 papers that cover topics such as image segmentation, fluvial navigation, Alzheimer's disease classification, pneumothorax detection, lung cancer malignancy prediction, amniotic fluid volume detection, COVID-19 detection, and Parkinson's disease detection. The papers showcase the progress and potential of ML models in computer vision applications and provide valuable insights for future research. [Extracted from the article]

This paper investigates a method for precise mapping of human arm movements using sEMG signals. A multi-channel approach captures the sEMG signals, which, combined with the accurately calculated joint angles from an Inertial Measurement Unit, allows for action recognition and mapping through deep learning algorithms. Firstly, signal acquisition and processing were carried out, which involved acquiring data from various movements (hand gestures, single-degree-of-freedom joint movements, and continuous joint actions) and sensor placement. Then, interference signals were filtered out through filters, and the signals were preprocessed using normalization and moving averages to obtain sEMG signals with obvious features. Additionally, this paper constructs a hybrid network model, combining Convolutional Neural Networks and Artificial Neural Networks, and employs a multi-feature fusion algorithm to enhance the accuracy of gesture recognition. Furthermore, a nonlinear fitting between sEMG signals and joint angles was established based on a backpropagation neural network, incorporating momentum term and adaptive learning rate adjustments. Finally, based on the gesture recognition and joint angle prediction model, prosthetic arm control experiments were conducted, achieving highly accurate arm movement prediction and execution. This paper not only validates the potential application of sEMG signals in the precise control of robotic arms but also lays a solid foundation for the development of more intuitive and responsive prostheses and assistive devices. [ABSTRACT FROM AUTHOR]

Sensitivity analysis of influencing factors on frost resistance is carried out in this paper, and a two-stage neural network model based on grey theory and Back Propagation Neural Networks (BPNNs) is established for the sake of predicting the frost resistance of active-admixture recycled concrete quickly and accurately. Firstly, the influence degree of cement, water, sand, natural aggregate, recycled aggregate, mineral powder, fly ash, fiber and air-entraining agent on the frost resistance of active-admixture recycled-aggregate concrete was analyzed based on the grey system theory, and the primary and secondary relationships of various factors were effectively distinguished. Then, the input layer of the model was determined as cement, water, sand, recycled aggregate and air-entraining agent, and the output layer was the relative dynamic elastic modulus. A total of 120 datasets were collected from the experimental data of another author, and the relative dynamic elastic modulus was predicted using the two-stage BPNN prediction model proposed in this paper and compared with the BPNN prediction results. The results show that the proposed two-stage BPNN model, after removing less-sensitive parameters from the input layer, has better prediction accuracy and shorter run time than the BPNN model. [ABSTRACT FROM AUTHOR]

This document is a summary of a special issue on advanced machine learning and deep learning techniques for remote sensing. The issue includes 16 research papers that cover a range of topics, including hyperspectral image classification, moving point target detection, radar echo extrapolation, and remote sensing object detection. Each paper introduces a novel approach or model and provides extensive testing and evaluation to demonstrate its effectiveness. The insights shared in this special issue are expected to contribute to future advancements in artificial intelligence-based remote sensing research. [Extracted from the article]

With the development of smart grids and new power systems, the combination of non-intrusive load identification technology and smart home technology can provide users with the operating conditions of home appliances and equipment, thus reducing home energy loss and improving users' ability to demand a response. This paper proposes a non-intrusive load decomposition model with a parallel multiscale attention mechanism (PMAM). The model can extract both local and global feature information and fuse it through a parallel multiscale network. This improves the attention mechanism's ability to capture feature information over long time periods. To validate the model's decomposition ability, we combined the PMAM model with four benchmark models: the Long Short-Term Memory (LSTM) recurrent neural network model, the Time Pooling-based Load Disaggregation Model (TPNILM), the Extreme Learning Machine (ELM), and the Load Disaggregation Model without Parallel Multi-scalar Attention Mechanisms (UNPMAM). The model was trained on the publicly available UK-DALE dataset and tested. The models' test results were quantitatively evaluated using a confusion matrix. This involved calculating the F1 score of the load decomposition. A higher F1 score indicates better model decomposition performance. The results indicate that the PMAM model proposed in this paper maintains an F1 score above 0.9 for the decomposition of three types of electrical equipment under the same household user, which is 3% higher than that of the other benchmark models on average. In the cross-household test, the PMAM also demonstrated a better decomposition ability, with the F1 score maintained above 0.85, and the mean absolute error (MAE) decreased by 5.3% on average compared with that of the UNPMAM. [ABSTRACT FROM AUTHOR]

This document is an editorial that summarizes several research papers on the topic of human recognition and the interactions between different channels of recognition, such as voice and face processing. The papers explore various aspects of this topic, including voice processing in challenging listening conditions, the role of familiarity in voice and face recognition, and the functional reorganization of neural systems in blind individuals. The papers highlight the importance of familiarity factors in recognition, the role of brain asymmetries, and the early integration of voice and face processing. The findings suggest that voice and face recognition are closely linked and influenced by familiarity, and that the right temporal lobe may play a significant role in vocal processing abilities in blind individuals. [Extracted from the article]

Power line inspection is an important means to eliminate hidden dangers of power lines. It is a difficult research problem how to solve the low accuracy of power line inspection based on deep neural network (DNN) due to the problems of multi‐view‐shape, small‐size object. In this paper, an automatic detection model based on Feature visual clustering network (FVCNet) for power line inspection is established. First, an unsupervised clustering method for power line inspection is proposed, and applied to construct a detection model which can recognize multi‐view‐shape objects and enhanced object features. Then, the bilinear interpolation method is used to Feature enhancement method, and the enhanced high‐level semantics and low‐level semantics are fused to solve the problems of small object size and single sample. In this paper, FVCNet is applied to the MS‐COCO 2017 data set and self‐made power line inspection data set, and the test accuracy is increased to 61.2% and 82.0%, respectively. Compared with other models, especially for the categories that are greatly affected by multi‐view‐shape, the test accuracy has been improved significantly. [ABSTRACT FROM AUTHOR]

This document is a reference list for a research paper on fracture mechanics and structural integrity. The paper explores the effect of element size on fracture propagation stress using energy criteria. The research was funded by the Ministry of Higher Education Malaysia. The document also includes a Python code for an artificial neural network algorithm used in the research. The reference list contains other research papers on fracture mechanics, machine learning, and structural integrity. [Extracted from the article]

Recent research has revealed that subtle imperceptible perturbations can deceive well-trained neural network models, leading to inaccurate outcomes. These instances, known as adversarial examples, pose significant threats to the secure application of machine learning techniques in safety-critical systems. In this paper, we delve into the study of one-pixel attacks in deep neural networks, recently reported as a kind of adversarial examples. To identify such one-pixel attacks, most existing methodologies rely on the differential evolution method, which utilizes random selection from the current population to escape local optima. However, the differential evolution technique might waste search time and overlook good solutions if the number of iterations is insufficient. Hence, in this paper, we propose a gradient ascent with momentum approach to efficiently discover good solutions for the one-pixel attack problem. As our method takes a more direct route to the goal compared to existing methods relying on blind random walks, it can effectively identify one-pixel attacks. Our experiments conducted on popular CNNs demonstrate that, in comparison with existing methodologies, our technique can detect one-pixel attacks significantly faster. [ABSTRACT FROM AUTHOR]

This correction notice provides updates and corrections to a research paper on deep machine learning model-based cyber-attacks detection in smart power systems. The paper proposes a deep learning-based attack detection model that addresses system disturbances caused by natural events and cyber-attacks. It discusses the use of principal component analysis (PCA) for feature selection and the potential of deep learning-based and decision tree classifiers for detecting cyber-attacks in intelligent energy grids. The notice also includes updates to references, clarifications on the experimental data set, and feature selection based on PCA. The study evaluates the effectiveness of the proposed model using various assessment indexes and compares it to conventional methods, concluding that the proposed model is effective in detecting cyber-attacks and demonstrates good performance in detecting destructive attacks. [Extracted from the article]

Electricity consumption in buildings is one of the major causes of energy usage and knowledge of this can help building owners and users increase energy efficiency and conservation efforts. For Pacific Island countries, building electricity demand data is not readily accessible or available for constructing models to predict electricity demand. This paper starts to fill this gap by studying the case of schools in Fiji. The aim of the paper is to assess the factors affecting electricity demand for grid-connected Fijian schools and use this assessment to build mathematical models (multiple linear regression (MLR) and artificial neural network (ANN)) to predict electricity consumption. The average grid-connected electricity demand in kWh/year was 1411 for early childhood education schools, 5403 for primary schools, and 23,895 for secondary schools. For predicting electricity demand (ED) for all grid-connected schools, the stepwise MLR model shows that taking logarithm transformations on both the dependent variable and independent variables (number of students, lights, and air conditioning systems) yields statistically significant independent variables with an R2 value of 73.3% and RMSE of 0.2248. To improve the predicting performance, ANN models were constructed on both the natural form of variables and transformed variables. The optimum ANN model had an R2 value of 95.3% and an RMSE of 59.4 kWh/year. The findings of this study can assist schools in putting measures in place to reduce their electricity demand, associated costs, and carbon footprint, as well as help government ministries make better-informed policies. [ABSTRACT FROM AUTHOR]

The digitization of distribution power systems has revolutionized the way data are collected and analyzed. In this paper, the critical task of harnessing this information to identify irregularities and anomalies in electricity consumption is tackled. The focus is on detecting non-technical losses (NTLs) and energy theft within distribution networks. A comprehensive overview of the methodologies employed to uncover NTLs and energy theft is presented, leveraging measurements of electricity consumption. The most common scenarios and prevalent cases of anomalies and theft among consumers are identified. Additionally, statistical indicators tailored to specific anomalies are proposed. In this research paper, the practical implementation of numerous artificial intelligence (AI) algorithms, including the artificial neural network (ANN), ANFIS, autoencoder neural network, and K-mean clustering, is highlighted. These algorithms play a central role in our research, and our primary objective is to showcase their effectiveness in identifying NTLs. Real-world data sourced directly from distribution networks are utilized. Additionally, we carefully assess how well statistical methods work and compare them to AI techniques by testing them with real data. The artificial neural network (ANN) accurately identifies various consumer types, exhibiting a frequency error of 7.62%. In contrast, the K-means algorithm shows a slightly higher frequency error of 9.26%, while the adaptive neuro-fuzzy inference system (ANFIS) fails to detect the initial anomaly type, resulting in a frequency error of 11.11%. Our research suggests that AI can make finding irregularities in electricity consumption even more effective. This approach, especially when using data from smart meters, can help us discover problems and safeguard distribution networks. [ABSTRACT FROM AUTHOR]

This paper presents a novel sound event detection (SED) system for rare events occurring in an open environment. Wavelet multiresolution analysis (MRA) is used to decompose the input audio clip of 30 seconds into five levels. Wavelet denoising is then applied on the third and fifth levels of MRA to filter out the background. Significant transitions, which may represent the onset of a rare event, are then estimated in these two levels by combining the peak-finding algorithm with the K-medoids clustering algorithm. The small portions of one-second duration, called 'chunks' are cropped from the input audio signal corresponding to the estimated locations of the significant transitions. Features from these chunks are extracted by the wavelet scattering network (WSN) and are given as input to a support vector machine (SVM) classifier, which classifies them. The proposed SED framework produces an error rate comparable to the SED systems based on convolutional neural network (CNN) architecture. Also, the proposed algorithm is computationally efficient and lightweight as compared to deep learning models, as it has no learnable parameter. It requires only a single epoch of training, which is 5, 10, 200, and 600 times lesser than the models based on CNNs and deep neural networks (DNNs), CNN with long short-term memory (LSTM) network, convolutional recurrent neural network (CRNN), and CNN respectively. The proposed model neither requires concatenation with previous frames for anomaly detection nor any additional training data creation needed for other comparative deep learning models. It needs to check almost 360 times fewer chunks for the presence of rare events than the other baseline systems used for comparison in this paper. All these characteristics make the proposed system suitable for real-time applications on resource-limited devices. [ABSTRACT FROM AUTHOR]

In this paper, we discuss the implementation of artificial self-awareness mechanisms and self-reflection abilities in deep neural networks. While the current limitations of research prevent achieving cognitive capabilities on par with natural biological entities, the incorporation of basic self-awareness and self-reflection mechanisms in deep learning architectures offers substantial advantages in tackling specific problems across various scientific fields, including geosciences. In the first section, we outline the foundational architecture of our deep learning approach termed Self-Aware Learning (SAL). The subsequent part of the paper highlights the practical benefits of this machine learning methodology through synthetic tests and applications addressed to automatic classification and image analysis of real petrological data sets. We show how Self-Aware Learning allows enhanced accuracy, reduced overfitting problems, and improved performances compared to other existing methods. [ABSTRACT FROM AUTHOR]

This paper is about the opposite of judgement and calculation. This opposition has been a traditional anchor of critiques concerned with the rise of AI decision making over human judgement. Contrary to these approaches, it is argued that human judgement is not and cannot be replaced by calculation, but that it is human judgement that contextualises computational structures and gives them meaning and purpose. The article focuses on the epistemic structure of algorithms and artificial neural networks to find that they always depend on human judgement to be related to real life objects or purposes. By introducing the philosophical concept of judgement, it becomes clear that the property of judgement to provide meaning and purposiveness is based on the temporality of human life and the ambiguity of language, which quantitative processes lack. A juxtaposition shows that calculations and clustering can be used and referred to in more or less prejudiced and reflecting as well as opaque and transparent ways, but thereby always depend on human judgement. The paper clearly asserts that the transparency of AI is necessary for their autonomous use. This transparency requires the explicitness of the judgements that constitute these computational structures, thereby creating an awareness of the conditionality of such epistemic entities. [ABSTRACT FROM AUTHOR]

The use of explosives to target civilian buildings and other structures around the world is becoming a growing problem in modern societies. This paper focuses on RC beams exposed to free air blast loads. The paper first presents a parametric study on the behavior of RC beams subjected to blast loads using finite element simulation and then proposes an Artificial Neural Network (ANN) model to predict that behavior in a simple and easy manner. The ABAQUS program is used to simulate RC beams under blast loads. Experimental data was collected from the literature and used to validate the ABAQUS models. Deflection, reaction forces, ultimate stress, ultimate strain, and failure mode of RC beams are investigated. The considered design parameters in the parametric study are the characteristic compressive strength of concrete (fcu), the transverse reinforcement ratio (ρT%), the longitudinal reinforcement ratio (ρL%), and the scaled distance (Z). In this paper, the proposed ANN model was trained and tested using datasets produced using ABAQUS. The input parameters of the ANN model are TNT weight, standoff distance (D), characteristic compressive strength of concrete, transverse reinforcement ratio, longitudinal reinforcement ratio, width-to-thickness ratio (b/t), and length-to-thickness ratio (L/t). The predicted behavior using the ANN model showed the credibility of the model. The results indicated that L/t, b/t, and Z have significant effects on the behavior of RC beams under blast loads compared with fcu, ρT%, and ρL%, the cracks area increases with the decrease in Z, fcu, and b/t and decreases with L/t decrease. [ABSTRACT FROM AUTHOR]

Over the last few years, a plethora of papers presenting machine-learning-based approaches for intrusion detection have been published. However, the majority of those papers do not compare their results with a proper baseline of a signature-based intrusion detection system, thus violating good machine learning practices. In order to evaluate the pros and cons of the machine-learning-based approach, we replicated a research study that uses a deep neural network model for intrusion detection. The results of our replicated research study expose several systematic problems with the used datasets and evaluation methods. In our experiments, a signature-based intrusion detection system with a minimal setup was able to outperform the tested model even under small traffic changes. Testing the replicated neural network on a new dataset recorded in the same environment with the same attacks using the same tools showed that the accuracy of the neural network dropped to 54%. Furthermore, the often-claimed advantage of being able to detect zero-day attacks could not be seen in our experiments. [ABSTRACT FROM AUTHOR]

Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person's emotional state in an image or a video. This process, called "Facial Expression Recognition (FER)", has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed. [ABSTRACT FROM AUTHOR]

Simple Summary: This paper presents a novel approach to produce virtual contrast enhanced (VCE) images for nasopharyngeal cancer (NPC) without the use of contrast agents, which carry certain risks. This model uses pixelwise gradient term to capture the shape and a GAN terms to capture the texture of the real contrast enhanced T1C images With similar accuracy to existing models, our method shows an advantage in reproducing texture closer to the realistic contrast-enhanced images. This results are tested by various measures, including mean absolute error (MAE), mean square error (MSE) and structural similarity index (SSIM) for similarity accuracy; total mean square variation per mean intensity (TMSVPMI), the total absolute vari-ation per mean intensity (TAVPMI), Tenengrad function per mean intensity (TFPMI) and variance function per mean intensity (VFPMI) Various variations of the model, including fine-tuning of the hyperparameters, normalization methods on the images and using single modality, have also been investigated to test the optimal performance. Background: The development of advanced computational models for medical imaging is crucial for improving diagnostic accuracy in healthcare. This paper introduces a novel approach for virtual contrast enhancement (VCE) in magnetic resonance imaging (MRI), particularly focusing on nasopharyngeal cancer (NPC). Methods: The proposed model, Pixelwise Gradient Model with GAN for Virtual Contrast Enhancement (PGMGVCE), makes use of pixelwise gradient methods with Generative Adversarial Networks (GANs) to enhance T1-weighted (T1-w) and T2-weighted (T2-w) MRI images. This approach combines the benefits of both modalities to simulate the effects of gadolinium-based contrast agents, thereby reducing associated risks. Various modifications of PGMGVCE, including changing hyperparameters, using normalization methods (z-score, Sigmoid and Tanh) and training the model with T1-w or T2-w images only, were tested to optimize the model's performance. Results: PGMGVCE demonstrated a similar accuracy to the existing model in terms of mean absolute error (MAE) (8.56 ± 0.45 for Li's model; 8.72 ± 0.48 for PGMGVCE), mean square error (MSE) (12.43 ± 0.67 for Li's model; 12.81 ± 0.73 for PGMGVCE) and structural similarity index (SSIM) (0.71 ± 0.08 for Li's model; 0.73 ± 0.12 for PGMGVCE). However, it showed improvements in texture representation, as indicated by total mean square variation per mean intensity (TMSVPMI) (0.124 ± 0.022 for ground truth; 0.079 ± 0.024 for Li's model; 0.120 ± 0.027 for PGMGVCE), total absolute variation per mean intensity (TAVPMI) (0.159 ± 0.031 for ground truth; 0.100 ± 0.032 for Li's model; 0.153 ± 0.029 for PGMGVCE), Tenengrad function per mean intensity (TFPMI) (1.222 ± 0.241 for ground truth; 0.981 ± 0.213 for Li's model; 1.194 ± 0.223 for PGMGVCE) and variance function per mean intensity (VFPMI) (0.0811 ± 0.005 for ground truth; 0.0667   ± 0.006 for Li's model; 0.0761   ± 0.006 for PGMGVCE). Conclusions: PGMGVCE presents an innovative and safe approach to VCE in MRI, demonstrating the power of deep learning in enhancing medical imaging. This model paves the way for more accurate and risk-free diagnostic tools in medical imaging. [ABSTRACT FROM AUTHOR]

This paper presents a model for determining the availability of continuous systems at open pits using the neuro-fuzzy system. The concept of availability is divided into partial indicators (synthetic indicators and sub-indicators). The presented model in relation to already existing models for determining availability uses a combination of the advantages of artificial neural networks and fuzzy logic. The case study addressed the I ECC (bucket wheel excavator–conveyors–crushing plant) system of the open pit Drmno, Kostolac. In this paper, in addition to the ANFIS model for determining the availability of continuous systems, a simulation model was developed. The obtained results of the ANFIS model were verified with the help of a simulation model that uses certain assumptions about the distribution of failures. This paper was created as a result of several years of field and theoretical research into the availability of continuous systems in open pits, and completes a cycle that consists of several published articles on the subject of modeling the behavior of these systems in real time using a time picture of the state, expert assessment, simulation and AI models, while respecting the multidisciplinarity of the problem (mining technological, mechanical, and information technological aspects). The developed ANFIS model is a key instrument for improving operational efficiency and resource management in the mining sector. Its ability to accurately predict the availability of the ECC system brings not only operational benefits through reduced downtime and optimized maintenance, but also a potential reduction in overall costs at coal open pits. Such an innovative model marks a significant step forward in the mining industry, especially when it comes to continuous systems in coal open pits. [ABSTRACT FROM AUTHOR]

Accurate prediction of sea level height is critically important for the government in assessing sea level risk in coastal areas. However, due to the nonlinear, time-varying and highly uncertain characteristics of sea level change data, sea level prediction is challenging. To improve the accuracy of sea level prediction, this paper uses a new swarm intelligence algorithm named the sparrow search algorithm (SSA), which can imitate the foraging behavior and antipredation behavior of sparrows, to determine optimal solutions. To avoid the algorithm falling into a local optimal situation, this paper integrates the sine–cosine algorithm and the Cauchy variation strategy into the SSA to obtain an algorithm named the SCSSA. The SCSSA is used to optimize the parameter values of the CNN-BiLSTM (convolutional neural network combined with bidirectional long short-term memory neural network) model; finally, a combined neural network model (named SCSSA-CNN-BiLSTM) is proposed. In this paper, the time series data of seven tidal stations located in coastal China are used for experimental analysis. First, the SCSSA-CNN-BiLSTM model is compared with the CNN-BiLSTM model to predict the time series data of SHANWEI Station. With respect to the training and test sets of data, the SCSSA-CNN-BiLSTM model outperforms the other models on all the evaluation metrics. In addition, the remaining six tide station datasets and five neural network models, including the SCSSA-CNN-BiLSTM model, are used to further study the performance of the proposed prediction model. Four evaluation indices including the root mean squared error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE) and coefficient of determination (R2) are adopted. For six stations, the RMSE, MAE, MAPE and R2 of SCSSA-CNN-BiLSTM model are ranged from 20.9217 ~ 27.8427 mm, 9.4770 ~ 17.8603 mm, 0.1322% ~ 0.2482% and 0.9119 ~ 0.9759, respectively. The experimental analysis results show that the SCSSA-CNN-BiLSTM model makes effective predictions at all stations, and the prediction performance is better than that of the other models. Even though the combination of SCSSA algorithm may increase the complexity of the model, indeed the proposed model is a new prediction method with good accuracy and robustness for predicting sea level change. [ABSTRACT FROM AUTHOR]

The paramount concern of highly accurate energy-efficient computing in machines with significant cognitive capabilities aims to enhance the accuracy and efficiency of bio-inspired Spiking Neural Networks (SNNs). This paper addresses this main objective by introducing a novel spatial power spike-timing-dependent plasticity (Spatial-Pow-STDP) learning rule as a digital block with high accuracy in a bio-inspired SNN model. Motivated by the demand for precise and accelerated computation that reduces high-cost resources in neural network applications, this paper presents a methodology based on COordinate Rotation DIgital Computer (CORDIC) definitions. The proposed designs of CORDIC algorithms for exponential (Exp CORDIC), natural logarithm (Ln CORDIC), and arbitrary power function (Pow CORDIC) are meticulously detailed and evaluated to ensure optimal acceleration and accuracy, which respectively show average errors near 10–9, 10–6, and 10–5 with 4, 4, and 6 iterations. The engineered architectures for the Exp, Ln, and Pow CORDIC implementations are illustrated and assessed, showcasing the efficiency achieved through high frequency, leading to the introduction of a Spatial-Pow-STDP learning block design based on Pow CORDIC that facilitates efficient and accurate hardware computation with 6.93 × 10–3 average error with 9 iterations. The proposed learning mechanism integrates this structure into a large-scale spatiotemporal SNN consisting of three layers with reduced hyper-parameters, enabling unsupervised training in an event-based paradigm using excitatory and inhibitory synapses. As a result, the application of the developed methodology and equations in the computational SNN model for image classification reveals superior accuracy and convergence speed compared to existing spiking networks by achieving up to 97.5%, 97.6%, 93.4%, and 93% accuracy, respectively, when trained on the MNIST, EMNIST digits, EMNIST letters, and CIFAR10 datasets with 6, 2, 2, and 6 training epochs. [ABSTRACT FROM AUTHOR]

Autonomous spacecraft relative navigation via monocular images became a hot topic in the past few years and, recently, received a further push thanks to the constantly growing field of artificial neural networks and the publication of several spaceborne image datasets. Despite the proliferation of spacecraft relative-state initialization algorithms developed, most architectures adopt computationally expensive solutions relying on convolutional neural networks (CNNs) that provide accurate output at the cost of a high computational burden that seems unfeasible for current spaceborne hardware. The paper addresses this issue by proposing a novel pose initialization algorithm based on lightweight CNNs. Inspired by previous state-of-the-art algorithms, the developed architecture leverages a fast and accurate target detection CNN followed by a line segment detection CNN capable of running with low inference time on mobile devices. The line segments and their junctions are grouped into complex geometrical groups, reducing the solution search space, and subsequently, they are adopted to extract the final pose estimate. As a main outcome, the analyses demonstrate that the lightweight architecture developed scores high accuracy in the pose estimation task, with a mean estimation error of less than 10 cm in translation and 2.5°in rotation. The baseline algorithm scores a mean SLAB error of 0.04552 with a standard deviation of 0.22972 in the test dataset. Detailed analyses demonstrate that the uncertainties on the overall pose score are driven mainly by errors in the relative attitude, which gives the highest contribution to the pose error metric adopted. The analyses on the error distributions point out that the uncertainties on the estimated relative position are higher in the camera boresight axis direction. Concerning the relative attitude, the algorithm proposed has higher uncertainties in estimating directions of the target x and y axes due to ambiguities related to the target geometry. Notably, the target detection CNN trained in this work outperforms the previous top scores in the benchmark dataset. The performances of the proposed algorithm have been investigated further by analyzing the effects on the accuracy due to the relative distance and the presence of background in the images. Lastly, the paper delves into the possibility of adopting a sub-portion of the 2D-to-3D match matrix made by the most complex perceptual groups identified that positively affects the overall run-time, pointing out the performances in terms of accuracy of the estimates and providing a comparison of both the baseline and the reduced match matrix versions against state-of-the-art algorithms concerning relative position and attitude errors and solution availability, highlighting the high accuracy and solution availability of the proposed architectures. • New relative pose initialization algorithm based on the detection of line segments. • Detailed literature review and description of available spaceborne image datasets. • Improvement of state of the art in spacecraft detection using lightweight CNN. • Assessment of accuracy of the proposed architecture and error sources analyses. • Proven feasibility of the approach via comparison with other architectures. [ABSTRACT FROM AUTHOR]