Search

Purpose: Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms' nutrient source. Mold not only can damage papers' structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods: Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion: In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation. [ABSTRACT FROM AUTHOR]

In an era overwhelmed by academic big data, students grapple with identifying academic papers that resonate with their learning objectives and research interests, due to the sheer volume and complexity of available information. This study addresses the challenge by proposing a novel academic paper recommendation system designed to enhance personalized learning through the nuanced understanding of academic social networks. Utilizing the theory of social homogeneity, the research first constructs a sophisticated academic social network, capturing high-order social relationships, such as co-authorship and advisor–advisee connections, through hypergraph modeling and advanced network representation learning techniques. The methodology encompasses the development and integration of a hypergraph convolutional neural network and a contrastive learning framework to accurately model and recommend academic papers, focusing on aligning with students' unique preferences and reducing reliance on sparse interaction data. The findings, validated across multiple real-world datasets, demonstrate a significant improvement in recommendation accuracy, particularly in addressing the cold-start problem and effectively mapping advisor–advisee relationships. The study concludes that leveraging complex academic social networks can substantially enhance the personalization and precision of academic paper recommendations, offering a promising avenue for addressing the challenges of academic information overload and fostering more effective personalized learning environments. [ABSTRACT FROM AUTHOR]

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

Herein, the challenge of accurately classifying the manufacturing origin of printing paper, including continent, country, and specific product, was addressed. One-dimensional convolutional neural network (1D CNN) models trained on infrared (IR) spectrum data acquired from printing paper samples were used for the task. The preprocessing of the IR spectra through a second-derivative transformation and the restriction of the spectral range to 1800 to 1200 cm-1 improved the classification performance of the model. The outcomes were highly promising. Models trained on second-derivative IR spectra in the 1800 to 1200-cm-1 range exhibited perfect classification for the manufacturing continent and country, with an impressive F1 score of 0.980 for product classification. Notably, the developed 1D CNN model outperformed traditional machine learning classifiers, such as support vector machines and feed-forward neural networks. In addition, the application of data point attribution enhanced the transparency of the decision-making process of the model, offering insights into the spectral patterns that affect classification. This study makes a considerable contribution to printing paper classification, with potential implications for accurate origin identification in various fields. [ABSTRACT FROM AUTHOR]

Document forgery is a significant issue in Korea, with around ten thousand cases reported every year. Analyzing paper plays a crucial role in examining questionable documents such as marketable securities and contracts, which can aid in solving criminal cases of document forgery. Paper analysis can also provide essential insights in other types of criminal cases, serving as an important clue for solving cases such as the source of a blackmail letter. The papermaking process generates distinct forming fabric marks and formations, which are critical features for paper classification. These characteristics are observable under transmitted light and are created by the forming fabric pattern and the distribution of pulp fibers, respectively. In this study, we propose a novel approach for paper identification based on hybrid features. This method combines texture features extracted from images converted using the gray‐level co‐occurrence matrix (GLCM) approach and a convolutional neural network (CNN), with another set of features extracted by the CNN using the same images as input. We applied the proposed method to classification tasks for seven major paper brands available in the Korean market, achieving an accuracy of 97.66%. The results confirm the applicability of this method for visually inspecting paper products and demonstrate its potential for assisting in solving criminal cases involving document forgery. [ABSTRACT FROM AUTHOR]

The use of Artificial Intelligence (AI) to preserve and promote cultural heritage has experienced significant growth in recent years. Among the various areas of cultural heritage, numismatics have emerged as a particularly promising field where we can develop AI solutions. Numismatics refers to the study of coins, tokens, paper money, and medals, which play a critical role in understanding human history and culture. However, there are still limited resources available to help researchers and collectors in the identification of coins. This is due to the vast number of coins in circulation, which presents a significant challenge in developing smart tools for classification tasks. This paper aims to provide a contribution to this setting. In particular, we start by creating a new dataset called EURO-Coin, which consists of images showing the side of coins with reliefs and is designed to facilitate the training and testing of AI models for euro coin classification. Then, we propose two approaches that leverage Convolutional Neural Networks and self-attention layers to classify the country and value of the coins. In our experiments, we obtain an accuracy of 86.9% for country classification and an accuracy of 96.4% for value classification. Finally, we conduct an ablation study to evaluate the impact of the preprocessing activities and attention layers in our approaches. [ABSTRACT FROM AUTHOR]

Medical imaging refers to the process of obtaining images of internal organs for therapeutic purposes such as discovering or studying diseases. The primary objective of medical image analysis is to improve the efficacy of clinical research and treatment options. Deep learning has revamped medical image analysis, yielding excellent results in image processing tasks such as registration, segmentation, feature extraction, and classification. The prime motivations for this are the availability of computational resources and the resurgence of deep convolutional neural networks. Deep learning techniques are good at observing hidden patterns in images and supporting clinicians in achieving diagnostic perfection. It has proven to be the most effective method for organ segmentation, cancer detection, disease categorization, and computer-assisted diagnosis. Many deep learning approaches have been published to analyze medical images for various diagnostic purposes. In this paper, we review the work exploiting current state-of-the-art deep learning approaches in medical image processing. We begin the survey by providing a synopsis of research works in medical imaging based on convolutional neural networks. Second, we discuss popular pretrained models and general adversarial networks that aid in improving convolutional networks' performance. Finally, to ease direct evaluation, we compile the performance metrics of deep learning models focusing on COVID-19 detection and child bone age prediction. [ABSTRACT FROM AUTHOR]

In the final manuscript [[33]], presented as a communication, the author indicates that unmanned aircraft systems (UASs), commonly referred to as drones, are an emerging technology that has changed the way that many industries conduct business. When used on a state-by-state basis, the normalized UAS adoption index shows that there are regional differences in UAS adoption, with western and eastern states having higher UAS adoption rates and central states having significantly lower UAS adoption rates. The aim of this second I Eng i Special Issue is to collect experimental and theoretical re-search relating to engineering science and technology. Telecommunication companies collect a deluge of subscriber data without retrieving substantial information. [Extracted from the article]

Since deep low‐frequency tremors are considered to be associated with large earthquakes that occur adjacently on the same subducting plate interface, it is important to investigate tremors that occurred before the establishment of modern seismograph networks such as the High Sensitivity Seismograph Network (Hi‐net). We propose a deep‐learning solution to detect evidence of tremors in scanned images of paper seismogram records from over 50 years ago. In this study, we fine‐tuned a convolutional neural network (CNN) based on the Residual Network, which was pre‐trained using images of synthetic waveforms from our previous study, using a data set comprised of images generated from real seismic data recorded digitally by Hi‐net to facilitate a supervised analysis. The fine‐tuned CNN was able to predict the presence or absence of tremors in the Hi‐net images with an accuracy of 98.64%. Gradient‐weighted Class Activation Mapping heatmaps created to visualize model predictions indicated that the CNN's ability to detect tremors is not degraded by the presence of teleseisms. Once validated using the Hi‐net images, the CNN was applied to paper seismograms recorded from 1966 to 1977 at the Kumano observatory in southwest Japan, operated by Earthquake Research Institute, The University of Tokyo. The CNN showed potential for detecting tremors in scanned images of paper seismogram records from the past, facilitating downstream tasks such as the creation of new tremor catalogs. However, further training using an augmented data set to control for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Plain Language Summary: In 2002, deep low‐frequency tremors, which periodically occur with much smaller amplitudes and longer durations than common earthquakes, were discovered owing to the establishment of dense seismic arrays in Japan. These tremors are considered to be associated with megathrust earthquakes because they occur in deeper regions of plate boundaries compared with common earthquakes. Investigating tremors that occurred before the establishment of dense seismic arrays is important since megathrust earthquakes recur on intervals of 100–200 years, and digital records from modern seismic arrays cover only a fraction of that time. In this study, we developed a convolutional neural network based on the Residual Network (ResNet) that extracts tremors from images of waveforms recorded more than 50 years ago, when seismometers drew waveforms directly on drum‐rolled paper using a pen. The proposed ResNet, which was trained on seismogram images generated from synthetic waveforms and real data recorded digitally by modern seismic arrays, was applied to scanned images of paper seismograms recorded from 1966 to 1977 at an observatory in southwest Japan. A list of tremors was successfully obtained; however, further training using data that accounts for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Key Points: Convolutional neural network model for detection of deep low‐frequency tremors from seismogram images is proposedThe model trained with seismogram images converted from real seismic data successfully detects tremorsThe detection performances of the trained model for the paper records at the Kumano observatory in southwest Japan are discussed [ABSTRACT FROM AUTHOR]

In view of the problems of data sparsity and the diversity in academic paper recom-mender systems,based on CONVNCF, this paper proposed an algorithm of convolution with word and heterogeneous information network for academic paper recommendation ( WN -APR) . Firstly, WN -APR algorithm learned user and paper' s diverse features from different semantics to alleviate the sparsity problem. Then it designed an outer product fusing way to seamlessly combine user features with paper features. Replacing of 2D CNN, this algorithm applied 3 D convolution to mine the influence of different features on the performance. Finally, it modified the BPR loss function to enhance diversity in recommendations. Experimental results on CiteULike-a and CiteULike-t datasets show that WN-APR improves the performance of accuracy and diversity over the baseline models. [ABSTRACT FROM AUTHOR]

One of the pandemics that have caused many deaths is the Coronavirus disease 2019 (COVID-19). It first appeared in late 2019, and many deaths are increasing day by day until now. Therefore, the early diagnosis of COVID-19 has become a salient issue. Additionally, the current diagnosis methods have several demerits, and a new investigation is required to enhance the diagnosis performance. In this paper, a set of phases are performed, such as collecting data, filtering and augmenting images, extracting features, and classifying ECG images. The data were obtained from two publicly available ECG image datasets, and one of them contained COVID ECG reports. A set of preprocessing methods are applied to the ECG images, and data augmentation is performed to balance the ECG images based on the classes. A deep learning approach based on a convolutional neural network (CNN) is performed for feature extraction. Four different pre-trained models are applied, such as Vgg16, Vgg19, ResNet-101, and Xception. Moreover, an ensemble of Xception and the temporary convolutional network (TCN), which is named ECGConvnet, is proposed. Finally, the results obtained from the former models are fed to four main classifiers. These classifiers are softmax, random forest (RF), multilayer perception (MLP), and support vector machine (SVM). The former classifiers are used to evaluate the diagnosis ability of the proposed methods. The classification scenario is based on fivefold cross-validation. Seven experiments are presented to evaluate the performance of the ECGConvnet. Three of them are multi-class, and the remaining are binary class diagnosing. Six out of seven experiments diagnose COVID-19 patients. The aforementioned experimental results indicated that ECGConvnet has the highest performance over other pre-trained models, and the SVM classifier showed higher accuracy in comparison with the other classifiers. The resulting accuracies from ECGConvnet based on SVM are (99.74%, 98.6%, 99.1% on the multi-class diagnosis tasks) and (99.8% on one of the binary-class diagnoses, while the remaining achieved 100%). It is possible to develop an automatic diagnosis system for COVID based on deep learning using ECG data. [ABSTRACT FROM AUTHOR]

The article focuses on the detection of suspicious acronyms, termed "tortured acronyms," in scientific papers, often indicative of plagiarism or misconduct, leading to the development of automated tools by researchers for identifying such anomalies, which have been integrated into existing systems like the Problematic Paper Screener (PPS) to aid publishers in screening submissions and uncovering potential instances of deception or unethical practices in academic publishing.

10.3390/rs13214334 7 Park S.-H., Yoo J., Son D., Kim J., Jung H.-S. Improved Calibration of Wind Estimates from Advanced Scatterometer MetOp-B in Korean Seas Using Deep Neural Network. Lee and Choi [[4]] proposed a daytime cloud detection algorithm using a multi-temporal Geostationary Korea Multi-Purpose Satellite 2A (GEO-KOMPSAT-2A, GK-2A) dataset. 10.3390/rs13214282 9 Park S.-H., Jung H.-S., Lee S., Kim E.-S. Mapping Forest Vertical Structure in Sogwang-ri Forest from Full-Waveform Lidar Point Clouds Using Deep Neural Network. [Extracted from the article]

Microfluidic paper-based analytical devices (μPADs) have been widely used in point-of-care testing owing to their simple operation, low volume of the sample required, and the lack of the need for an external force. To obtain accurate semi-quantitative or quantitative results, μPADs need to respond to the challenges posed by differences in reaction conditions. In this paper, multi-layer μPADs are fabricated by the imprinting method for the colorimetric detection of C-reactive protein (CRP). Different lighting conditions and shooting angles of scenes are simulated in image acquisition, and the detection-related performance of μPADs is improved by using a machine learning algorithm. The You Only Look Once (YOLO) model is used to identify the areas of reaction in μPADs. This model can observe an image only once to predict the objects present in it and their locations. The YOLO model trained in this study was able to identify all the reaction areas quickly without incurring any error. These reaction areas were categorized by classification algorithms to determine the risk level of CRP concentration. Multi-layer perceptron, convolutional neural network, and residual network algorithms were used for the classification tasks, where the latter yielded the highest accuracy of 96%. It has a promising application prospect in fast recognition and analysis of μPADs. [ABSTRACT FROM AUTHOR]

Raman spectroscopy is an effective method for diagnosing the aging state of transformer oil-paper insulation. Aiming at overcoming the drawback of previous methods that require a large number of training samples, this research proposes a method for aging diagnosis of oil-paper insulation that can be used for few-shot learning. In this study, different Raman spectroscopy samples of aging insulating oil are obtained by accelerated thermal aging experiments. This paper uses identity matrix as node feature, calculates the connection weights between them by Gaussian kernel function, and constructs the graph structure of Raman spectroscopy library. Using graph convolutional neural network (GCN) based on the graph structure, a diagnosis model is established. The diagnostic accuracy rate is as high as 95.5%. This method provides a theoretical basis for establishing a new structured Raman spectroscopy library and assessing the aging state of transformer oil-paper insulation with a small number of training samples. [ABSTRACT FROM AUTHOR]

[Display omitted] • 3D-ACM involves two rounds of Hilbert transform and tensor product operations. • It significantly enhances the equivalent frequency points and sample numbers. • The R-squared values for PLS-LR, KNN, RF and CNN models approach or equal 1. • These supervised models are comparable to unsupervised models such as PCA-LR. We have developed a novel 3D asynchronous correlation method (3D-ACM) designed for the classification and identification of Chinese handmade paper samples using Raman spectra and machine learning. The 3D-ACM approach involves two rounds of tensor product and Hilbert transform operations. In the tensor product process, the outer product of the spectral data from different samples within the same category is computed, establishing inner connections among all samples within that category. The Hilbert transform introduces a 90-degree phase shift, resulting in a true three-dimensional spectral data structure. This expansion significantly increases the number of equivalent frequency points and samples within each category. This enhancement substantially boosts spectral resolution and reveals more hidden information within the spectral data. To maximize the potential of 3D-ACM, we employed six machine learning models: principal component analysis (PCA) with linear regression (LR), support vector machine (SVM) with LR, k-Nearest Neighbors (KNN), random forest (RF), and convolutional neural network (CNN). When applied to the 3D-ACM data preprocessing method, R-squared values of PLS-LR, KNN, RF and CNN supervised models, approached or equaled 1. This indicates exceptional performance comparable to unsupervised models like PCA. 3D-ACM stands as a versatile mathematical technique not confined to spectral data. It also eliminates the necessity for additional experimental setups or external control conditions, distinct from traditional two-dimensional correlation spectroscopy. Moreover, it preserves the original experimental data, setting it apart from conventional data preprocessing methods. This positions 3D-ACM as a promising tool for future material classification and identification in conjunction with machine learning. [ABSTRACT FROM AUTHOR]

Detecting insulation performance through testing the Raman spectroscopy of transformer oil is noninvasive and shows great promise in on-site diagnosis. The information, stored in spectra, that may reflect aging states of insulation aims to be effectively unfolded and provides decision support as well. In this article, a transformation method based on intrinsic product arithmetic is used to transform the 1-D Raman spectral data into 2-D image data. With the help of CNN based on the dimensionality expanding method, diagnosis of oil–paper insulation with different aging states based on the Raman spectroscopy was realized. The network-based oil–paper insulation aging diagnosis model has an accuracy of 95% in ten aging categories of 60 test samples and 100% in four aging categories. The result shows the trained CNN was able to identify the differences of transformer oil samples at each aging stage through visualized Raman spectral image. This method provides a more accurate determination method for diagnosing oil-immersed transformers’ aging conditions; it also develops an available method for a more detailed evaluation of insulation aging levels. [ABSTRACT FROM AUTHOR]

This paper presents a convolutional neural network (CNN) to classify between the conventionally and organically cultivated Memecik varieties of green olives. The image forming method called the rising paper chromatography is utilized in preparing the images of Memecik varieties of green olives for CNN. In the rising chromatography method, 20, 30, and 40% sample concentrations were determined as the suitable concentrations for both organic and conventional olives. The concentrations of AgNO3 and FeSO4 were determined as 0.25, 0.5, 0.75 and 1% for both conventional and organic samples. The visual differences used for differentiation of different types of Memecik green olives are usually determined according to the regional color differences, the vivid color occurrence, the width and the frequency of bowl occurrence, the thin line, and the picks at drop zone by the expert assessors. The testing results in this study verified the effectiveness of the CNN methodology in differentiating between the organically and conventionally cultivated Memecik green olives. The newly designed neural network achieved 100% accuracy. Furthermore, this high accuracy achieved by CNN might suggest that it can be effectively used in place of the expert assessors. [ABSTRACT FROM AUTHOR]

Municipal papers and polyethylene terephthalate (PET) wastes are primary constituents of municipal solid waste (MSW) which necessitates effective disposal. Co-pyrolysis is an efficient transformation technology for the production of valuable gas and liquid fuels. Therefore, co-pyrolysis characteristics, kinetics, gas and liquid products of cellulose and PET mixtures were investigated in a two-stage reactor by multiple characterizations coupling with deep learning approach. The results indicated that there exhibited positive interaction for cellulose and PET co-pyrolysis in terms of mass difference (δ m) and mass loss rate difference (δ r) between experimental and calculated values. The thermal decomposition process and synergistic effects (δ m and δ r) were accurately predicted by deep learning approaches (R 2 =0.9823–0.9993) using temperature, catalyst, mixing ratio and heating rate variables. Feature importance revealed that the temperature, catalyst, heating rate and mixing ratio were in the descending order to affect the remaining mass from TG curves. And the temperature played a predominant role in synergistic effects. The Flynn-Wall-Ozawa (FWO) method was more suitable for fitting the pyrolysis process to obtain activation energy (E a) with higher R 2 (0.94714–0.99640) compared with Kissinger-Akahira-Sunose (KAS) method. When the mixing ratio of cellulose and PET was 1:1, the E a was significantly reduced to 80.73 KJ/mol, and further reduced to 73.04 KJ/mol by introducing the catalyst, as compared to E a of individual cellulose (178.95 KJ/mol) and PET (198.34 KJ/mol). Co-pyrolysis of cellulose and PET led to a reduction of carbohydrates, furans, alcohols, ketones, and phenols, while the content of acids was remarkably increased which was consistent with the observation in FTIR that the absorption peak of C＝O became sharp and strong. The introduction of ZSM-11 resulted in an increase in aromatics and a decrease in acids content owing to aromatization and deoxygenation. This work is expected to offer beneficial guidance for the efficient disposal of MSW and the application of deep learning methods. [Display omitted] • The interactive pathway for catalytic co-pyrolysis of cellulose and PET was proposed. • The activation energy reached the lowest 73.04 KJ/mol when the mixing ratio was 1:1. • Optimized convolutional neural network predicted synergistic effects with R 2 > 0.99. • Feature importance for TG was temperature > catalyst > heating rate > mixing ratio. [ABSTRACT FROM AUTHOR]

An efficient plant disease identification is prime important for Agricultural productivity. This paper proposes a method of automatic leaf extraction and classification with improved accuracy compared with existing techniques. Images acquired from natural fields are complex, with background information that needs to be accurately segmented to identify areas of interest. Grab cut is a semi-automatic approach to extract foreground objects, which might occasionally degrade an object's properties. This paper suggests a better Grab cut for automatically extracting leaves from real-field images. The enhanced dataset of 23,617 images with eleven tomato leaf classes are created using the plant village dataset and actual field images. This paper addresses a wide range of issues related to convolutional neural network optimization, including how the number of layers affects the results of leaf disease detection and the creation of tiny models for portable devices. Five models, VGG 16, MobileNet, and custom architecture with input sizes of 98 × 98, 160 × 160, and 256 × 256, have been optimized and evaluated through several trials. Training and testing involve varying the input size, the number of layers, the optimizer, the dropout, the batch normalization, and the transfer learning. This paper presents and analyzes the findings of thirty experiments on various architecture. The proposed modified sequential eleven-layer architecture achieves accuracy compared with MobileNet and a reduced model size of 3.9 MB for input size 160 and 4.5 MB for input size 98. [ABSTRACT FROM AUTHOR]

Aiming at the problems of high stochasticity and volatility of power loads as well as the difficulty of accurate load forecasting, this paper proposes a power load forecasting method based on CEEMDAN (Completely Integrated Empirical Modal Decomposition) and TCN-LSTM (Temporal Convolutional Networks and Long-Short-Term Memory Networks). The method combines the decomposition of raw load data by CEEMDAN and the spatio-temporal modeling capability of TCN-LSTM model, aiming to improve the accuracy and stability of forecasting. First, the raw load data are decomposed into multiple linearly stable subsequences by CEEMDAN, and then the sample entropy is introduced to reorganize each subsequence. Then the reorganized sequences are used as inputs to the TCN-LSTM model to extract sequence features and perform training and prediction. The modeling prediction is carried out by selecting the electricity compliance data of New South Wales, Australia, and compared with the traditional prediction methods. The experimental results show that the algorithm proposed in this paper has higher accuracy and better prediction effect on load forecasting, which can provide a partial reference for electricity load forecasting methods. [ABSTRACT FROM AUTHOR]

The aim of image inpainting is to fill in damaged areas according to certain rules based on information about the adjacent positions of missing areas and the overall structure of the image, a technique that plays a key role in various tasks in computer vision. With the rapid development of deep learning, researchers have combined it with image inpainting and achieved excellent performance. To gain insight into the techniques involved, this paper summarizes the latest research advances in the field of image inpainting. Firstly, existing classical image inpainting methods are reviewed, and traditional image inpainting methods and their advantages and disadvantages are introduced. Secondly, three classical network models are outlined, and the image inpainting methods are classified into single-stage, multi-stage and a priori condition-guided approaches according to different network types and model structures. Representative algorithms among them are selected and their important technical improvement ideas are analyzed and summarized. Then, the common datasets commonly used in image inpainting tasks and the evaluation metrics used to evaluate inpainting results are introduced. The paper presents a comprehensive summary of the various algorithms in terms of network models and inpainting methods, and selects representative algorithms for quantitative and qualitative comparative analysis. Finally, the future development trends and research directions have prospected, and the current problems of image inpainting are summarized. [ABSTRACT FROM AUTHOR]

Unbalanced data in intrusion detection seriously affect the overall performance of intrusion detection methods. This paper proposes an intrusion detection algorithm based on unbalanced learning (ID-UL) for unbalanced learning. It uses two strategies to address the issues brought about by unbalanced data. First, the data grouping strategy based on integrated learning alleviates the extreme data imbalance and avoids the negative impact on imbalanced learning. Meanwhile, to avoid the possible negative impact brought by unbalanced data on the learning procedures of convolutional neural networks, the strategy of assigning weight to the loss function is adopted. Besides, a method for determining the weight value is designed to make the model supervise the learning of attack samples during the training process. Experimental results on the NSL-KDD dataset show that the method in this paper can effectively improve the detection of attack classes, and the overall detection accuracy reaches 81.48%. ID-UL has the same significant effect on other imbalanced datasets. [ABSTRACT FROM AUTHOR]

Natural disasters can be unpredictable and catastrophic. Even after the event, the repercussions are prolonged due to the incompetence of disaster management strategies. To mitigate the effects of a natural hazard, disaster management teams have to rapidly come forth with innovative plans of action. To contain the damage that a disaster causes, the response time, and preparedness of a disaster management team is crucial. Having a forewarning about the nature of the disaster can prove to be beneficial for the management team. Remote/unreachable areas such as deep parts of the forests, far-flung rural areas, oceans and other hard to reach locations are at a higher risk of receiving poorer aid and response due to the lack of communication and connectivity with the rest of the world. Our paper provides a solution for this particular problem by suggesting UAV/Drones for surveillance and monitoring in these inaccessible, disaster struck areas. The drones not only monitor the situation but constantly click pictures and send them to a base station, where the images are used to collect insights about the type of disaster that has to be dealt with. The paper proposes a deep learning model based on feature concatenation for classification of disasters which can be deployed at the base station, and can receive data in the form of images from a UAV/drone hovering over the affected place. The proposed model is efficient and able to achieve a higher accuracy as compared to the leading CNN models and closely related recent works as well. [ABSTRACT FROM AUTHOR]

The traditional method for retrieving cloud optical thickness (COT) is carried out through a Look-Up Table (LUT). Researchers must make a series of idealized assumptions and conduct extensive observations and record features in this scenario, consuming considerable resources. The emergence of deep learning effectively addresses the shortcomings of the traditional approach. In this paper, we first propose a daytime (SOZA < 70°) COT retrieval algorithm based on FY-4A AGRI. We establish and train a Convolutional Neural Network (CNN) model for COT retrieval, CM4CR, with the CALIPSO's COT product spatially and temporally synchronized as the ground truth. Then, a deep learning method extended from video prediction models is adopted to predict COT values based on the retrieval results obtained from CM4CR. The COT prediction model (CPM) consists of an encoder, a predictor, and a decoder. On this basis, we further incorporated a time embedding module to enhance the model's ability to learn from irregular time intervals in the input COT sequence. During the training phase, we employed Charbonnier Loss and Edge Loss to enhance the model's capability to represent COT details. Experiments indicate that our CM4CR outperforms existing COT retrieval methods, with predictions showing better performance across several metrics than other benchmark prediction models. Additionally, this paper also investigates the impact of different lengths of COT input sequences and the time intervals between adjacent frames of COT on prediction performance. [ABSTRACT FROM AUTHOR]

The precision of short-term photovoltaic power forecasts is of utmost importance for the planning and operation of the electrical grid system. To enhance the precision of short-term output power prediction in photovoltaic systems, this paper proposes a method integrating K-means clustering: an improved snake optimization algorithm with a convolutional neural network–bidirectional long short-term memory network to predict short-term photovoltaic power. Firstly, K-means clustering is utilized to categorize weather scenarios into three categories: sunny, cloudy, and rainy. The Pearson correlation coefficient method is then utilized to determine the inputs of the model. Secondly, the snake optimization algorithm is improved by introducing Tent chaotic mapping, lens imaging backward learning, and an optimal individual adaptive perturbation strategy to enhance its optimization ability. Then, the multi-strategy improved snake optimization algorithm is employed to optimize the parameters of the convolutional neural network–bidirectional long short-term memory network model, thereby augmenting the predictive precision of the model. Finally, the model established in this paper is utilized to forecast photovoltaic power in diverse weather scenarios. The simulation findings indicate that the regression coefficients of this method can reach 0.99216, 0.95772, and 0.93163 on sunny, cloudy, and rainy days, which has better prediction precision and adaptability under various weather conditions. [ABSTRACT FROM AUTHOR]

Sensor data fusion analysis is a crucial process that integrates data from multiple sensors to provide more accurate and comprehensive information. This analysis has various applications in fields such as industry, medicine, robotics, transportation, and information systems. The article highlights sixteen high-quality papers that explore different aspects of sensor data fusion, including facial detection, object detection, odometry systems, geospatial data evaluation, and fault detection. The papers demonstrate the potential of sensor data fusion in improving decision-making, efficiency, and productivity in various industries. Future research in this area will focus on miniaturization, multi-sensor systems, and addressing challenges related to data quality in mobile sensors. [Extracted from the article]

This paper introduces a novel one-dimensional convolutional neural network that utilizes clinical data to accurately detect choledocholithiasis, where gallstones obstruct the common bile duct. Swift and precise detection of this condition is critical to preventing severe complications, such as biliary colic, jaundice, and pancreatitis. This cutting-edge model was rigorously compared with other machine learning methods commonly used in similar problems, such as logistic regression, linear discriminant analysis, and a state-of-the-art random forest, using a dataset derived from endoscopic retrograde cholangiopancreatography scans performed at Olive View–University of California, Los Angeles Medical Center. The one-dimensional convolutional neural network model demonstrated exceptional performance, achieving 90.77% accuracy and 92.86% specificity, with an area under the curve of 0.9270. While the paper acknowledges potential areas for improvement, it emphasizes the effectiveness of the one-dimensional convolutional neural network architecture. The results suggest that this one-dimensional convolutional neural network approach could serve as a plausible alternative to endoscopic retrograde cholangiopancreatography, considering its disadvantages, such as the need for specialized equipment and skilled personnel and the risk of postoperative complications. The potential of the one-dimensional convolutional neural network model to significantly advance the clinical diagnosis of this gallstone-related condition is notable, offering a less invasive, potentially safer, and more accessible alternative. [ABSTRACT FROM AUTHOR]

CNN has demonstrated remarkable performance in EEG signal detection, yet it still faces limitations in terms of global perception. Additionally, due to individual differences in EEG signals, the generalization ability of epilepsy detection models is week. To address this issue, this paper presents a cross-patient epilepsy detection method utilizing a multi-head self-attention mechanism. This method first utilizes Short-Time Fourier Transform (STFT) to transform the original EEG signals into time-frequency features, then models local information using Convolutional Neural Network (CNN), subsequently captures global dependency relationships between features using the multi-head self-attention mechanism of Transformer, and finally performs epilepsy detection using these features. Meanwhile, this model employs a light multi-head attention mechanism module with an alternating structure, which can comprehensively extract multi-scale features while significantly reducing computational costs. Experimental results on the CHB-MIT dataset show that the proposed model achieves accuracy, sensitivity, specificity, F1 score, and AUC of 92.89%, 96.17%, 92.99%, 94.41%, and 96.77%, respectively. Compared to the existing methods, the method proposed in this paper obtains better performance along with better generalization. [ABSTRACT FROM AUTHOR]

Offshore wind-hydrogen systems operate in harsh marine environments for extended periods, posing risks of low accessibility and high failure rates. This paper proposes a data-driven fault detection framework for offshore wind-hydrogen systems, aiming to promptly detect potential faults based on the system's physical parameters. The research establishes a comprehensive model based on the operating principles of offshore wind-hydrogen systems. The study uses fault injection techniques to simulate common partial faults in offshore wind-hydrogen systems and collects relevant physical parameters (such as wind turbine power generation, energy storage battery charging/discharging current, and electrolyzer hydrogen production rate). A fault detection model was constructed using a combination of Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to enable precise detection of potential faults in the system. The established model provides theoretical support for designing, optimizing, and operating offshore wind-hydrogen systems, reducing reliance on actual experiments and lowering project risks and costs. Introducing artificial faults can evaluate the system's performance in different fault scenarios. This paper proposes a CNN-BiLSTM fault detection method that achieves automatic feature extraction and high-precision classification of time-series fault data, confirming the practicality and feasibility of offshore wind-hydrogen systems. This investigation realizes the integration of the offshore wind-hydrogen system model and deep learning, as well as a fully automated learning process from data to fault detection. By calculating and comparing results, it is verified that the framework has a high accuracy of 96.9%. This innovative research offers new methods and perspectives for enhancing the reliability and efficiency of fault detection in offshore wind-hydrogen systems. • A comprehensive multi-system simulation model for offshore wind-hydrogen systems is established. • Fault injection is employed to acquire data samples for offshore wind-hydrogen systems. • Utilizing the CNN-BiLSTM method, a high-accuracy deep learning fault detection model is crafted. • A simulation model-based data-driven deep learning framework for fault detection is devised in this study. [ABSTRACT FROM AUTHOR]

Percutaneous coronary intervention (PCI) has become a vital treatment approach for coronary artery disease, but the clinical data of PCI cannot be directly utilized due to its unstructured characteristics. The existing clinical named entity recognition (CNER) has been used to identify specific entities such as body parts, drugs, and diseases, but its specific potential in PCI clinical texts remains largely unexplored. How to effectively use CNER to deeply mine the information in the existing PCI clinical records is worth studying. In this paper, a total of 24 267 corpora are collected from the Cardiovascular Disease Treatment Center of the People's Hospital of Liaoning Province in China. We select three types of clinical record texts of fine-grained PCI surgical information, from which 5.8% of representative surgical records of PCI patients are selected as datasets for labeling. To fully utilize global information and multi-level semantic features, we design a novel character-level vector embedding method and further propose a new hybrid model based on it. Based on the classic Bidirectional Long Short-Term Memory Network (BiLSTM), the model further integrates Convolutional Neural Networks (CNNs) and Bidirectional Encoder Representations from Transformers (BERTs) for feature extraction and representation, and finally uses Conditional Random Field (CRF) for decoding and predicting label sequences. This hybrid model is referred to as BCC-BiLSTM in this paper. In order to verify the performance of the proposed hybrid model for extracting PCI surgical information, we simultaneously compare both representative traditional and intelligent methods. Under the same circumstances, compared with other intelligent methods, the BCC-BiLSTM proposed in this paper reduces the word vector dimension by 15%, and the F1 score reaches 86.2% in named entity recognition of PCI clinical texts, which is 26.4% higher than that of HMM. The improvement is 1.2% higher than BiLSTM + CRF and 0.7% higher than the most popular BERT + BiLSTM + CRF. Compared with the representative models, the hybrid model has better performance and can achieve optimal results faster in the model training process, so it has good clinical application prospects. [ABSTRACT FROM AUTHOR]

The paper focuses on two kinds of rotating machinery, miniature table drilling machine and automobile engine, as the research object. Traditional machine learning has the need for manual feature extraction, and is very dependent on expert diagnostic experience and expertise, but also has the disadvantages of low accuracy, low timeliness, low efficiency, etc. For the traditional rotating machinery fault diagnosis method is more based on the traditional machine learning model, this paper puts forward a one-dimensional convolutional neural network-based fault identification method. According to the characteristics of the miniature table drilling machine and the automobile engine which are not detachable, the corresponding faults are set up respectively, Vibration signals of the attitude sensor are obtained by using the signal collector, and the collected data are preprocessed, then the CNN model is built for fault identification, and the network structure is constantly optimized to obtain the optimal network model with high accuracy (up to 100 %) and robustness. The results show that the one-dimensional convolutional neural network model improves the fault recognition accuracy and reduces the cost compared with the traditional machine learning SVM model when the original signal is used as the input signal. [ABSTRACT FROM AUTHOR]

Training in Feed Forward Deep Neural Networks is a memory-intensive operation which is usually performed on GPUs with limited memory capacities. This may force data scientists to limit the depth of the models or the resolution of the input data if data does not fit in the GPU memory. The re-materialization technique, whose idea comes from the checkpointing strategies developed in the Automatic Differentiation literature, allows data scientists to limit the memory requirements related to the storage of intermediate data (activations), at the cost of an increase in the computational cost. This paper introduces a new strategy of re-materialization of activations that significantly reduces memory usage. It consists in selecting which activations are saved and which activations are deleted during the forward phase and then recomputing the deleted activations when they are needed during the backward phase. We propose an original computation model that combines two types of activation savings: either only storing the layer inputs or recording the complete history of operations that produced the outputs. This paper focuses on the fully heterogeneous case, where the computation time and the memory requirement of each layer is different. We prove that finding the optimal solution is NP-hard and that classical techniques from Automatic Differentiation literature do not apply. Moreover, the classical assumption of memory persistence of materialized activations, used to simplify the search of optimal solutions, does not hold anymore. Thus, we propose a weak memory persistence property and provide a dynamic program to compute the optimal sequence of computations. This algorithm is made available through the Rotor software, a PyTorch plug-in dealing with any network consisting of a sequence of layers, each of them having an arbitrarily complex structure. Through extensive experiments, we show that our implementation consistently outperforms existing re-materialization approaches for a large class of networks, image sizes, and batch sizes. [ABSTRACT FROM AUTHOR]

Visual information is important in final approach and landing phases for an approaching aircraft, it presents supplementary source for navigation system, and provides backup guidance when radio navigation fails, or even supports a complete vision‐based landing. Relative position and attitude can be solved from the runway features in the image. Traditional runway detection methods have high latency and low accuracy, which is unable to satisfy the requirements for a safe landing. This paper proposes a real‐time runway detection model, efficient runway feature extractor (ERFE), based on deep convolutional neural network, generating semantic segmentation and feature lines output. In order to evaluate the model's effectiveness, a benchmark is proposed to calculate the actual error between predicted feature line and ground truth one. A novel runway dataset which is based on pictures from Microsoft Flight Simulator 2020 (FS2020), is also proposed in this paper to train and test the model. The dataset will be released at https://www.kaggle.com/datasets/relufrank/fs2020‐runway‐dataset. ERFE shows excellent performance in FS2020 dataset, it gives satisfactory results even for real runway images excluded from our dataset. [ABSTRACT FROM AUTHOR]

Segmentation is crucial in diagnosing retinal diseases by accurately identifiying retinal vessels. This paper addresses the complexity of segmenting retinal vessels, highlighting the need for precise analysis of blood vessel structures. Despite the progress made by convolutional neural networsks (CNNs) in image segmentation, their limitations in capturing the global structure of retinal vsessels and maintaining segmentation continuity present challenges. To tackle these issues, our proposed network integrates graph convolutional networks (GCNs) and attention mechansims. This allows the model to consider pixel relationships and learn vessel graphical structures, significantly improving segmentation accuracy. Additionally, the attentional feature fusion module, including pixel‐wise and channel‐wise attention mechansims within the U‐Net architecture, refines the model's focus on relevant features. This paper emphasizes the importance of continuty preservation, ensuring an accurate representation of pixel‐level information and structural details during sefmentation. Therefore, our method performs as an effective solution to overcome challenges in retinal vessel segmentation. The proposed method outperformed the state‐of‐the‐art approaches on DRIVE (Digital Retinal Images for Vessel Extraction) and STARE (Structed Analysis of the Retina) datasets with accuracies of 0.12% and 0.14%, respecttively. Importantly, our proposed approach excelled in delineating slender and diminutive blood vessels, crucial for diagnosing vascular‐related diseases. Implementation is accessible on https://github.com/CVLab‐SHUT/VGA‐Net. [ABSTRACT FROM AUTHOR]

With the aim of solving the problem of identifying complex underwater acoustic targets using a single signal feature in the Time–Frequency (TF) feature, this paper designs a method that recognizes the underwater targets based on the Delay-Doppler joint feature. First, this method uses symplectic finite Fourier transform (SFFT) to extract the Delay-Doppler features of underwater acoustic signals, analyzes the Time–Frequency features at the same time, and combines the Delay-Doppler (DD) feature and Time–Frequency feature to form a joint feature (TF-DD). This paper uses three types of convolutional neural networks to verify that TF-DD can effectively improve the accuracy of target recognition. Secondly, this paper designs an object recognition model (TF-DD-CNN) based on joint features as input, which simplifies the neural network's overall structure and improves the model's training efficiency. This research employs ship-radiated noise to validate the efficacy of TF-DD-CNN for target identification. The results demonstrate that the combined characteristic and the TF-DD-CNN model introduced in this study can proficiently detect ships, and the model notably enhances the precision of detection. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the International Journal of Uncertainty, Fuzziness & Knowledge-Based Systems. It discusses the potential of fuzzy-based systems in statistical learning theory and their ability to handle uncertainty and ambiguity in real-time data. The editorial highlights recent advancements in integrating fuzzy systems with deep learning architectures and other machine learning techniques. The special issue aims to explore the intersection of fuzzy logic and statistical learning theory and includes twelve accepted papers that investigate the capabilities of fuzzy-based systems. The document provides a brief summary of each paper, covering topics such as pop-up text recognition, alignment of laser images, knowledge graph reasoning, land use changes, 3D printing in vehicle design, defect detection in electronic components, digital management process improvement, spectrum sharing in IoV, deep clustering for time series data, anti-collision algorithms, missing data filling, and video action recognition. The guest editor expresses gratitude to the authors and reviewers for their contributions and to the Editor-in-Chief for the opportunity to curate the special issue. [Extracted from the article]

In order to accurately estimate the period of X-ray pulsars to improve navigation performance, this paper proposes a pulsar period estimation method based on photon energy using reverse Hilbert coding and double Convolutional Neural Networks (CNNs) discrimination. This method uses photon energy information to perform epoch folding. It converts one-dimensional contour information into two-dimensional image signals through reverse Hilbert curve and recognizes contour image features through CNN models to determine the optimal period. According to the simulation results, the period estimation accuracy of this method is 0.5350 ns, which is 65.71% higher than the χ 2 epoch folding method. The contour phase accuracy is 0.0004767, which is 41.93% higher than the χ 2 epoch folding method. At the same time, the observation time and noise interference that may affect the accuracy of period estimation are also quantitatively analyzed. In addition, in order to simulate real navigation scenarios, this paper also conducts dynamic period estimation experiments on PSR B0531+21 pulsar in a specific period of time. The method proposed in this paper has the advantages of high precision, fast calculation speed, strong anti-interference ability and accurate dynamic period estimation, which can significantly improve the navigation performance of X-ray pulsars. • The proposed period estimation method uses photon energy information for contour weighted folding. • The proposed method uses reverse Hilbert curve to convert one-dimensional contour information into two-dimensional image information. • Convolutional Neural Network models are used to optimize pulsar period estimation. [Display omitted] [ABSTRACT FROM AUTHOR]

Segmentation of whole slide histological images through the classification of tissue types of small fragments is an extremely relevant task in digital pathology, necessary for the development of methods for automatic analysis of whole slide histological images. The extremely large resolution of such images also makes the task of increasing image resolution relevant, which allows storing images at a reduced resolution and increasing it if necessary. Annotating whole slide images by histologists is complex and time-consuming, so it is important to make the most efficient use of the available data, both labeled and unlabeled. In this paper we propose a novel neural network method to simultaneously solve the problems of super-resolution of histological images from ×20 optical magnification to ×40 and classifying image fragments into tissue types at ×20 magnification. The use of a single encoder as well as the proposed neural network training scheme allows to achieve better results on both tasks compared to existing approaches. The PATH-DT-MSU WSS2v2 dataset presented for the first time in this paper was used for training and testing the method. On the test sample, an accuracy value of 0.971 and a balanced accuracy value of 0.916 were achieved in the classification task on 5 tissue types, for the super-resolution task, values of PSNR = 32.26 and SSIM = 0.89 were achieved. The source code of the proposed method is available at: https://github.com/Kukty/WSI_SR_CL. [ABSTRACT FROM AUTHOR]

Convolutional Neural Networks (CNNs) are a kind of artificial neural network designed to extract features and find out patterns for tasks such as segmentation, recognizing objects, and drawing up classification. Within a CNNs architecture, pooling operations are used until the number of parameters and the computational complexity are reduced. Numerous papers have focused on investigating the impact of pooling on the performance of Convolutional Neural Networks (CNNs), leading to the development of various pooling models. Recently, a fuzzy pooling operation based on type-1 fuzzy sets was introduced to cope with the local imprecision of the feature maps. However, in fuzzy set theory, it is not always accurate to assume that the degree of non-membership of an element in a fuzzy set is simply the complement of the degree of membership. This is due to the potential existence of a hesitation degree, which implies a certain level of uncertainty. To overcome this limitation, intuitionistic fuzzy sets (IFS) were introduced to incorporate the concept of a degree of hesitation. In this paper, we introduce a novel pooling operation based on intuitionistic fuzzy sets to incorporate the degree of hesitation heretofore neglected by a fuzzy pooling operation based on classical fuzzy sets, and we investigate its performance in the context of image classification. Intuitionistic pooling is performed in four steps: bifuzzification (by the transformation of data through the use of membership and non-membership maps), first aggregation (through the transformation of the IFS into a standard fuzzy set, second aggregation (through the transformation and use of a sum operator), and the defuzzification of feature map neighborhoods by using a max operator. IFS pooling is used for the construction of an intuitionistic pooling layer that can be applied as a drop-in replacement for the current, fuzzy (type-1) and crisp, pooling layers of CNN architectures. Various experiments involving multiple datasets demonstrate that an IFS-based pooling can enhance the classification performance of a CNN. A benchmarking study reveals that this significantly outperforms even the most recent pooling models, especially in stochastic environments. [ABSTRACT FROM AUTHOR]

In the context of the Internet of Things, there is a growing demand for real-time monitoring of water distribution systems (WDS). Among the various leak detection methods, acoustic leak detection is considered to be a suitable method. However, existing methods are not very effective in environments with high daytime ambient noise. To address this issue, this paper conducted on-site data collection experiments and designed a monitoring system that combines traditional nighttime monitoring with daytime monitoring, combining water company pipeline inspections and repair work. A large number of daytime audio samples were collected. In this paper, the logarithmic spectrogram (log spectrogram) was used to represent the features of the leak signal. By comparing the features of the signal during day and night, noisy and quiet environments, and leak and normal signals, we identified the interfering frames that required noise reduction, and applied frame-level noise reduction processing to the signal. Based on this, a log PS-ResNet18 model was developed to identify leaks, and its performance was compared with other classification models [including traditional nighttime detection methods, random forests, XGBoost, and convolutional neural network (CNN)]. The results showed that the log PS-ResNet18 model had the best performance, with an all-day accuracy rate of 99.4% and a daytime accuracy rate of 99.3%. In addition, by conducting ablation experiments to explore the role and contribution of the log PS-ResNet18 and noise reduction methods in the model, the results showed that the log spectrogram and noise reduction methods increased the all-day accuracy rate by 18.8% and 23.2%, respectively, and by 24.7% when used together. In another practical application, the log PS-ResNet18 model achieved an all-day detection accuracy rate of 99.6%. This study demonstrated the applicability of the log spectrogram and CNN combination in daytime leak detection, overcoming research limitations in the field. This research presents the log PS-ResNet18 framework, which combines deep learning models and denoised logarithmic spectrograms to improve leak detection in water supply pipelines under daytime environmental noise. The research focuses on field data collection and analysis of cast iron pipes with different diameters in Hangzhou (HZ). The model was tested on cast iron pipes in Lishui (LS) and proved to be effective. The proposed method is highly versatile and can be applied to different regions and pipe materials after sufficient sample collection and model training validation. The research recommends a comprehensive leak monitoring solution that involves initial intelligent detection using front-end noise meters and secondary identification of suspicious audio signals using the log PS-ResNet18 model in the cloud. This enables water utility operators to respond quickly to pipeline leaks, leading to more efficient water resource conservation and improved water supply service quality. [ABSTRACT FROM AUTHOR]

Sign language is an essential means of communication for individuals with hearing disabilities. However, there is a significant shortage of sign language interpreters in some languages, especially in Saudi Arabia. This shortage results in a large proportion of the hearing-impaired population being deprived of services, especially in public places. This paper aims to address this gap in accessibility by leveraging technology to develop systems capable of recognizing Arabic Sign Language (ArSL) using deep learning techniques. In this paper, we propose a hybrid model to capture the spatio-temporal aspects of sign language (i.e., letters and words). The hybrid model consists of a Convolutional Neural Network (CNN) classifier to extract spatial features from sign language data and a Long Short-Term Memory (LSTM) classifier to extract spatial and temporal characteristics to handle sequential data (i.e., hand movements). To demonstrate the feasibility of our proposed hybrid model, we created a dataset of 20 different words, resulting in 4000 images for ArSL: 10 static gesture words and 500 videos for 10 dynamic gesture words. Our proposed hybrid model demonstrates promising performance, with the CNN and LSTM classifiers achieving accuracy rates of 94.40% and 82.70%, respectively. These results indicate that our approach can significantly enhance communication accessibility for the hearing-impaired community in Saudi Arabia. Thus, this paper represents a major step toward promoting inclusivity and improving the quality of life for the hearing impaired. [ABSTRACT FROM AUTHOR]

This paper addresses issues concerning biometric authentication based on handwritten signatures. Our research aimed to check whether a handwritten signature acquired with a mobile device can effectively verify a user's identity. We present a novel online signature verification method using coordinates of points and pressure values at each point collected with a mobile device. Convolutional neural networks are used for signature verification. In this paper, three neural network models are investigated, i.e., two self-made light SigNet and SigNetExt models and the VGG-16 model commonly used in image processing. The convolutional neural networks aim to determine whether the acquired signature sample matches the class declared by the signer. Thus, the scenario of closed set verification is performed. The effectiveness of our method was tested on signatures acquired with mobile phones. We used the subset of the multimodal database, MobiBits, that was captured using a custom-made application and consists of samples acquired from 53 people of diverse ages. The experimental results on accurate data demonstrate that developed architectures of deep neural networks can be successfully used for online handwritten signature verification. We achieved an equal error rate (EER) of 0.63% for random forgeries and 6.66% for skilled forgeries. [ABSTRACT FROM AUTHOR]

Emotion recognition has become increasingly important in the field of Deep Learning (DL) and computer vision due to its broad applicability by using human–computer interaction (HCI) in areas such as psychology, healthcare, and entertainment. In this paper, we conduct a systematic review of facial and pose emotion recognition using DL and computer vision, analyzing and evaluating 77 papers from different sources under Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Our review covers several topics, including the scope and purpose of the studies, the methods employed, and the used datasets. The scope of this work is to conduct a systematic review of facial and pose emotion recognition using DL methods and computer vision. The studies were categorized based on a proposed taxonomy that describes the type of expressions used for emotion detection, the testing environment, the currently relevant DL methods, and the datasets used. The taxonomy of methods in our review includes Convolutional Neural Network (CNN), Faster Region-based Convolutional Neural Network (R-CNN), Vision Transformer (ViT), and "Other NNs", which are the most commonly used models in the analyzed studies, indicating their trendiness in the field. Hybrid and augmented models are not explicitly categorized within this taxonomy, but they are still important to the field. This review offers an understanding of state-of-the-art computer vision algorithms and datasets for emotion recognition through facial expressions and body poses, allowing researchers to understand its fundamental components and trends. [ABSTRACT FROM AUTHOR]

With the continuous development of automotive intelligence, vehicle occupant detection technology has received increasing attention. Despite various types of research in this field, a simple, reliable, and highly private detection method is lacking. This paper proposes a method for vehicle occupant detection using millimeter-wave radar. Specifically, the paper outlines the system design for vehicle occupant detection using millimeter-wave radar. By collecting the raw signals of FMCW radar and applying Range-FFT and DoA estimation algorithms, a range–azimuth heatmap was generated, visually depicting the current status of people inside the vehicle. Furthermore, utilizing the collected range–azimuth heatmap of passengers, this paper integrates the Faster R-CNN deep learning networks with radar signal processing to identify passenger information. Finally, to test the performance of the detection method proposed in this article, an experimental verification was conducted in a car and the results were compared with those of traditional machine learning algorithms. The findings indicated that the method employed in this experiment achieves higher accuracy, reaching approximately 99%. [ABSTRACT FROM AUTHOR]

Radio frequency interference (RFI) significantly hampers the target detection performance of frequency-modulated continuous-wave radar. To address the problem and maintain the target echo signal, this paper proposes a priori assumption on the interference component nature in the radar received signal, as well as a method for interference estimation and mitigation via time–frequency analysis. The solution employs Fourier synchrosqueezed transform to implement the radar's beat signal transformation from time domain to time–frequency domain, thus converting the interference mitigation to the task of time–frequency distribution image restoration. The solution proposes the use of image processing based on the dual-tree complex wavelet transform and combines it with the spatial domain-based approach, thereby establishing a dual-domain fusion interference filter for time–frequency distribution images. This paper also presents a convolutional neural network model of structurally improved UNet++, which serves as the interference estimator. The proposed solution demonstrated its capability against various forms of RFI through the simulation experiment and showed a superior interference mitigation performance over other CNN model-based approaches. [ABSTRACT FROM AUTHOR]

Global Navigation Satellite Systems (GNSS) offer comprehensive position, navigation, and timing (PNT) estimates worldwide. Given the growing demand for reliable location awareness in both indoor and outdoor contexts, the advent of fifth-generation mobile communication technology (5G) has enabled expansive coverage and precise positioning services. However, the power received by the signal of interest (SOI) at terminals is notably low. This can lead to significant jamming, whether intentional or unintentional, which can adversely affect positioning receivers. The diagnosis of jamming types, such as classification, assists receivers in spectrum sensing and choosing effective mitigation strategies. Traditional jamming diagnosis methodologies predominantly depend on the expertise of classification experts, often demonstrating a lack of adaptability for diverse tasks. Recently, researchers have begun utilizing convolutional neural networks to re-conceptualize a jamming diagnosis as an image classification issue, thereby augmenting recognition performance. However, in real-world scenarios, the assumptions of independent and homogeneous distributions are frequently violated. This discrepancy between the source and target distributions frequently leads to subpar model performance on the test set or an inability to procure usable evaluation samples during training. In this paper, we introduce LJCD-Net, a deep adversarial migration-based cross-domain jamming generalization diagnostic network. LJCD-Net capitalizes on a fully labeled source domain and multiple unlabeled auxiliary domains to generate shared feature representations with generalization capabilities. Initially, our paper proposes an uncertainty-guided auxiliary domain labeling weighting strategy, which estimates the multi-domain sample uncertainty to re-weight the classification loss and specify the gradient optimization direction. Subsequently, from a probabilistic distribution standpoint, the spatial constraint imposed on the cross-domain global jamming time-frequency feature distribution facilitates the optimization of collaborative objectives. These objectives include minimizing both the source domain classification loss and auxiliary domain classification loss, as well as optimizing the inter-domain marginal probability and conditional probability distribution. Experimental results demonstrate that LJCD-Net enhances the recognition accuracy and confidence compared to five other diagnostic methods. [ABSTRACT FROM AUTHOR]

Listening to music is a crucial tool for relieving stress and promoting relaxation. However, the limited options available for stress-relief music do not cater to individual preferences, compromising its effectiveness. Traditional methods of curating stress-relief music rely heavily on measuring biological responses, which is time-consuming, expensive, and requires specialized measurement devices. In this paper, a deep learning approach to solve this problem is introduced that explicitly uses convolutional neural networks and provides a more efficient and economical method for generating large datasets of stress-relief music. These datasets are composed of Mel-scaled spectrograms that include essential sound elements (such as frequency, amplitude, and waveform) that can be directly extracted from the music. The trained model demonstrated a test accuracy of 98.7%, and a clinical study indicated that the model-selected music was as effective as researcher-verified music in terms of stress-relieving capacity. This paper underlines the transformative potential of deep learning in addressing the challenge of limited music options for stress relief. More importantly, the proposed method has profound implications for music therapy because it enables a more personalized approach to stress-relief music selection, offering the potential for enhanced emotional well-being. [ABSTRACT FROM AUTHOR]

Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out. [ABSTRACT FROM AUTHOR]

Delamination represents one of the most significant and dangerous damages in composite plates. Recently, many papers have presented the capability of structural health monitoring (SHM) techniques for the investigation of structural delamination with various shapes and thickness depths. However, few studies have been conducted regarding the utilization of convolutional neural network (CNN) methods for automating the non-destructive testing (NDT) techniques database to identify the delamination size and depth. In this paper, an automated system qualified for distinguishing between pristine and damaged structures and classifying three classes of delamination with various depths is presented. This system includes a proposed CNN model and the Lamb wave technique. In this work, a unidirectional composite plate with three samples of delamination inserted at different depths was prepared for numerical and experimental investigations. In the numerical part, the guided wave propagation and interaction with three samples of delamination were studied to observe how the delamination depth can affect the scattered and trapped waves over the delamination region. This numerical study was validated experimentally using an efficient ultrasonic guided waves technique. This technique involved piezoelectric wafer active sensors (PWASs) and a scanning laser Doppler vibrometer (SLDV). Both numerical and experimental studies demonstrate that the delamination depth has a direct effect on the trapped waves' energy and distribution. Three different datasets were collected from the numerical and experimental studies, involving the numerical wavefield image dataset, experimental wavefield image dataset, and experimental wavenumber spectrum image dataset. These three datasets were used independently with the proposed CNN model to develop a system that can automatically classify four classes (pristine class and three different delamination classes). The results of all three datasets show the capability of the proposed CNN model for predicting the delamination depth with high accuracy. The proposed CNN model results of the three different datasets were validated using the GoogLeNet CNN. The results of both methods show an excellent agreement. The results proved the capability of the wavefield image and wavenumber spectrum datasets to be used as input data to the CNN for the detection of delamination depth. [ABSTRACT FROM AUTHOR]