Search

Purpose: Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms' nutrient source. Mold not only can damage papers' structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods: Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion: In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation. [ABSTRACT FROM AUTHOR]

In an era overwhelmed by academic big data, students grapple with identifying academic papers that resonate with their learning objectives and research interests, due to the sheer volume and complexity of available information. This study addresses the challenge by proposing a novel academic paper recommendation system designed to enhance personalized learning through the nuanced understanding of academic social networks. Utilizing the theory of social homogeneity, the research first constructs a sophisticated academic social network, capturing high-order social relationships, such as co-authorship and advisor–advisee connections, through hypergraph modeling and advanced network representation learning techniques. The methodology encompasses the development and integration of a hypergraph convolutional neural network and a contrastive learning framework to accurately model and recommend academic papers, focusing on aligning with students' unique preferences and reducing reliance on sparse interaction data. The findings, validated across multiple real-world datasets, demonstrate a significant improvement in recommendation accuracy, particularly in addressing the cold-start problem and effectively mapping advisor–advisee relationships. The study concludes that leveraging complex academic social networks can substantially enhance the personalization and precision of academic paper recommendations, offering a promising avenue for addressing the challenges of academic information overload and fostering more effective personalized learning environments. [ABSTRACT FROM AUTHOR]

Herein, the challenge of accurately classifying the manufacturing origin of printing paper, including continent, country, and specific product, was addressed. One-dimensional convolutional neural network (1D CNN) models trained on infrared (IR) spectrum data acquired from printing paper samples were used for the task. The preprocessing of the IR spectra through a second-derivative transformation and the restriction of the spectral range to 1800 to 1200 cm-1 improved the classification performance of the model. The outcomes were highly promising. Models trained on second-derivative IR spectra in the 1800 to 1200-cm-1 range exhibited perfect classification for the manufacturing continent and country, with an impressive F1 score of 0.980 for product classification. Notably, the developed 1D CNN model outperformed traditional machine learning classifiers, such as support vector machines and feed-forward neural networks. In addition, the application of data point attribution enhanced the transparency of the decision-making process of the model, offering insights into the spectral patterns that affect classification. This study makes a considerable contribution to printing paper classification, with potential implications for accurate origin identification in various fields. [ABSTRACT FROM AUTHOR]

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

Document forgery is a significant issue in Korea, with around ten thousand cases reported every year. Analyzing paper plays a crucial role in examining questionable documents such as marketable securities and contracts, which can aid in solving criminal cases of document forgery. Paper analysis can also provide essential insights in other types of criminal cases, serving as an important clue for solving cases such as the source of a blackmail letter. The papermaking process generates distinct forming fabric marks and formations, which are critical features for paper classification. These characteristics are observable under transmitted light and are created by the forming fabric pattern and the distribution of pulp fibers, respectively. In this study, we propose a novel approach for paper identification based on hybrid features. This method combines texture features extracted from images converted using the gray‐level co‐occurrence matrix (GLCM) approach and a convolutional neural network (CNN), with another set of features extracted by the CNN using the same images as input. We applied the proposed method to classification tasks for seven major paper brands available in the Korean market, achieving an accuracy of 97.66%. The results confirm the applicability of this method for visually inspecting paper products and demonstrate its potential for assisting in solving criminal cases involving document forgery. [ABSTRACT FROM AUTHOR]

Medical imaging refers to the process of obtaining images of internal organs for therapeutic purposes such as discovering or studying diseases. The primary objective of medical image analysis is to improve the efficacy of clinical research and treatment options. Deep learning has revamped medical image analysis, yielding excellent results in image processing tasks such as registration, segmentation, feature extraction, and classification. The prime motivations for this are the availability of computational resources and the resurgence of deep convolutional neural networks. Deep learning techniques are good at observing hidden patterns in images and supporting clinicians in achieving diagnostic perfection. It has proven to be the most effective method for organ segmentation, cancer detection, disease categorization, and computer-assisted diagnosis. Many deep learning approaches have been published to analyze medical images for various diagnostic purposes. In this paper, we review the work exploiting current state-of-the-art deep learning approaches in medical image processing. We begin the survey by providing a synopsis of research works in medical imaging based on convolutional neural networks. Second, we discuss popular pretrained models and general adversarial networks that aid in improving convolutional networks' performance. Finally, to ease direct evaluation, we compile the performance metrics of deep learning models focusing on COVID-19 detection and child bone age prediction. [ABSTRACT FROM AUTHOR]

In the final manuscript [[33]], presented as a communication, the author indicates that unmanned aircraft systems (UASs), commonly referred to as drones, are an emerging technology that has changed the way that many industries conduct business. When used on a state-by-state basis, the normalized UAS adoption index shows that there are regional differences in UAS adoption, with western and eastern states having higher UAS adoption rates and central states having significantly lower UAS adoption rates. The aim of this second I Eng i Special Issue is to collect experimental and theoretical re-search relating to engineering science and technology. Telecommunication companies collect a deluge of subscriber data without retrieving substantial information. [Extracted from the article]

Since deep low‐frequency tremors are considered to be associated with large earthquakes that occur adjacently on the same subducting plate interface, it is important to investigate tremors that occurred before the establishment of modern seismograph networks such as the High Sensitivity Seismograph Network (Hi‐net). We propose a deep‐learning solution to detect evidence of tremors in scanned images of paper seismogram records from over 50 years ago. In this study, we fine‐tuned a convolutional neural network (CNN) based on the Residual Network, which was pre‐trained using images of synthetic waveforms from our previous study, using a data set comprised of images generated from real seismic data recorded digitally by Hi‐net to facilitate a supervised analysis. The fine‐tuned CNN was able to predict the presence or absence of tremors in the Hi‐net images with an accuracy of 98.64%. Gradient‐weighted Class Activation Mapping heatmaps created to visualize model predictions indicated that the CNN's ability to detect tremors is not degraded by the presence of teleseisms. Once validated using the Hi‐net images, the CNN was applied to paper seismograms recorded from 1966 to 1977 at the Kumano observatory in southwest Japan, operated by Earthquake Research Institute, The University of Tokyo. The CNN showed potential for detecting tremors in scanned images of paper seismogram records from the past, facilitating downstream tasks such as the creation of new tremor catalogs. However, further training using an augmented data set to control for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Plain Language Summary: In 2002, deep low‐frequency tremors, which periodically occur with much smaller amplitudes and longer durations than common earthquakes, were discovered owing to the establishment of dense seismic arrays in Japan. These tremors are considered to be associated with megathrust earthquakes because they occur in deeper regions of plate boundaries compared with common earthquakes. Investigating tremors that occurred before the establishment of dense seismic arrays is important since megathrust earthquakes recur on intervals of 100–200 years, and digital records from modern seismic arrays cover only a fraction of that time. In this study, we developed a convolutional neural network based on the Residual Network (ResNet) that extracts tremors from images of waveforms recorded more than 50 years ago, when seismometers drew waveforms directly on drum‐rolled paper using a pen. The proposed ResNet, which was trained on seismogram images generated from synthetic waveforms and real data recorded digitally by modern seismic arrays, was applied to scanned images of paper seismograms recorded from 1966 to 1977 at an observatory in southwest Japan. A list of tremors was successfully obtained; however, further training using data that accounts for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Key Points: Convolutional neural network model for detection of deep low‐frequency tremors from seismogram images is proposedThe model trained with seismogram images converted from real seismic data successfully detects tremorsThe detection performances of the trained model for the paper records at the Kumano observatory in southwest Japan are discussed [ABSTRACT FROM AUTHOR]

In view of the problems of data sparsity and the diversity in academic paper recom-mender systems,based on CONVNCF, this paper proposed an algorithm of convolution with word and heterogeneous information network for academic paper recommendation ( WN -APR) . Firstly, WN -APR algorithm learned user and paper' s diverse features from different semantics to alleviate the sparsity problem. Then it designed an outer product fusing way to seamlessly combine user features with paper features. Replacing of 2D CNN, this algorithm applied 3 D convolution to mine the influence of different features on the performance. Finally, it modified the BPR loss function to enhance diversity in recommendations. Experimental results on CiteULike-a and CiteULike-t datasets show that WN-APR improves the performance of accuracy and diversity over the baseline models. [ABSTRACT FROM AUTHOR]

One of the pandemics that have caused many deaths is the Coronavirus disease 2019 (COVID-19). It first appeared in late 2019, and many deaths are increasing day by day until now. Therefore, the early diagnosis of COVID-19 has become a salient issue. Additionally, the current diagnosis methods have several demerits, and a new investigation is required to enhance the diagnosis performance. In this paper, a set of phases are performed, such as collecting data, filtering and augmenting images, extracting features, and classifying ECG images. The data were obtained from two publicly available ECG image datasets, and one of them contained COVID ECG reports. A set of preprocessing methods are applied to the ECG images, and data augmentation is performed to balance the ECG images based on the classes. A deep learning approach based on a convolutional neural network (CNN) is performed for feature extraction. Four different pre-trained models are applied, such as Vgg16, Vgg19, ResNet-101, and Xception. Moreover, an ensemble of Xception and the temporary convolutional network (TCN), which is named ECGConvnet, is proposed. Finally, the results obtained from the former models are fed to four main classifiers. These classifiers are softmax, random forest (RF), multilayer perception (MLP), and support vector machine (SVM). The former classifiers are used to evaluate the diagnosis ability of the proposed methods. The classification scenario is based on fivefold cross-validation. Seven experiments are presented to evaluate the performance of the ECGConvnet. Three of them are multi-class, and the remaining are binary class diagnosing. Six out of seven experiments diagnose COVID-19 patients. The aforementioned experimental results indicated that ECGConvnet has the highest performance over other pre-trained models, and the SVM classifier showed higher accuracy in comparison with the other classifiers. The resulting accuracies from ECGConvnet based on SVM are (99.74%, 98.6%, 99.1% on the multi-class diagnosis tasks) and (99.8% on one of the binary-class diagnoses, while the remaining achieved 100%). It is possible to develop an automatic diagnosis system for COVID based on deep learning using ECG data. [ABSTRACT FROM AUTHOR]

The article focuses on the detection of suspicious acronyms, termed "tortured acronyms," in scientific papers, often indicative of plagiarism or misconduct, leading to the development of automated tools by researchers for identifying such anomalies, which have been integrated into existing systems like the Problematic Paper Screener (PPS) to aid publishers in screening submissions and uncovering potential instances of deception or unethical practices in academic publishing.

[Display omitted] • 3D-ACM involves two rounds of Hilbert transform and tensor product operations. • It significantly enhances the equivalent frequency points and sample numbers. • The R-squared values for PLS-LR, KNN, RF and CNN models approach or equal 1. • These supervised models are comparable to unsupervised models such as PCA-LR. We have developed a novel 3D asynchronous correlation method (3D-ACM) designed for the classification and identification of Chinese handmade paper samples using Raman spectra and machine learning. The 3D-ACM approach involves two rounds of tensor product and Hilbert transform operations. In the tensor product process, the outer product of the spectral data from different samples within the same category is computed, establishing inner connections among all samples within that category. The Hilbert transform introduces a 90-degree phase shift, resulting in a true three-dimensional spectral data structure. This expansion significantly increases the number of equivalent frequency points and samples within each category. This enhancement substantially boosts spectral resolution and reveals more hidden information within the spectral data. To maximize the potential of 3D-ACM, we employed six machine learning models: principal component analysis (PCA) with linear regression (LR), support vector machine (SVM) with LR, k-Nearest Neighbors (KNN), random forest (RF), and convolutional neural network (CNN). When applied to the 3D-ACM data preprocessing method, R-squared values of PLS-LR, KNN, RF and CNN supervised models, approached or equaled 1. This indicates exceptional performance comparable to unsupervised models like PCA. 3D-ACM stands as a versatile mathematical technique not confined to spectral data. It also eliminates the necessity for additional experimental setups or external control conditions, distinct from traditional two-dimensional correlation spectroscopy. Moreover, it preserves the original experimental data, setting it apart from conventional data preprocessing methods. This positions 3D-ACM as a promising tool for future material classification and identification in conjunction with machine learning. [ABSTRACT FROM AUTHOR]

10.3390/rs13214334 7 Park S.-H., Yoo J., Son D., Kim J., Jung H.-S. Improved Calibration of Wind Estimates from Advanced Scatterometer MetOp-B in Korean Seas Using Deep Neural Network. Lee and Choi [[4]] proposed a daytime cloud detection algorithm using a multi-temporal Geostationary Korea Multi-Purpose Satellite 2A (GEO-KOMPSAT-2A, GK-2A) dataset. 10.3390/rs13214282 9 Park S.-H., Jung H.-S., Lee S., Kim E.-S. Mapping Forest Vertical Structure in Sogwang-ri Forest from Full-Waveform Lidar Point Clouds Using Deep Neural Network. [Extracted from the article]

Microfluidic paper-based analytical devices (μPADs) have been widely used in point-of-care testing owing to their simple operation, low volume of the sample required, and the lack of the need for an external force. To obtain accurate semi-quantitative or quantitative results, μPADs need to respond to the challenges posed by differences in reaction conditions. In this paper, multi-layer μPADs are fabricated by the imprinting method for the colorimetric detection of C-reactive protein (CRP). Different lighting conditions and shooting angles of scenes are simulated in image acquisition, and the detection-related performance of μPADs is improved by using a machine learning algorithm. The You Only Look Once (YOLO) model is used to identify the areas of reaction in μPADs. This model can observe an image only once to predict the objects present in it and their locations. The YOLO model trained in this study was able to identify all the reaction areas quickly without incurring any error. These reaction areas were categorized by classification algorithms to determine the risk level of CRP concentration. Multi-layer perceptron, convolutional neural network, and residual network algorithms were used for the classification tasks, where the latter yielded the highest accuracy of 96%. It has a promising application prospect in fast recognition and analysis of μPADs. [ABSTRACT FROM AUTHOR]

Raman spectroscopy is an effective method for diagnosing the aging state of transformer oil-paper insulation. Aiming at overcoming the drawback of previous methods that require a large number of training samples, this research proposes a method for aging diagnosis of oil-paper insulation that can be used for few-shot learning. In this study, different Raman spectroscopy samples of aging insulating oil are obtained by accelerated thermal aging experiments. This paper uses identity matrix as node feature, calculates the connection weights between them by Gaussian kernel function, and constructs the graph structure of Raman spectroscopy library. Using graph convolutional neural network (GCN) based on the graph structure, a diagnosis model is established. The diagnostic accuracy rate is as high as 95.5%. This method provides a theoretical basis for establishing a new structured Raman spectroscopy library and assessing the aging state of transformer oil-paper insulation with a small number of training samples. [ABSTRACT FROM AUTHOR]

Detecting insulation performance through testing the Raman spectroscopy of transformer oil is noninvasive and shows great promise in on-site diagnosis. The information, stored in spectra, that may reflect aging states of insulation aims to be effectively unfolded and provides decision support as well. In this article, a transformation method based on intrinsic product arithmetic is used to transform the 1-D Raman spectral data into 2-D image data. With the help of CNN based on the dimensionality expanding method, diagnosis of oil–paper insulation with different aging states based on the Raman spectroscopy was realized. The network-based oil–paper insulation aging diagnosis model has an accuracy of 95% in ten aging categories of 60 test samples and 100% in four aging categories. The result shows the trained CNN was able to identify the differences of transformer oil samples at each aging stage through visualized Raman spectral image. This method provides a more accurate determination method for diagnosing oil-immersed transformers’ aging conditions; it also develops an available method for a more detailed evaluation of insulation aging levels. [ABSTRACT FROM AUTHOR]

This paper presents a convolutional neural network (CNN) to classify between the conventionally and organically cultivated Memecik varieties of green olives. The image forming method called the rising paper chromatography is utilized in preparing the images of Memecik varieties of green olives for CNN. In the rising chromatography method, 20, 30, and 40% sample concentrations were determined as the suitable concentrations for both organic and conventional olives. The concentrations of AgNO3 and FeSO4 were determined as 0.25, 0.5, 0.75 and 1% for both conventional and organic samples. The visual differences used for differentiation of different types of Memecik green olives are usually determined according to the regional color differences, the vivid color occurrence, the width and the frequency of bowl occurrence, the thin line, and the picks at drop zone by the expert assessors. The testing results in this study verified the effectiveness of the CNN methodology in differentiating between the organically and conventionally cultivated Memecik green olives. The newly designed neural network achieved 100% accuracy. Furthermore, this high accuracy achieved by CNN might suggest that it can be effectively used in place of the expert assessors. [ABSTRACT FROM AUTHOR]

Municipal papers and polyethylene terephthalate (PET) wastes are primary constituents of municipal solid waste (MSW) which necessitates effective disposal. Co-pyrolysis is an efficient transformation technology for the production of valuable gas and liquid fuels. Therefore, co-pyrolysis characteristics, kinetics, gas and liquid products of cellulose and PET mixtures were investigated in a two-stage reactor by multiple characterizations coupling with deep learning approach. The results indicated that there exhibited positive interaction for cellulose and PET co-pyrolysis in terms of mass difference (δ m) and mass loss rate difference (δ r) between experimental and calculated values. The thermal decomposition process and synergistic effects (δ m and δ r) were accurately predicted by deep learning approaches (R 2 =0.9823–0.9993) using temperature, catalyst, mixing ratio and heating rate variables. Feature importance revealed that the temperature, catalyst, heating rate and mixing ratio were in the descending order to affect the remaining mass from TG curves. And the temperature played a predominant role in synergistic effects. The Flynn-Wall-Ozawa (FWO) method was more suitable for fitting the pyrolysis process to obtain activation energy (E a) with higher R 2 (0.94714–0.99640) compared with Kissinger-Akahira-Sunose (KAS) method. When the mixing ratio of cellulose and PET was 1:1, the E a was significantly reduced to 80.73 KJ/mol, and further reduced to 73.04 KJ/mol by introducing the catalyst, as compared to E a of individual cellulose (178.95 KJ/mol) and PET (198.34 KJ/mol). Co-pyrolysis of cellulose and PET led to a reduction of carbohydrates, furans, alcohols, ketones, and phenols, while the content of acids was remarkably increased which was consistent with the observation in FTIR that the absorption peak of C＝O became sharp and strong. The introduction of ZSM-11 resulted in an increase in aromatics and a decrease in acids content owing to aromatization and deoxygenation. This work is expected to offer beneficial guidance for the efficient disposal of MSW and the application of deep learning methods. [Display omitted] • The interactive pathway for catalytic co-pyrolysis of cellulose and PET was proposed. • The activation energy reached the lowest 73.04 KJ/mol when the mixing ratio was 1:1. • Optimized convolutional neural network predicted synergistic effects with R 2 > 0.99. • Feature importance for TG was temperature > catalyst > heating rate > mixing ratio. [ABSTRACT FROM AUTHOR]

To increase crop productivity, recognition of a plant disease is a very pivotal task. The prior identification of plant diseases helps farmers to prevent losses occurred by various types of plant diseases. Manual observation and identification of plant diseases is a very tedious task as it requires a lot of time, money, efforts etc. therefore an automated system is required that efficiently identifies plant disease in a minimum span of time without requiring much efforts. Plant disease have been identified using various techniques such as image segmentation, clustering, convolution neural network, decision trees and many more by determining the patterns of plant images based on their colour, spots, light intensity over a certain period of time by various researchers. This paper aims to portray the techniques formulate in this area. This work infers the major challenges that thus far not explored. [ABSTRACT FROM AUTHOR]

To increase crop productivity, recognition of a plant disease is a very pivotal task. The prior identification of plant diseases helps farmers to prevent losses occurred by various types of plant diseases. Manual observation and identification of plant diseases is a very tedious task as it requires a lot of time, money, efforts etc. therefore an automated system is required that efficiently identifies plant disease in a minimum span of time without requiring much efforts. Plant disease have been identified using various techniques such as image segmentation, clustering, convolution neural network, decision trees and many more by determining the patterns of plant images based on their colour, spots, light intensity over a certain period of time by various researchers. This paper aims to portray the techniques formulate in this area. This work infers the major challenges that thus far not explored. [ABSTRACT FROM AUTHOR]

Natural disasters can be unpredictable and catastrophic. Even after the event, the repercussions are prolonged due to the incompetence of disaster management strategies. To mitigate the effects of a natural hazard, disaster management teams have to rapidly come forth with innovative plans of action. To contain the damage that a disaster causes, the response time, and preparedness of a disaster management team is crucial. Having a forewarning about the nature of the disaster can prove to be beneficial for the management team. Remote/unreachable areas such as deep parts of the forests, far-flung rural areas, oceans and other hard to reach locations are at a higher risk of receiving poorer aid and response due to the lack of communication and connectivity with the rest of the world. Our paper provides a solution for this particular problem by suggesting UAV/Drones for surveillance and monitoring in these inaccessible, disaster struck areas. The drones not only monitor the situation but constantly click pictures and send them to a base station, where the images are used to collect insights about the type of disaster that has to be dealt with. The paper proposes a deep learning model based on feature concatenation for classification of disasters which can be deployed at the base station, and can receive data in the form of images from a UAV/drone hovering over the affected place. The proposed model is efficient and able to achieve a higher accuracy as compared to the leading CNN models and closely related recent works as well. [ABSTRACT FROM AUTHOR]

CNN has demonstrated remarkable performance in EEG signal detection, yet it still faces limitations in terms of global perception. Additionally, due to individual differences in EEG signals, the generalization ability of epilepsy detection models is week. To address this issue, this paper presents a cross-patient epilepsy detection method utilizing a multi-head self-attention mechanism. This method first utilizes Short-Time Fourier Transform (STFT) to transform the original EEG signals into time-frequency features, then models local information using Convolutional Neural Network (CNN), subsequently captures global dependency relationships between features using the multi-head self-attention mechanism of Transformer, and finally performs epilepsy detection using these features. Meanwhile, this model employs a light multi-head attention mechanism module with an alternating structure, which can comprehensively extract multi-scale features while significantly reducing computational costs. Experimental results on the CHB-MIT dataset show that the proposed model achieves accuracy, sensitivity, specificity, F1 score, and AUC of 92.89%, 96.17%, 92.99%, 94.41%, and 96.77%, respectively. Compared to the existing methods, the method proposed in this paper obtains better performance along with better generalization. [ABSTRACT FROM AUTHOR]

Offshore wind-hydrogen systems operate in harsh marine environments for extended periods, posing risks of low accessibility and high failure rates. This paper proposes a data-driven fault detection framework for offshore wind-hydrogen systems, aiming to promptly detect potential faults based on the system's physical parameters. The research establishes a comprehensive model based on the operating principles of offshore wind-hydrogen systems. The study uses fault injection techniques to simulate common partial faults in offshore wind-hydrogen systems and collects relevant physical parameters (such as wind turbine power generation, energy storage battery charging/discharging current, and electrolyzer hydrogen production rate). A fault detection model was constructed using a combination of Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to enable precise detection of potential faults in the system. The established model provides theoretical support for designing, optimizing, and operating offshore wind-hydrogen systems, reducing reliance on actual experiments and lowering project risks and costs. Introducing artificial faults can evaluate the system's performance in different fault scenarios. This paper proposes a CNN-BiLSTM fault detection method that achieves automatic feature extraction and high-precision classification of time-series fault data, confirming the practicality and feasibility of offshore wind-hydrogen systems. This investigation realizes the integration of the offshore wind-hydrogen system model and deep learning, as well as a fully automated learning process from data to fault detection. By calculating and comparing results, it is verified that the framework has a high accuracy of 96.9%. This innovative research offers new methods and perspectives for enhancing the reliability and efficiency of fault detection in offshore wind-hydrogen systems. • A comprehensive multi-system simulation model for offshore wind-hydrogen systems is established. • Fault injection is employed to acquire data samples for offshore wind-hydrogen systems. • Utilizing the CNN-BiLSTM method, a high-accuracy deep learning fault detection model is crafted. • A simulation model-based data-driven deep learning framework for fault detection is devised in this study. [ABSTRACT FROM AUTHOR]

Visual information is important in final approach and landing phases for an approaching aircraft, it presents supplementary source for navigation system, and provides backup guidance when radio navigation fails, or even supports a complete vision‐based landing. Relative position and attitude can be solved from the runway features in the image. Traditional runway detection methods have high latency and low accuracy, which is unable to satisfy the requirements for a safe landing. This paper proposes a real‐time runway detection model, efficient runway feature extractor (ERFE), based on deep convolutional neural network, generating semantic segmentation and feature lines output. In order to evaluate the model's effectiveness, a benchmark is proposed to calculate the actual error between predicted feature line and ground truth one. A novel runway dataset which is based on pictures from Microsoft Flight Simulator 2020 (FS2020), is also proposed in this paper to train and test the model. The dataset will be released at https://www.kaggle.com/datasets/relufrank/fs2020‐runway‐dataset. ERFE shows excellent performance in FS2020 dataset, it gives satisfactory results even for real runway images excluded from our dataset. [ABSTRACT FROM AUTHOR]

Segmentation is crucial in diagnosing retinal diseases by accurately identifiying retinal vessels. This paper addresses the complexity of segmenting retinal vessels, highlighting the need for precise analysis of blood vessel structures. Despite the progress made by convolutional neural networsks (CNNs) in image segmentation, their limitations in capturing the global structure of retinal vsessels and maintaining segmentation continuity present challenges. To tackle these issues, our proposed network integrates graph convolutional networks (GCNs) and attention mechansims. This allows the model to consider pixel relationships and learn vessel graphical structures, significantly improving segmentation accuracy. Additionally, the attentional feature fusion module, including pixel‐wise and channel‐wise attention mechansims within the U‐Net architecture, refines the model's focus on relevant features. This paper emphasizes the importance of continuty preservation, ensuring an accurate representation of pixel‐level information and structural details during sefmentation. Therefore, our method performs as an effective solution to overcome challenges in retinal vessel segmentation. The proposed method outperformed the state‐of‐the‐art approaches on DRIVE (Digital Retinal Images for Vessel Extraction) and STARE (Structed Analysis of the Retina) datasets with accuracies of 0.12% and 0.14%, respecttively. Importantly, our proposed approach excelled in delineating slender and diminutive blood vessels, crucial for diagnosing vascular‐related diseases. Implementation is accessible on https://github.com/CVLab‐SHUT/VGA‐Net. [ABSTRACT FROM AUTHOR]

With the aim of solving the problem of identifying complex underwater acoustic targets using a single signal feature in the Time–Frequency (TF) feature, this paper designs a method that recognizes the underwater targets based on the Delay-Doppler joint feature. First, this method uses symplectic finite Fourier transform (SFFT) to extract the Delay-Doppler features of underwater acoustic signals, analyzes the Time–Frequency features at the same time, and combines the Delay-Doppler (DD) feature and Time–Frequency feature to form a joint feature (TF-DD). This paper uses three types of convolutional neural networks to verify that TF-DD can effectively improve the accuracy of target recognition. Secondly, this paper designs an object recognition model (TF-DD-CNN) based on joint features as input, which simplifies the neural network's overall structure and improves the model's training efficiency. This research employs ship-radiated noise to validate the efficacy of TF-DD-CNN for target identification. The results demonstrate that the combined characteristic and the TF-DD-CNN model introduced in this study can proficiently detect ships, and the model notably enhances the precision of detection. [ABSTRACT FROM AUTHOR]

In order to accurately estimate the period of X-ray pulsars to improve navigation performance, this paper proposes a pulsar period estimation method based on photon energy using reverse Hilbert coding and double Convolutional Neural Networks (CNNs) discrimination. This method uses photon energy information to perform epoch folding. It converts one-dimensional contour information into two-dimensional image signals through reverse Hilbert curve and recognizes contour image features through CNN models to determine the optimal period. According to the simulation results, the period estimation accuracy of this method is 0.5350 ns, which is 65.71% higher than the χ 2 epoch folding method. The contour phase accuracy is 0.0004767, which is 41.93% higher than the χ 2 epoch folding method. At the same time, the observation time and noise interference that may affect the accuracy of period estimation are also quantitatively analyzed. In addition, in order to simulate real navigation scenarios, this paper also conducts dynamic period estimation experiments on PSR B0531+21 pulsar in a specific period of time. The method proposed in this paper has the advantages of high precision, fast calculation speed, strong anti-interference ability and accurate dynamic period estimation, which can significantly improve the navigation performance of X-ray pulsars. • The proposed period estimation method uses photon energy information for contour weighted folding. • The proposed method uses reverse Hilbert curve to convert one-dimensional contour information into two-dimensional image information. • Convolutional Neural Network models are used to optimize pulsar period estimation. [Display omitted] [ABSTRACT FROM AUTHOR]

Segmentation of whole slide histological images through the classification of tissue types of small fragments is an extremely relevant task in digital pathology, necessary for the development of methods for automatic analysis of whole slide histological images. The extremely large resolution of such images also makes the task of increasing image resolution relevant, which allows storing images at a reduced resolution and increasing it if necessary. Annotating whole slide images by histologists is complex and time-consuming, so it is important to make the most efficient use of the available data, both labeled and unlabeled. In this paper we propose a novel neural network method to simultaneously solve the problems of super-resolution of histological images from ×20 optical magnification to ×40 and classifying image fragments into tissue types at ×20 magnification. The use of a single encoder as well as the proposed neural network training scheme allows to achieve better results on both tasks compared to existing approaches. The PATH-DT-MSU WSS2v2 dataset presented for the first time in this paper was used for training and testing the method. On the test sample, an accuracy value of 0.971 and a balanced accuracy value of 0.916 were achieved in the classification task on 5 tissue types, for the super-resolution task, values of PSNR = 32.26 and SSIM = 0.89 were achieved. The source code of the proposed method is available at: https://github.com/Kukty/WSI_SR_CL. [ABSTRACT FROM AUTHOR]

Convolutional Neural Networks (CNNs) are a kind of artificial neural network designed to extract features and find out patterns for tasks such as segmentation, recognizing objects, and drawing up classification. Within a CNNs architecture, pooling operations are used until the number of parameters and the computational complexity are reduced. Numerous papers have focused on investigating the impact of pooling on the performance of Convolutional Neural Networks (CNNs), leading to the development of various pooling models. Recently, a fuzzy pooling operation based on type-1 fuzzy sets was introduced to cope with the local imprecision of the feature maps. However, in fuzzy set theory, it is not always accurate to assume that the degree of non-membership of an element in a fuzzy set is simply the complement of the degree of membership. This is due to the potential existence of a hesitation degree, which implies a certain level of uncertainty. To overcome this limitation, intuitionistic fuzzy sets (IFS) were introduced to incorporate the concept of a degree of hesitation. In this paper, we introduce a novel pooling operation based on intuitionistic fuzzy sets to incorporate the degree of hesitation heretofore neglected by a fuzzy pooling operation based on classical fuzzy sets, and we investigate its performance in the context of image classification. Intuitionistic pooling is performed in four steps: bifuzzification (by the transformation of data through the use of membership and non-membership maps), first aggregation (through the transformation of the IFS into a standard fuzzy set, second aggregation (through the transformation and use of a sum operator), and the defuzzification of feature map neighborhoods by using a max operator. IFS pooling is used for the construction of an intuitionistic pooling layer that can be applied as a drop-in replacement for the current, fuzzy (type-1) and crisp, pooling layers of CNN architectures. Various experiments involving multiple datasets demonstrate that an IFS-based pooling can enhance the classification performance of a CNN. A benchmarking study reveals that this significantly outperforms even the most recent pooling models, especially in stochastic environments. [ABSTRACT FROM AUTHOR]

In the context of the Internet of Things, there is a growing demand for real-time monitoring of water distribution systems (WDS). Among the various leak detection methods, acoustic leak detection is considered to be a suitable method. However, existing methods are not very effective in environments with high daytime ambient noise. To address this issue, this paper conducted on-site data collection experiments and designed a monitoring system that combines traditional nighttime monitoring with daytime monitoring, combining water company pipeline inspections and repair work. A large number of daytime audio samples were collected. In this paper, the logarithmic spectrogram (log spectrogram) was used to represent the features of the leak signal. By comparing the features of the signal during day and night, noisy and quiet environments, and leak and normal signals, we identified the interfering frames that required noise reduction, and applied frame-level noise reduction processing to the signal. Based on this, a log PS-ResNet18 model was developed to identify leaks, and its performance was compared with other classification models [including traditional nighttime detection methods, random forests, XGBoost, and convolutional neural network (CNN)]. The results showed that the log PS-ResNet18 model had the best performance, with an all-day accuracy rate of 99.4% and a daytime accuracy rate of 99.3%. In addition, by conducting ablation experiments to explore the role and contribution of the log PS-ResNet18 and noise reduction methods in the model, the results showed that the log spectrogram and noise reduction methods increased the all-day accuracy rate by 18.8% and 23.2%, respectively, and by 24.7% when used together. In another practical application, the log PS-ResNet18 model achieved an all-day detection accuracy rate of 99.6%. This study demonstrated the applicability of the log spectrogram and CNN combination in daytime leak detection, overcoming research limitations in the field. This research presents the log PS-ResNet18 framework, which combines deep learning models and denoised logarithmic spectrograms to improve leak detection in water supply pipelines under daytime environmental noise. The research focuses on field data collection and analysis of cast iron pipes with different diameters in Hangzhou (HZ). The model was tested on cast iron pipes in Lishui (LS) and proved to be effective. The proposed method is highly versatile and can be applied to different regions and pipe materials after sufficient sample collection and model training validation. The research recommends a comprehensive leak monitoring solution that involves initial intelligent detection using front-end noise meters and secondary identification of suspicious audio signals using the log PS-ResNet18 model in the cloud. This enables water utility operators to respond quickly to pipeline leaks, leading to more efficient water resource conservation and improved water supply service quality. [ABSTRACT FROM AUTHOR]

Sign language is an essential means of communication for individuals with hearing disabilities. However, there is a significant shortage of sign language interpreters in some languages, especially in Saudi Arabia. This shortage results in a large proportion of the hearing-impaired population being deprived of services, especially in public places. This paper aims to address this gap in accessibility by leveraging technology to develop systems capable of recognizing Arabic Sign Language (ArSL) using deep learning techniques. In this paper, we propose a hybrid model to capture the spatio-temporal aspects of sign language (i.e., letters and words). The hybrid model consists of a Convolutional Neural Network (CNN) classifier to extract spatial features from sign language data and a Long Short-Term Memory (LSTM) classifier to extract spatial and temporal characteristics to handle sequential data (i.e., hand movements). To demonstrate the feasibility of our proposed hybrid model, we created a dataset of 20 different words, resulting in 4000 images for ArSL: 10 static gesture words and 500 videos for 10 dynamic gesture words. Our proposed hybrid model demonstrates promising performance, with the CNN and LSTM classifiers achieving accuracy rates of 94.40% and 82.70%, respectively. These results indicate that our approach can significantly enhance communication accessibility for the hearing-impaired community in Saudi Arabia. Thus, this paper represents a major step toward promoting inclusivity and improving the quality of life for the hearing impaired. [ABSTRACT FROM AUTHOR]

This paper addresses issues concerning biometric authentication based on handwritten signatures. Our research aimed to check whether a handwritten signature acquired with a mobile device can effectively verify a user's identity. We present a novel online signature verification method using coordinates of points and pressure values at each point collected with a mobile device. Convolutional neural networks are used for signature verification. In this paper, three neural network models are investigated, i.e., two self-made light SigNet and SigNetExt models and the VGG-16 model commonly used in image processing. The convolutional neural networks aim to determine whether the acquired signature sample matches the class declared by the signer. Thus, the scenario of closed set verification is performed. The effectiveness of our method was tested on signatures acquired with mobile phones. We used the subset of the multimodal database, MobiBits, that was captured using a custom-made application and consists of samples acquired from 53 people of diverse ages. The experimental results on accurate data demonstrate that developed architectures of deep neural networks can be successfully used for online handwritten signature verification. We achieved an equal error rate (EER) of 0.63% for random forgeries and 6.66% for skilled forgeries. [ABSTRACT FROM AUTHOR]

Emotion recognition has become increasingly important in the field of Deep Learning (DL) and computer vision due to its broad applicability by using human–computer interaction (HCI) in areas such as psychology, healthcare, and entertainment. In this paper, we conduct a systematic review of facial and pose emotion recognition using DL and computer vision, analyzing and evaluating 77 papers from different sources under Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Our review covers several topics, including the scope and purpose of the studies, the methods employed, and the used datasets. The scope of this work is to conduct a systematic review of facial and pose emotion recognition using DL methods and computer vision. The studies were categorized based on a proposed taxonomy that describes the type of expressions used for emotion detection, the testing environment, the currently relevant DL methods, and the datasets used. The taxonomy of methods in our review includes Convolutional Neural Network (CNN), Faster Region-based Convolutional Neural Network (R-CNN), Vision Transformer (ViT), and "Other NNs", which are the most commonly used models in the analyzed studies, indicating their trendiness in the field. Hybrid and augmented models are not explicitly categorized within this taxonomy, but they are still important to the field. This review offers an understanding of state-of-the-art computer vision algorithms and datasets for emotion recognition through facial expressions and body poses, allowing researchers to understand its fundamental components and trends. [ABSTRACT FROM AUTHOR]

With the continuous development of automotive intelligence, vehicle occupant detection technology has received increasing attention. Despite various types of research in this field, a simple, reliable, and highly private detection method is lacking. This paper proposes a method for vehicle occupant detection using millimeter-wave radar. Specifically, the paper outlines the system design for vehicle occupant detection using millimeter-wave radar. By collecting the raw signals of FMCW radar and applying Range-FFT and DoA estimation algorithms, a range–azimuth heatmap was generated, visually depicting the current status of people inside the vehicle. Furthermore, utilizing the collected range–azimuth heatmap of passengers, this paper integrates the Faster R-CNN deep learning networks with radar signal processing to identify passenger information. Finally, to test the performance of the detection method proposed in this article, an experimental verification was conducted in a car and the results were compared with those of traditional machine learning algorithms. The findings indicated that the method employed in this experiment achieves higher accuracy, reaching approximately 99%. [ABSTRACT FROM AUTHOR]

Radio frequency interference (RFI) significantly hampers the target detection performance of frequency-modulated continuous-wave radar. To address the problem and maintain the target echo signal, this paper proposes a priori assumption on the interference component nature in the radar received signal, as well as a method for interference estimation and mitigation via time–frequency analysis. The solution employs Fourier synchrosqueezed transform to implement the radar's beat signal transformation from time domain to time–frequency domain, thus converting the interference mitigation to the task of time–frequency distribution image restoration. The solution proposes the use of image processing based on the dual-tree complex wavelet transform and combines it with the spatial domain-based approach, thereby establishing a dual-domain fusion interference filter for time–frequency distribution images. This paper also presents a convolutional neural network model of structurally improved UNet++, which serves as the interference estimator. The proposed solution demonstrated its capability against various forms of RFI through the simulation experiment and showed a superior interference mitigation performance over other CNN model-based approaches. [ABSTRACT FROM AUTHOR]

Global Navigation Satellite Systems (GNSS) offer comprehensive position, navigation, and timing (PNT) estimates worldwide. Given the growing demand for reliable location awareness in both indoor and outdoor contexts, the advent of fifth-generation mobile communication technology (5G) has enabled expansive coverage and precise positioning services. However, the power received by the signal of interest (SOI) at terminals is notably low. This can lead to significant jamming, whether intentional or unintentional, which can adversely affect positioning receivers. The diagnosis of jamming types, such as classification, assists receivers in spectrum sensing and choosing effective mitigation strategies. Traditional jamming diagnosis methodologies predominantly depend on the expertise of classification experts, often demonstrating a lack of adaptability for diverse tasks. Recently, researchers have begun utilizing convolutional neural networks to re-conceptualize a jamming diagnosis as an image classification issue, thereby augmenting recognition performance. However, in real-world scenarios, the assumptions of independent and homogeneous distributions are frequently violated. This discrepancy between the source and target distributions frequently leads to subpar model performance on the test set or an inability to procure usable evaluation samples during training. In this paper, we introduce LJCD-Net, a deep adversarial migration-based cross-domain jamming generalization diagnostic network. LJCD-Net capitalizes on a fully labeled source domain and multiple unlabeled auxiliary domains to generate shared feature representations with generalization capabilities. Initially, our paper proposes an uncertainty-guided auxiliary domain labeling weighting strategy, which estimates the multi-domain sample uncertainty to re-weight the classification loss and specify the gradient optimization direction. Subsequently, from a probabilistic distribution standpoint, the spatial constraint imposed on the cross-domain global jamming time-frequency feature distribution facilitates the optimization of collaborative objectives. These objectives include minimizing both the source domain classification loss and auxiliary domain classification loss, as well as optimizing the inter-domain marginal probability and conditional probability distribution. Experimental results demonstrate that LJCD-Net enhances the recognition accuracy and confidence compared to five other diagnostic methods. [ABSTRACT FROM AUTHOR]

Listening to music is a crucial tool for relieving stress and promoting relaxation. However, the limited options available for stress-relief music do not cater to individual preferences, compromising its effectiveness. Traditional methods of curating stress-relief music rely heavily on measuring biological responses, which is time-consuming, expensive, and requires specialized measurement devices. In this paper, a deep learning approach to solve this problem is introduced that explicitly uses convolutional neural networks and provides a more efficient and economical method for generating large datasets of stress-relief music. These datasets are composed of Mel-scaled spectrograms that include essential sound elements (such as frequency, amplitude, and waveform) that can be directly extracted from the music. The trained model demonstrated a test accuracy of 98.7%, and a clinical study indicated that the model-selected music was as effective as researcher-verified music in terms of stress-relieving capacity. This paper underlines the transformative potential of deep learning in addressing the challenge of limited music options for stress relief. More importantly, the proposed method has profound implications for music therapy because it enables a more personalized approach to stress-relief music selection, offering the potential for enhanced emotional well-being. [ABSTRACT FROM AUTHOR]

Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out. [ABSTRACT FROM AUTHOR]

Delamination represents one of the most significant and dangerous damages in composite plates. Recently, many papers have presented the capability of structural health monitoring (SHM) techniques for the investigation of structural delamination with various shapes and thickness depths. However, few studies have been conducted regarding the utilization of convolutional neural network (CNN) methods for automating the non-destructive testing (NDT) techniques database to identify the delamination size and depth. In this paper, an automated system qualified for distinguishing between pristine and damaged structures and classifying three classes of delamination with various depths is presented. This system includes a proposed CNN model and the Lamb wave technique. In this work, a unidirectional composite plate with three samples of delamination inserted at different depths was prepared for numerical and experimental investigations. In the numerical part, the guided wave propagation and interaction with three samples of delamination were studied to observe how the delamination depth can affect the scattered and trapped waves over the delamination region. This numerical study was validated experimentally using an efficient ultrasonic guided waves technique. This technique involved piezoelectric wafer active sensors (PWASs) and a scanning laser Doppler vibrometer (SLDV). Both numerical and experimental studies demonstrate that the delamination depth has a direct effect on the trapped waves' energy and distribution. Three different datasets were collected from the numerical and experimental studies, involving the numerical wavefield image dataset, experimental wavefield image dataset, and experimental wavenumber spectrum image dataset. These three datasets were used independently with the proposed CNN model to develop a system that can automatically classify four classes (pristine class and three different delamination classes). The results of all three datasets show the capability of the proposed CNN model for predicting the delamination depth with high accuracy. The proposed CNN model results of the three different datasets were validated using the GoogLeNet CNN. The results of both methods show an excellent agreement. The results proved the capability of the wavefield image and wavenumber spectrum datasets to be used as input data to the CNN for the detection of delamination depth. [ABSTRACT FROM AUTHOR]

COVID‐19 has been ravaging the world for a long time, and although its effects are currently the same as those of a cold or a fever, timely diagnosis of COVID‐19 in the elderly and in patients with related illnesses is still a matter of great urgency. To address this challenge, we propose a model that combines the strengths of the Swin Transformer and ResNet34 architectures to efficiently diagnose COVID‐19 in elderly and vulnerable patients. In this paper, we design a model that integrates Swin transformer and resnet34, which not only integrates the advantages of transformer and CNN but also achieves excellent performance in this image classification problem. Moreover, a pre‐processing method is also proposed to increase the accuracy of the model to 99.08%. In this paper, experiments were conducted on Kaggle's publicly available three‐classification and four‐classification datasets, respectively, and on the three main evaluation metrics of Accuracy, Precision, and Recall, the first dataset obtained 98.81%, 99.49%, and 97.99%, while the second dataset obtained 88.82%, 88.92%, and 86.38%. These findings highlight the validity and potential of our proposed model for diagnosing the presence or absence of COVID‐19 in elderly and vulnerable patients. [ABSTRACT FROM AUTHOR]

The models based on convolutional neural network have achieved excellent results in image super-resolution by acquiring prior knowledge from a large number of images, but such models still have problems such as the features between layers in the depth network cannot be effectively fused, the number of parameters is too large, and cross-channel feature learning is impossible. Based on this, a deep recursive residual channel attention network (DRRCAN) model was proposed in this paper. To solve the problem that the information between different layers in the deep network cannot be fused effectively, this paper constructs a channel feature fusion module, which can effectively fuse the feature information of different layers. To solve the problem that the parameters increase sharply due to the increase of network depth, recursive blocks are adopted in this paper, which greatly reduces the number of parameters in the deep network. The channel attention is integrated to enable the model to learn features across channels. In addition, to avoid gradient explosion or disappearance, residual modules, long skip connections are introduced to improve the stability and generalization ability of the model. Extensive benchmark evaluations validate the superiority of the proposed DRRCAN model compared with existing algorithms. [ABSTRACT FROM AUTHOR]

In recent years, deep convolutional neural networks (DCNNs) have shown promising performance in medical image analysis, including breast lesion classification in 2D ultrasound (US) images. Despite the outstanding performance of DCNN solutions, explaining their decisions remains an open investigation. Yet, the explainability of DCNN models has become essential for healthcare systems to accept and trust the models. This paper presents a novel framework for explaining DCNN classification decisions of lesions in ultrasound images using the saliency maps linking the DCNN decisions to known cancer characteristics in the medical domain. The proposed framework consists of three main phases. First, DCNN models for classification in ultrasound images are built. Next, selected methods for visualization are applied to obtain saliency maps on the input images of the DCNN models. In the final phase, the visualization outputs and domain-known cancer characteristics are mapped. The paper then demonstrates the use of the framework for breast lesion classification from ultrasound images. We first follow the transfer learning approach and build two DCNN models. We then analyze the visualization outputs of the trained DCNN models using the EGrad-CAM and Ablation-CAM methods. We map the DCNN model decisions of benign and malignant lesions through the visualization outputs to the characteristics such as echogenicity, calcification, shape, and margin. A retrospective dataset of 1298 US images collected from different hospitals is used to evaluate the effectiveness of the framework. The test results show that these characteristics contribute differently to the benign and malignant lesions' decisions. Our study provides the foundation for other researchers to explain the DCNN classification decisions of other cancer types. [ABSTRACT FROM AUTHOR]

A pipeline is critical in conveying water, oil, gas, petrochemicals, and slurry. As the pipeline ages and corrodes, it becomes susceptible to deterioration, resulting in wastage and hazardous damages depending on the material it transports. To mitigate these risks, implementing a suitable monitoring system becomes essential, enabling the early identification of damage and minimizing waste and the potential for hazardous incidents. The pipeline monitoring system can be exterior, visual/biological, and computational. This paper surveys state-of-the-art approaches and also performs experimental analyses with a few methods in signal/data-driven approaches within computational methods. More precisely, signal processing-based leak localization methods, artificial intelligence-based leak detection methods, and combined approaches are given. This paper implements five signal processing-based methods and 17 artificial intelligence-based methods. This implementation helps to compare and understand the significance of appropriate noise removal and feature extraction. The data for this analysis is collected using acousto-optic sensors from an experimental setup. After implementation, the highest observed leak localization accuracy is 99.14% with the wavelet packet adaptive independent component analysis-based generalized cross correlation, and the highest leak detection accuracy is 98.32% with the one-dimensional convolutional neural network. [ABSTRACT FROM AUTHOR]

Incorporating style-related objectives into shape design has been centrally important to maximize product appeal. However, algorithmic style capture and reuse have not fully benefited from automated data-driven methodologies due to the challenging nature of design describability. This paper proposes an AI-driven method to fully automate the discovery of brand-related features. First, to tackle the scarcity of vectorized product images, this research proposes two data acquisition workflows: parametric modeling from small curve-based datasets, and vectorization from large pixel-based datasets. Second, this study constructs BIGNet, a two-tier Brand Identification Graph Neural Network, to learn from both scalar vector graphics' curve-level and chunk-level parameters. In the first case study, BIGNet not only classifies phone brands but also captures brand-related features across multiple scales, such as lens' location, as confirmed by AI evaluation. In the second study, this paper showcases the generalizability of BIGNet learning from a vectorized car image dataset and validates the consistency and robustness of its predictions given four scenarios. The results match the difference commonly observed in luxury versus economy brands in the automobile market. Finally, this paper also visualizes the activation maps generated from a convolutional neural network and shows BIGNet's advantage of being a more explainable style-capturing agent. [ABSTRACT FROM AUTHOR]

The fetal electrocardiogram (FECG) records changes in the graph of fetal cardiac action potential during conduction, reflecting the developmental status of the fetus in utero and its physiological cardiac activity. Morphological alterations in the FECG can indicate intrauterine hypoxia, fetal distress, and neonatal asphyxia early on, enhancing maternal and fetal safety through prompt clinical intervention, thereby reducing neonatal morbidity and mortality. To reconstruct FECG signals with clear morphological information, this paper proposes a novel deep learning model, CBLS-CycleGAN. The model's generator combines spatial features extracted by the CNN with temporal features extracted by the BiLSTM network, thus ensuring that the reconstructed signals possess combined features with spatial and temporal dependencies. The model's discriminator utilizes PatchGAN, employing small segments of the signal as discriminative inputs to concentrate the training process on capturing signal details. Evaluating the model using two real FECG signal databases, namely "Abdominal and Direct Fetal ECG Database" and "Fetal Electrocardiograms, Direct and Abdominal with Reference Heartbeat Annotations", resulted in a mean MSE and MAE of 0.019 and 0.006, respectively. It detects the FQRS compound wave with a sensitivity, positive predictive value, and F1 of 99.51%, 99.57%, and 99.54%, respectively. This paper's model effectively preserves the morphological information of FECG signals, capturing not only the FQRS compound wave but also the fetal P-wave, T-wave, P-R interval, and ST segment information, providing clinicians with crucial diagnostic insights and a scientific foundation for developing rational treatment protocols. [ABSTRACT FROM AUTHOR]

This document is an editorial for a special issue titled "Machine Learning in Computer Vision and Image Sensing: Theory and Applications." The editorial highlights the diverse applications of machine learning (ML) models in various domains such as medical imaging, signal processing, remote sensing, and human activity detection. The special issue includes 11 papers that cover topics such as image segmentation, fluvial navigation, Alzheimer's disease classification, pneumothorax detection, lung cancer malignancy prediction, amniotic fluid volume detection, COVID-19 detection, and Parkinson's disease detection. The papers showcase the progress and potential of ML models in computer vision applications and provide valuable insights for future research. [Extracted from the article]