Search

Document forgery is a significant issue in Korea, with around ten thousand cases reported every year. Analyzing paper plays a crucial role in examining questionable documents such as marketable securities and contracts, which can aid in solving criminal cases of document forgery. Paper analysis can also provide essential insights in other types of criminal cases, serving as an important clue for solving cases such as the source of a blackmail letter. The papermaking process generates distinct forming fabric marks and formations, which are critical features for paper classification. These characteristics are observable under transmitted light and are created by the forming fabric pattern and the distribution of pulp fibers, respectively. In this study, we propose a novel approach for paper identification based on hybrid features. This method combines texture features extracted from images converted using the gray‐level co‐occurrence matrix (GLCM) approach and a convolutional neural network (CNN), with another set of features extracted by the CNN using the same images as input. We applied the proposed method to classification tasks for seven major paper brands available in the Korean market, achieving an accuracy of 97.66%. The results confirm the applicability of this method for visually inspecting paper products and demonstrate its potential for assisting in solving criminal cases involving document forgery. [ABSTRACT FROM AUTHOR]

Since deep low‐frequency tremors are considered to be associated with large earthquakes that occur adjacently on the same subducting plate interface, it is important to investigate tremors that occurred before the establishment of modern seismograph networks such as the High Sensitivity Seismograph Network (Hi‐net). We propose a deep‐learning solution to detect evidence of tremors in scanned images of paper seismogram records from over 50 years ago. In this study, we fine‐tuned a convolutional neural network (CNN) based on the Residual Network, which was pre‐trained using images of synthetic waveforms from our previous study, using a data set comprised of images generated from real seismic data recorded digitally by Hi‐net to facilitate a supervised analysis. The fine‐tuned CNN was able to predict the presence or absence of tremors in the Hi‐net images with an accuracy of 98.64%. Gradient‐weighted Class Activation Mapping heatmaps created to visualize model predictions indicated that the CNN's ability to detect tremors is not degraded by the presence of teleseisms. Once validated using the Hi‐net images, the CNN was applied to paper seismograms recorded from 1966 to 1977 at the Kumano observatory in southwest Japan, operated by Earthquake Research Institute, The University of Tokyo. The CNN showed potential for detecting tremors in scanned images of paper seismogram records from the past, facilitating downstream tasks such as the creation of new tremor catalogs. However, further training using an augmented data set to control for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Plain Language Summary: In 2002, deep low‐frequency tremors, which periodically occur with much smaller amplitudes and longer durations than common earthquakes, were discovered owing to the establishment of dense seismic arrays in Japan. These tremors are considered to be associated with megathrust earthquakes because they occur in deeper regions of plate boundaries compared with common earthquakes. Investigating tremors that occurred before the establishment of dense seismic arrays is important since megathrust earthquakes recur on intervals of 100–200 years, and digital records from modern seismic arrays cover only a fraction of that time. In this study, we developed a convolutional neural network based on the Residual Network (ResNet) that extracts tremors from images of waveforms recorded more than 50 years ago, when seismometers drew waveforms directly on drum‐rolled paper using a pen. The proposed ResNet, which was trained on seismogram images generated from synthetic waveforms and real data recorded digitally by modern seismic arrays, was applied to scanned images of paper seismograms recorded from 1966 to 1977 at an observatory in southwest Japan. A list of tremors was successfully obtained; however, further training using data that accounts for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Key Points: Convolutional neural network model for detection of deep low‐frequency tremors from seismogram images is proposedThe model trained with seismogram images converted from real seismic data successfully detects tremorsThe detection performances of the trained model for the paper records at the Kumano observatory in southwest Japan are discussed [ABSTRACT FROM AUTHOR]

Visual information is important in final approach and landing phases for an approaching aircraft, it presents supplementary source for navigation system, and provides backup guidance when radio navigation fails, or even supports a complete vision‐based landing. Relative position and attitude can be solved from the runway features in the image. Traditional runway detection methods have high latency and low accuracy, which is unable to satisfy the requirements for a safe landing. This paper proposes a real‐time runway detection model, efficient runway feature extractor (ERFE), based on deep convolutional neural network, generating semantic segmentation and feature lines output. In order to evaluate the model's effectiveness, a benchmark is proposed to calculate the actual error between predicted feature line and ground truth one. A novel runway dataset which is based on pictures from Microsoft Flight Simulator 2020 (FS2020), is also proposed in this paper to train and test the model. The dataset will be released at https://www.kaggle.com/datasets/relufrank/fs2020‐runway‐dataset. ERFE shows excellent performance in FS2020 dataset, it gives satisfactory results even for real runway images excluded from our dataset. [ABSTRACT FROM AUTHOR]

Segmentation is crucial in diagnosing retinal diseases by accurately identifiying retinal vessels. This paper addresses the complexity of segmenting retinal vessels, highlighting the need for precise analysis of blood vessel structures. Despite the progress made by convolutional neural networsks (CNNs) in image segmentation, their limitations in capturing the global structure of retinal vsessels and maintaining segmentation continuity present challenges. To tackle these issues, our proposed network integrates graph convolutional networks (GCNs) and attention mechansims. This allows the model to consider pixel relationships and learn vessel graphical structures, significantly improving segmentation accuracy. Additionally, the attentional feature fusion module, including pixel‐wise and channel‐wise attention mechansims within the U‐Net architecture, refines the model's focus on relevant features. This paper emphasizes the importance of continuty preservation, ensuring an accurate representation of pixel‐level information and structural details during sefmentation. Therefore, our method performs as an effective solution to overcome challenges in retinal vessel segmentation. The proposed method outperformed the state‐of‐the‐art approaches on DRIVE (Digital Retinal Images for Vessel Extraction) and STARE (Structed Analysis of the Retina) datasets with accuracies of 0.12% and 0.14%, respecttively. Importantly, our proposed approach excelled in delineating slender and diminutive blood vessels, crucial for diagnosing vascular‐related diseases. Implementation is accessible on https://github.com/CVLab‐SHUT/VGA‐Net. [ABSTRACT FROM AUTHOR]

COVID‐19 has been ravaging the world for a long time, and although its effects are currently the same as those of a cold or a fever, timely diagnosis of COVID‐19 in the elderly and in patients with related illnesses is still a matter of great urgency. To address this challenge, we propose a model that combines the strengths of the Swin Transformer and ResNet34 architectures to efficiently diagnose COVID‐19 in elderly and vulnerable patients. In this paper, we design a model that integrates Swin transformer and resnet34, which not only integrates the advantages of transformer and CNN but also achieves excellent performance in this image classification problem. Moreover, a pre‐processing method is also proposed to increase the accuracy of the model to 99.08%. In this paper, experiments were conducted on Kaggle's publicly available three‐classification and four‐classification datasets, respectively, and on the three main evaluation metrics of Accuracy, Precision, and Recall, the first dataset obtained 98.81%, 99.49%, and 97.99%, while the second dataset obtained 88.82%, 88.92%, and 86.38%. These findings highlight the validity and potential of our proposed model for diagnosing the presence or absence of COVID‐19 in elderly and vulnerable patients. [ABSTRACT FROM AUTHOR]

The analysis of sentiments and mining of opinions have become more and more important in years because of the development of social media technologies. The methods that utilize natural language processing and lexicon‐based sentiment analysis techniques to analyze people's opinions in texts require the proper extraction of sentiment words to ensure accuracy. The current issue is tackled with a novel perspective in this paper by introducing a hybrid sentiment analysis technique. This technique brings together Convolutional Neural Network (CNN) and Hidden Markov Models (HMMs), to accurately categorize text data and pinpoint feelings. The proposed method involves 1D convolutional‐layer CNN to extract hidden features from comments and applying HMMs on a feature‐sentence matrix, allowing for the utilization of word sequences in extracting opinions. The method effectively captures diverse text patterns by extracting a range of features from texts using CNN. Text patterns are learned using text HMM by calculating the probabilities between sequences of feature vectors and clustering feature vectors. The paper's experimental evaluation employs benchmark datasets such as CR, MR, Subj, and SST2, demonstrating that the proposed method surpasses existing sentiment analysis techniques and traditional HMMs. One of its strengths is to analyze a range of text patterns and identify crucial features that recognize the emotion of different pieces of a sentence. Additionally, the research findings highlight the improved performance of sentiment analysis tasks through the strategic use of zero padding in conjunction with the masking technique. [ABSTRACT FROM AUTHOR]

This paper designs a new facial Expression recognition network called a multi‐scale feature Fusion Convolutional neural Network (EFCN). This network is proposed to solve two problems in the facial expression recognition task. First, there are many commonalities between faces of different expression categories, and the recognition task cannot be precisely performed when the commonality is greater than the individuality. Secondly, facial detail features have a significant impact on the final results of expression recognition, while the image detail features extracted by traditional convolutional neural networks are not sufficient. In order to address the above issues, the feature enhancement network (FEN) and the detail information enhancement module (DEM) are designed. The FEN fuses deep and shallow features. Accordingly, the feature map contains richer information, making it easy to identify the samples. The DEM extracts and fuses the features passed by the backbone network with multi‐scale features to enhance the network's ability to extract features from small regions of the face. We validated the proposed method on three datasets, RAF‐DB, CK+, and JAFFE, and achieved 84.50%, 97.86%, and 91.05% accuracy, respectively, and the experimental results showed the effectiveness of the proposed method in this paper. For example, on the JAFFE dataset, the recognition accuracy of this method surpasses the MLT method by 1.87%. [ABSTRACT FROM AUTHOR]

Single image super‐resolution (SISR) has gained significant attention in image processing and computer vision, driven by deep learning‐based models like convolutional neural networks (CNN). Yet, the resource‐intensive nature of these models poses challenges when deploying them on edge devices. To address this issue, resource‐constrained models need to be developed. While recent models like the information distillation network (IDN), the information multi‐distillation network (IMDN), the residual feature distillation network (RFDN), and so on, have attempted to reduce parameters and computational complexity, further optimization remains vital. Therefore, this paper presents an approach to enhancing the efficiency and lightweight nature of the SISR. We introduce a novel lightweight SR model by building upon the RFDN architecture, the winner of the AIM2020 and NTIRE2022 SR challenges. The proposed depthwise channel attention network (DWCAN) model makes some key changes to RFDN. First, it replaces the main residual feature distillation block (RFDB) with a depthwise channel attention block (DWCAB). Additionally, DWCAN includes a shallow residual block (SRB) with depthwise separable convolution (DW) and a channel attention (CA) block. The primary goal of our work is to significantly reduce model parameters, computational operations, inference time, and memory size while maintaining or improving a peak signal‐to‐noise ratio (PSNR) of 29 dB. The experimental results demonstrate the effectiveness of the proposed model. By applying our modifications, we achieve a notable reduction in model complexity, leading to an improved PSNR of 29.07 dB, up from RFDN's 29.04 dB on a diverse 2 K resolution (DIV2K) dataset. This underscores the potential of our lightweight model to balance computational efficiency and SR quality. Additionally, the proposed work is essential for the metaverse for two key reasons: (1) Enhancing visual quality by adding complex details to textures and objects, making the digital world feel more like reality. (2) Ensuring device compatibility across a range of gadgets, from smartphones to VR headsets, optimizing the metaverse experience for all users. In short, a lightweight single image super‐resolution model for image reconstruction is proposed in this paper. [ABSTRACT FROM AUTHOR]

Accurate power load prediction is an important guide for power system planning and operation. High‐ or low‐load prediction results will affect the operation of the power system. In recent years, deep learning technology represented by convolution neural network (CNN) and transformer has been proved to be suitable for power load prediction. This paper proposes a new short‐term power load hybrid forecasting model, called channel enhanced attention (CEA) and temporal convolutional network (TCN)‐based transformer comprehensive forecasting model. This method combines the short‐term feature extraction ability of TCN with the long‐term dependent capture ability of transformer for short‐term load forecasting. And the CEA designed in this study is added to improve the prediction accuracy. On the same dataset, the designed model predicts power load mean square errors of 0.056 and 0.146 for the next 24 h and the next week, respectively, which is 0.002 to 0.073 and 0.012 to 0.024 lower than the baseline model. The experimental results show that the hybrid short‐term power load prediction model proposed in this paper is significantly better than the existing methods. The predicted curve is in agreement with the actual charge change, which provides a good guidance for short‐term power load prediction. [ABSTRACT FROM AUTHOR]

The purpose of this paper is to investigate the utilization of artificial neural networks (ANNs) in learning models that address the nonlinear anisotropic flow and hysteresis retention behavior of deformable porous materials. Herein, the micro‐geometries of various networks of porous Bentheimer Sandstones subjected to several degrees of strain from the literature are considered. For the generation of the database required for the training, validation, and testing of the machine learning (ML) models, single‐phase and biphasic lattice Boltzmann (LB) simulations are performed. The anisotropic nature of the intrinsic permeability is investigated for the single‐phase LB simulations. Thereafter, the database contains the computed average fluid velocities versus the pressure gradients. In this database, the range of applied fluid pressure gradients includes Darcy as well as non‐Darcy flows. The generated output from the single‐phase flow simulations is implemented in a feed‐forward neural network, representing a path‐independent informed graph‐based model. Concerning the two‐phase LB simulations, the Shan‐Chen multiphase LB model is used to generate the retention curves of the cyclic drying/wetting processes in the deformed porous networks. Consequently, two different ML path‐dependent approaches, that is, 1D convolutional neural network and the recurrent neural network, are used to model the biphasic flow through the deformable porous materials. A comparison in terms of accuracy and speed of training between the two approaches is presented. Conclusively, the outcomes of the papers show the capability of the ML models in representing constitutive relations for permeability and hysteretic retention curves accurately and efficiently. [ABSTRACT FROM AUTHOR]

The aptness of machine learning (ML) to learn from large datasets, discover trends, and make predictions has demonstrated its potential to metamorphose the medical field. Medical data analysis with ML algorithms can improve patient outcomes in terms of both treatment and diagnosis. This paper investigates the numerous possibilities of ML in the medical industries, including radiology, pathology, genomics, and clinical decision‐making. It also goes over the benefits and drawbacks of ML in various sectors as well as the limitations that come with its application. It illustrates the potential advantages of ML, such as better accuracy and efficiency in diagnosis and individualized treatment programs, through a review of previous studies. Lastly, it provides perspectives on prospective advancements and prospects for the discipline. This study also intends to investigate the applications of deep learning (DL) in the medical field. DL algorithms have performed exceptionally satisfactorily in several healthcare‐related fields. The main conclusions of the study are summarized, and their ramifications for the healthcare sector are discussed in this paper's conclusion. This paper intends to contribute to a greater understanding of the prevailing state of the discipline and the possibility for future developments by emphasizing the prospects of these methodologies to alter medical study and clinical practice. [ABSTRACT FROM AUTHOR]

In this paper, an additive margin network with adaptive feature recalibration, AMNets, for handling a wide range of visual tasks, is proposed. The new AMNets consists of three improvements on convolutional neural networks: (1) squeeze‐and‐excitation mechanism was embedded into the the residual block of single layer to improve the performance of the classification, (2) softmax loss was replaced by the additive margin softmax loss to minimize intra‐class variance and maximize inter‐class variance, and (3) Adam optimizer was exploited to update iteratively the network parameters. Experiments on the Brain Stroke CT Image Dataset show that our additive margin network is quite effective to improve state‐of‐the‐art algorithms. Network algorithms have been extensively used in medical image field to pursuit a more accuracy of disease recognition. This paper proposes AMNets, an additive margin network with adaptive feature recalibration for handling a wide range of visual tasks in medicine. [ABSTRACT FROM AUTHOR]

Power transformers play a critical role in the performance of power systems. This equipment is costly due to significant copper and iron prices and manufacturing costs. Therefore, maintenance and protection of such equipment is essential. Despite its robust performance, maloperation of differential protection (DP) in transformers may cause operational challenges to power system operators. The differential relay may operate incorrectly after the transformer energization leads to an inrush current (IC) and the relay identifies the event as an internal fault, and consequently issues the trip command. The other case of maloperation includes, but not limited to, a moment when the current transformer saturates due to an external fault. In this paper, a novel approach for DP is proposed, that is based on signal processing methods. In this paper, variational mode decomposition (VMD) and the deep neural network are implemented by using the convolutional neural network (CNN) and bi‐directional long short‐term memory (BiLSTM) models. The VMD decomposes differential current signal (DCS) to intrinsic mode functions with corresponding narrow‐band property frequency spectrums, which provides more detailed information about signal characteristics in different frequency bands. At the next stage, an effective feature for the BiLSTM is extracted by the CNN with the convolutional layers to classify events and proper discrimination. Extensive simulations on a 500 MVA transformer in MATLAB demonstrate the effectiveness of the proposed protection approach to differentiate ICs from internal and external faults with 99.8% accuracy in less than 1/8th of a power cycle. [ABSTRACT FROM AUTHOR]

This article discusses a special issue of the International Conference on Computing and Communications Networks (ICCCN 2022), which focuses on various topics in computing and networking. The special issue includes 12 selected papers that cover a range of subjects, such as code-mixed language identification, sentiment analysis, sleep quality assessment, gait analysis, cervical precancerous lesion classification, marine radar monitoring, text summarization, software optimization, fault diagnosis, imbalanced data analysis, neonatal hypoglycemia brain injury, and feature selection for classification problems. The authors present their research methodologies, experimental results, and conclusions for each paper. The guest editors hope that the research contributions in this special issue will be beneficial to readers. [Extracted from the article]

Summary: Mobile Ad Hoc Network (MANETs) are indeed autonomous, fast‐deployable wireless networks that are ideal for communications in areas with limited radio infrastructure, outdoor events, military operations, and disaster relief. But the primary problem is with routing because of the nodes' mobility. This paper proposes a cluster‐based routing under energy prediction via deep learning techniques. Here, proposes a new model termed as Concatenation of Convolutional with Max‐Avg Pooling layer in Deep Convolutional Neural Network (CCMAP‐DCNN) for energy prediction, in which additional layers are inserted into the extant DCNN structure to ensure the effectiveness of energy prediction. As a result, clusters are created by grouping the nodes together. Constraints like energy, trust, distance, and latency are taken into account while choosing the cluster leader. For cluster head selection and optimal routing, proposes a new hybrid Namib Beetle Upgraded Jellyfish Search Optimization (NBUJSO) algorithm that utilizes the NBO strategy to the JSO algorithm making the selection process more optimal. The best route is then chosen by the optimum routing method, which takes into account variables like network quality and mobility to send data packets from source to destination as efficiently as possible. Finally, the data aggregation process is followed for eliminating the redundant transmission. [ABSTRACT FROM AUTHOR]

The surface texture of asphalt pavement has a significant effect on skid resistance performance. However, its contribution to the performance of skid resistance is non‐homogeneous and subjects to local validity. There are also a few deep learning models that take into account the effective contact texture region. This paper proposes a convolutional neural network model based on the effective contact texture region, containing macro‐ and micro‐scale awareness sub‐modules. In this study, the asphalt mixture with varying gradations was designed to accurately obtain the effective contact texture region. Then, the textures were disentangled into macro‐ and micro‐texture scales by applying the fast Fourier transform and fed into the model for training. Finally, the area of effective contact texture region was calculated, and the effective contact ratio parameter was then proposed using the triangulation algorithm. The results showed that the effective contact texture area of pavement varies by the asphalt mixture type. The effective contact ratio parameter exhibited a significant positive correlation (Pearson correlation coefficient is 0.901, R2= 0.8129) with skid resistance performance and was also influenced by key sieve aggregate content from 2.36 to 4.75 mm. The data of effective contact texture region following disentanglement significantly released the model performance (the relative error dropped to 1.81%). The model exhibited improved precision and performance, which can be utilized as an efficient, non‐contact alternative method for skid resistance analysis. [ABSTRACT FROM AUTHOR]

The most recent and precise biological and healthcare knowledge is critical in the current outbreak such as COVID. In today's small world, everyone needs timely and appropriate medical information to prevent contagious diseases. Extraction of important information from medical conversations and dissemination to patients and doctors may benefit in the treatments of doctor tiredness and patient amnesia. Problem: Automatic text summarizing is essential for gaining great knowledge in any topic in an efficient and productive manner. The material included in health records is vital to our understanding of kind illness and its manifestations. Creating a comprehensive and standard kind of content is becoming an unavoidable and crucial problem in the medical process as a result of the massive amounts of fragmented data created in many sectors. Approach: The purpose of this study is to employ NLP‐based deep learning algorithms for text summary that perform well on linguistic text summarization data, and then modify/adapt these for biomedical domain‐specific text summarization. This paper provides an approach developed in‐house for condensing ill‐punctuated or unpunctuated discussion transcripts into more intelligible summaries, which combines topic modelling and phrase selection with punctuation restorations. For autonomous synthesis of medical reports from biomedical transcripts, this research proposes using an end‐to‐end summarization technique, Deep Dense Long Short Term Memory Network (LSTM), followed by Convolutional Neural Network (CNN). Results: Extensive testing, examination, and comparing have demonstrated that this summarizer works well for medical transcript summarization. The suggested approach achieved an average ROUGE score of 93.5% using a single document summary. Furthermore, by comparing new techniques to previous ones, the utility and accuracy of novel strategies would be shown. The results reveal that models trained on ordinary language provide comparable results on a biomedical testing set, with one model outperforming the linguistic test set. [ABSTRACT FROM AUTHOR]

The Induction Motor (IM) is one of the most frequently used prime movers in most industrial and transportation systems. The motor's stable and safe operation directly influences the secure and reliable operation of such prime movers. Developing an intelligent fault diagnosis system for such motors is very significant. This paper presents an intelligent fault diagnosis method based on the improved functionality of a Convolutional Neural Network (CNN) through its hyperparameter optimization using a nature‐inspired Artificial Bee Colony Optimization (ABCO) algorithm. The proposed diagnostic method introduces and analyses various possible mechanical and electrical faults in the IM. The validation of the proposed method is presented with three different modalities, including vibration, acoustic, and infrared thermography, with their comparative performance analysis. Vibration and acoustic‐based detection are done with time‐frequency scalograms using Constant Q Transform (CQT), which provides enhanced time resolution for lower and higher frequencies. The obtained result indicates that the infrared thermography‐based anomaly detection outperforms the vibration and acoustic‐based diagnosis with 100% classification accuracy. The results signify the potential to diagnose different mechanical and electrical faults in IM with substantial reliability and robustness. [ABSTRACT FROM AUTHOR]

The crucial part of the software development cycle is software maintenance. The demands included in the software management are fault fixes and request to change or bring a new feature. If priority is not given to these demands, then it may lead to customer dissatisfaction, inefficient planning, and software failure as well. Therefore, it is important to study the severity of the bug reports to maintain the efficiency of the software. Various research has been conducted in the past to predict the severity of the paper using text mining focusing only on the content of the bug reports. The sentiment of the user while reporting a bug also plays a vital role. In this study, we will be focusing on two aspects, that is, sentiment and content to improve the prediction. We propose a prediction model based on LDA to study the content aspect and emotion analysis to study the sentiment aspect. The model is validated on the datasets collected from the Eclipse project using Convolutional Neural Network (CNN). The results show that the CNN model effectively utilizes the content and sentiment aspect of the data to handle the severity prediction. CNN has weight sharing feature that decreases the number of parameters used for training. It also improves generalization and overfitting is avoided The Accuracy, Precision, Recall, and F‐measure are improved when both aspects are taken into account rather than considering only content. [ABSTRACT FROM AUTHOR]

High‐fidelity segmentation of blood vessels plays a pivotal role in numerous biomedical applications, such as injection assistance, cancer detection, various surgeries, and vein authentication. Near‐infrared (NIR) transillumination imaging is an effective and safe method to visualize the subcutaneous blood vessel network. However, such images are severely blurred because of the light scattering in body tissues. Inspired by the Vision Transformer model, this paper proposes a novel deep learning network known as transformer connection (TRC)‐Unet to capture global blurred and local clear correlations while using multi‐layer attention. Our method mainly consists of two blocks, thereby aiming to remap skip connection information flow and fuse different domain features. Specifically, the TRC extracts global blurred information from multiple layers and suppresses scattering to increase the clarity of vessel features. Transformer feature fusion eliminates the domain gap between the highly semantic feature maps of the convolutional neural network backbone and the adaptive self‐attention maps of TRCs. Benefiting from the long‐range dependencies of transformers, we achieved competitive results in relation to various competing methods on different data sets, including retinal vessel segmentation, simulated blur image segmentation, and real NIR blood vessel image segmentation. Moreover, our method remarkably improved the segmentation results of simulated blur image data sets and a real NIR vessel image data set. The quantitative results of ablation studies and visualizations are also reported to demonstrate the superiority of the TRC‐Unet design. © 2024 The Author(s). IEEJ Transactions on Electrical and Electronic Engineering published by Institute of Electrical Engineers of Japan and Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

Convolutional neural networks possess the capability of feature learning and nonlinear mapping, which has significant advantages in classifying and recognizing optical fiber vibration signals. In order to further enhance the recognition rate of vibration signals, this paper combines wavelet transform with convolutional neural networks and designs a convolutional layer based on parameterized wavelets. In this layer, the initial signal is convolved with parameterized Laplace wavelet dictionaries to complete the wavelet transform. Such customized filters make more sense than filters with randomly initialized parameters for traditional CNNs. Simultaneously, we introduce the channel attention mechanism to enhance the features of the filtered signals. Subsequently, standard CNNs are employed to extract and process signal features, ultimately utilizing a multi‐layer perceptron for recognition and classification. The experimental results show that the network model possesses better recognition refinement. © 2024 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

Transformer has achieved outstanding performance in hyperspectral image classification (HSIC) thanks to its effectiveness in modelling the long‐term dependence relation. However, most of the existing algorithms combine convolution with transformer and use convolution for spatial–spectral information fusion, which cannot adequately learn the spatial–spectral fusion features of hyperspectral images (HSIs). To mine the rich spatial and spectral features, a two‐branch global spatial–spectral fusion transformer (GSSFT) model is designed in this paper, in which a spatial–spectral information fusion (SSIF) module is designed to fuse features of spectral and spatial branches. For the spatial branch, the local multiscale swin transformer (LMST) module is devised to obtain local–global spatial information of the samples and the background filtering (BF) module is constructed to weaken the weights of irrelevant pixels. The information learned from the spatial branch and the spectral branch is effectively fused to get final classification results. Extensive experiments are conducted on three HSI datasets, and the results of experiments show that the designed GSSFT method performs well compared with the traditional convolutional neural network and transformer‐based methods. [ABSTRACT FROM AUTHOR]

As one of the key technologies in battery management system, accurate remaining useful life (RUL) prediction is critical to guarantee the reliability and safety for electrical equipment. However, the generalization and robustness of a single method are limited. A novel fusion data‐driven RUL prediction method CSSA‐ELM‐LSSVR based on charging‐discharging health features extraction is proposed in this paper, which fusions chaotic sparrow search algorithm (CSSA), extreme learning machine (ELM), and least squares support vector regression (LSSVR). First, four health indicators (HIs) are extracted from the charging‐discharging process, which can reflect the battery degradation phenomenon from multiple perspectives. Then, pearson correlation coefficient is used to numerically analyze the correlation between HIs and battery aging capacities. Second, the extracted HIs are used as the inputs for ELM and LSSVR to predict the degradation trend of battery, where CSSA is used for hyperparameters optimization in ELM. Finally, considering that CSSA‐ELM can capture the general trend of degradation curves, while LSSVR can trace the detail changes, a fusion framework based on CSSA‐ELM and LSSVR is proposed for RUL prediction. Two weighting schemes, namely precision‐based weighting (PW) and random forest regressor‐based weighting (RFRW) are put forward to fix the weights of CSSA‐ELM and LSSVR algorithms. Two publicly available datasets from National Aeronautics and Space Administration (NASA) and MIT are adopted to verify the feasibility and effectiveness of the proposed method. The results indicate that the proposed method with any weighting scheme has an overall superior prediction performance for different kinds of batteries compared with CSSA‐ELM, LSSVR, convolution neural network and long short term memory. Moreover, the RFRW scheme has better overall performance. Specifically, the maximum root mean square error of the predicted method is 2.5126%, the mean absolute percentage error is 12.9167%, the mean absolute error is 1.8376%, the predicted RUL errors are within one cycle, and the determination coefficient R2$R^2$ is above 0.97. [ABSTRACT FROM AUTHOR]

Domain adaptation is a transfer learning method that is widely applied for remaining useful life (RUL) prediction under different operating conditions. However, current RUL prediction methods based on domain adaptation only consider minimizing degradation feature differences, while ignoring the correlation between features and labels, which may result in significant errors in the mapping relationship between the two learned by the model, and thus reduce the accuracy of prediction. To address this issue, this paper proposes an unsupervised subdomain adversarial network (USDAN) for RUL estimation under various conditions. On the basis of traditional domain adversarial adaptation networks, the network uses temporal convolutional networks to construct the feature extractor to learn the long‐term dependencies between degradation data, and a multilinear conditioning scheme is designed to combine the features and subdomain labels as input features to the domain discriminator. Finally, with backpropagation and gradient reversal, the feature extractor is prompted to generate cross‐domain invariant features that are correlated with the labels, improving the prediction accuracy and enhancing the transferability of the network. In the experimental section, the public turbofan engine degradation dataset is used to validate the effectiveness of the network, and the comparison with other approaches demonstrates its advantages. [ABSTRACT FROM AUTHOR]

Perception systems in autonomous vehicles need to accurately detect and classify objects within their surrounding environments. Numerous types of sensors are deployed on these vehicles, and the combination of such multimodal data streams can significantly boost performance. The authors introduce a novel sensor fusion framework using deep convolutional neural networks. The framework employs both camera and LiDAR sensors in a multimodal, multiview configuration. The authors leverage both data types by introducing two new innovative fusion mechanisms: element‐wise multiplication and multimodal factorised bilinear pooling. The methods improve the bird's eye view moderate average precision score by +4.97% and +8.35% on the KITTI dataset when compared to traditional fusion operators like element‐wise addition and feature map concatenation. An in‐depth analysis of key design choices impacting performance, such as data augmentation, multi‐task learning, and convolutional architecture design is offered. The study aims to pave the way for the development of more robust multimodal machine vision systems. The authors conclude the paper with qualitative results, discussing both successful and problematic cases, along with potential ways to mitigate the latter. [ABSTRACT FROM AUTHOR]

In order to balance accuracy and real‐time performance in semantic segmentation, this paper proposes a real‐time semantic segmentation algorithm model based on attention mechanism and multi‐branch feature fusion using Fast convolutional neural network model (Fast‐SCNN). In this method, the spatial detail feature enhancement branch is introduced to enhance spatial detail features firstly. Then, through rational design of fusion module, the feature information of each branch is optimized to achieve better fusion of deep and shallow features. At the end of the feature fusion module, an adaptive feature enhancement focus module is introduced to capture the interdependence between remote pixels. The experimental results show that the proposed algorithm achieves 71.55% segmentation accuracy on Cityscapes dataset, the reasoning speed FPS is 97.6 frames/s, and the number of parameters is 1.39 M, which verifies the effectiveness of the network model constructed by the algorithm. Code is available at https://github.com/ccchhheeennn/model. [ABSTRACT FROM AUTHOR]

This paper proposes two efficient approximation methods to solve high-dimensional fully nonlinear partial differential equations (NPDEs) and second-order backward stochastic differential equations (2BSDEs), where such high-dimensional fully NPDEs are extremely difficult to solve because the computational cost of standard approximation methods grows exponentially with the number of dimensions. Therefore, we consider the following methods to overcome this difficulty. For the merged fully NPDEs and 2BSDEs system, combined with the time forward discretization and ReLU function, we use multiscale deep learning fusion and convolutional neural network (CNN) techniques to obtain two numerical approximation schemes, respectively. Finally, three practical high-dimensional test problems involving Allen-Cahn, Black-Scholes-Barenblatt, and Hamilton-Jacobi-Bellman equations are given so that the first proposed method exhibits higher efficiency and accuracy than the existing method, while the second proposed method can extend the dimensionality of the completely NPDEs-2BSDEs system over 400 dimensions, from which the numerical results highlight the effectiveness of proposed methods. [ABSTRACT FROM AUTHOR]

Whole brain segmentation from magnetic resonance images (MRI) is crucial in diagnosing brain diseases and analyzing neuroimaging data. Despite advances through deep learning, challenges such as uneven gray distribution and the presence of artifacts still present hurdles in medical image processing. These limitations are often a result of insufficient spatial contextual information and lack of attention to important regions within existing models. To address these issues, this paper presents SSA‐UNet (Squeeze‐and‐Excitation and Self‐Attention UNet), a uniquely designed deep convolutional neural network that integrates spatial constraints by converting three consecutive 2D MRI slices into a single 2.5D image. This facilitates capturing inter‐slice dependencies effectively. Additionally, the newly formulated SSA block, which sequentially incorporates channel attention and Self‐Attention mechanisms, is placed before the decoders in the conventional U‐Net architecture. This enables the network to automatically weight different feature maps and focus more effectively on regions requiring precise segmentation. Rigorous evaluations on LPBA40 and IBSR18 datasets substantiate the remarkable improvements in accuracy and stability achieved by SSA‐UNet. Results indicate Dice coefficients of 98.38% and 97.47%, specificity of 99.69% and 99.57%, and sensitivity of 98.5% and 97.98% for the respective datasets. Compared to other existing models, SSA‐UNet shows significant improvements on both the LPBA40 and IBSR18 datasets. On the LPBA40 dataset, SSA‐UNet's Dice coefficient improved by 0.33% compared to the sub‐optimal model, while on the IBSR18 dataset, the improvement reached 1.78%. These empirical findings demonstrate SSA‐UNet's heightened capability in addressing the long‐standing challenges in MRI‐based whole‐brain segmentation. [ABSTRACT FROM AUTHOR]

Photovoltaics (PV), which is one of variable renewable energies, have been installed largely. In the environment of largely installed PV, the output fluctuates of PV influences on the operation of power gird network adversely. Therefore, PV energy generation forecasting is valid for power grid operation and management and needs the reduction of large forecast error as well as average error. Due to a day‐ahead forecast of the total PV energy generation in the power grid area, we developed the forecasting method by using meteorological forecast data of many points in the target area. In order to forecast the regional PV energy generation, the proposed method uses auto‐encoder and convolutional neural network (CNN) for extracting requirements and valid data, and forecast with neural network (NN) by means of extracted information. In this paper, we improved the forecasting error by using multiple meteorological elements as input data. As a result, we indicated that using both of global horizontal irradiance and low cloud cover is required for the reginal PV energy generation forecasting, and large forecasting error can be reduced by adding either dew point depression, or cumulative precipitation as input data. © 2024 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

As one of the classic tasks in information retrieval, the core of image retrieval is to identify the images sharing similar features with a query image, aiming to enable users to find the required information from a large number of images conveniently. Street view image retrieval, in particular, finds extensive applications in many fields, such as improvements to navigation and mapping services, formulation of urban development planning scheme, and analysis of historical evolution of buildings. However, the intricate foreground and background details in street view images, coupled with a lack of attribute annotations, render it among the most challenging issues in practical applications. Current image retrieval research mainly uses the visual model that is completely dependent on the image visual features, and the multimodal learning model that necessitates additional data sources (e.g., annotated text). Yet, creating annotated datasets is expensive, and street view images, which contain a large amount of scene texts themselves, are often unannotated. Therefore, this paper proposes a deep unsupervised learning algorithm that combines visual and text features from image data for improving the accuracy of street view image retrieval. Specifically, we employ text detection algorithms to identify scene text, utilize the Pyramidal Histogram of Characters encoding predictor model to extract text information from images, deploy deep convolutional neural networks for visual feature extraction, and incorporate a contrastive learning module for image retrieval. Upon testing across three street view image datasets, the results demonstrate that our model holds certain advantages over the state‐of‐the‐art multimodal models pre‐trained on extensive datasets, characterized by fewer parameters and lower floating point operations. Code and data are available at https://github.com/nwuSY/svtRetrieval. [ABSTRACT FROM AUTHOR]

In the current state of the art of process industries/manufacturing technologies, computer‐instrumented and computer‐controlled autonomous techniques are necessary for damage diagnosis and prognosis in operating machinery. From this perspective, the paper addresses the issue of fatigue damage that is one of the most encountered sources of degradation in polycrystalline‐alloy structures of machinery components. In this paper, the convolutional neural networks (CNNs) are applied to synergistic combinations of ultrasonic measurements and images from a confocal microscope (Alicona) to detect and evaluate the risk of fatigue damage. The database of the Alicona has been used to calibrate the ultrasonic database and to provide the ground truth for fatigue damage assessment. The results show that both the ultrasonic data and Alicona images are capable of classifying the fatigue damage into their respective classes with considerably high accuracy. However, the ultrasonic CNN model yields better accuracy than the Alicona CNN model by almost 9%. Highlights: This paper shows the role of artificial intelligence in evaluating the severity of the fatigue damage.A comparison between two convolutional neural network (CNN) models has been demonstrated in this paper.The ultrasonic CNN model provides better performance than microscope CNN model. [ABSTRACT FROM AUTHOR]

Introduction: Algorithms to predict short‐term changes in local weather modalities have been used in meteorology for many years. These algorithms predict the temporospatial change in the movement of weather patterns such as cloud cover or precipitation. This paper extends convolutional neural network models for weather prediction/nowcasting to predict evolution in the extrapolation of sequentially acquired count data seen with cardiac positron tomography (PET) data to expected value temporally rather than spatially. Methods: Six different algorithms used for nowcasting were modified and applied to confirm the approach. These algorithms were trained on an image data set of both simulated ellipsoids and simulated cardiac PET data. The peak signal‐to‐noise ratio (PSNR) and structural similarity (SSIM) were calculated for each of these trained models. They were compared to the BM3D denoising algorithm as a baseline comparison to a standard method of image denoising. Results: Most of the implemented algorithms showed a significant improvement in both PSNR and SSIM when compared with the baseline standard, especially when the algorithms were implemented in combination. The best results were obtained with a combination of the ConvLSTM and TrajGRU algorithms with a PSNR improvement over the standard of 5 and more than double the SSIM metric. Conclusion: This approach of using serially acquired count data to extrapolate a future expected representation through convolutional neural networks has been shown to produce accurate representations of the expected value when compared with a baseline analytic methodology. This paper confirms that algorithms such as these can be used to substantially improve image estimation and shows significant improvement over a baseline standard. [ABSTRACT FROM AUTHOR]

Background: Accurate segmentation of brain glioma is a critical prerequisite for clinical diagnosis, surgical planning and treatment evaluation. In current clinical workflow, physicians typically perform delineation of brain tumor subregions slice‐by‐slice, which is more susceptible to variabilities in raters and also time‐consuming. Besides, even though convolutional neural networks (CNNs) are driving progress, the performance of standard models still have some room for further improvement. Purpose: To deal with these issues, this paper proposes an attention‐guided multi‐scale context aggregation network (AMCA‐Net) for the accurate segmentation of brain glioma in the magnetic resonance imaging (MRI) images with multi‐modalities. Methods: AMCA‐Net extracts the multi‐scale features from the MRI images and fuses the extracted discriminative features via a self‐attention mechanism for brain glioma segmentation. The extraction is performed via a series of down‐sampling, convolution layers, and the global context information guidance (GCIG) modules are developed to fuse the features extracted for contextual features. At the end of the down‐sampling, a multi‐scale fusion (MSF) module is designed to exploit and combine all the extracted multi‐scale features. Each of the GCIG and MSF modules contain a channel attention (CA) module that can adaptively calibrate feature responses and emphasize the most relevant features. Finally, multiple predictions with different resolutions are fused through different weightings given by a multi‐resolution adaptation (MRA) module instead of the use of averaging or max‐pooling to improve the final segmentation results. Results: Datasets used in this paper are publicly accessible, that is, the Multimodal Brain Tumor Segmentation Challenges 2018 (BraTS2018) and 2019 (BraTS2019). BraTS2018 contains 285 patient cases and BraTS2019 contains 335 cases. Simulations show that the AMCA‐Net has better or comparable performance against that of the other state‐of‐the‐art models. In terms of the Dice score and Hausdorff 95 for the BraTS2018 dataset, 90.4% and 10.2 mm for the whole tumor region (WT), 83.9% and 7.4 mm for the tumor core region (TC), 80.2% and 4.3 mm for the enhancing tumor region (ET), whereas the Dice score and Hausdorff 95 for the BraTS2019 dataset, 91.0% and 10.7 mm for the WT, 84.2% and 8.4 mm for the TC, 80.1% and 4.8 mm for the ET. Conclusions: The proposed AMCA‐Net performs comparably well in comparison to several state‐of‐the‐art neural net models in identifying the areas involving the peritumoral edema, enhancing tumor, and necrotic and non‐enhancing tumor core of brain glioma, which has great potential for clinical practice. In future research, we will further explore the feasibility of applying AMCA‐Net to other similar segmentation tasks. [ABSTRACT FROM AUTHOR]

In the field of tunnel lining crack identification, the semantic segmentation algorithms based on convolution neural network (CNN) are extensively used. Owing to the inherent locality of CNN, these algorithms cannot make full use of context semantic information, resulting in difficulty in capturing the global features of crack. Transformer‐based networks can capture global semantic information, but this method also has the deficiencies of strong data dependence and easy loss of local features. In this paper, a hybrid semantic segmentation algorithm for tunnel lining crack, named SCDeepLab, is proposed by fusing Swin Transformer and CNN in the encoding and decoding framework of DeepLabv3+ to address the above issues. In SCDeepLab, a joint backbone network is introduced with CNN‐based Inverse Residual Block and Swin Transformer Block. The former is used to extract the local detailed information of the crack to generate the shallow feature layer, whereas the latter is used to extract the global semantic information to obtain the deep feature layer. In addition, Efficient Channel Attention enhanced Feature Fusion Module is proposed to fuse the shallow and deep features to combine the advantages of the two types of features. Furthermore, the strategy of transfer learning is adopted to solve the data dependency of Swin Transformer. The results show that the mean intersection over union (mIoU) and mean pixel accuracy (mPA) of SCDeepLab on the data sets constructed in this paper are 77.41% and 84.42%, respectively, which have higher segmentation accuracy than previous CNN‐based and transformer‐based semantic segmentation algorithms. [ABSTRACT FROM AUTHOR]

Because roads are the major backbone of the transportation network, research about crack detection on road surfaces has been popular in computer and infrastructure engineering. When training a convolutional neural network (CNN) for pixel‐level road crack detection, three common challenges include (1) the data are severely imbalanced, (2) crack pixels can be easily confused with normal road texture and other visual noises, and (3) there are many unexplainable characteristics regarding the CNN itself. When it comes to very fine and thin cracks, these challenges are exaggerated and a new challenge is introduced, as there can be a discrepancy between the actual width and the annotated width of a crack. To tackle all these challenges of thin crack detection, this paper proposes a new variant of CNN named ThinCrack U‐Net, designed to provide thin results upon pixel‐level crack detection on road surfaces. The main contribution is to demystify how pixel‐level thin crack detection results are affected by different loss functions as well as various combinations of the U‐Net components. The experimental results show that ThinCrack U‐Net yields a significant performance boost in CrackTree260, from 65.71% to 94.48% F‐measure, compared to the existing variant of U‐Net previously proposed in the context of pixel‐level thin crack detection. Finally, this paper locates the source of undesirable result thickness and solves it with the balanced usage of downsampling/upsampling layers and atrous convolution. Unlike suggested by previous works, different loss functions show no significant impact on ThinCrack U‐Net, whereas normalization layers are proved crucial in pixel‐level thin crack detection. [ABSTRACT FROM AUTHOR]

The problems of insufficient recognition accuracy, poor real‐time performance and lack of consideration of actual working conditions in the process of intelligent construction of coal mines make this technology still in the research stage and not applied in practical engineering. The purpose of this paper is to establish an accurate and real‐time recognition model, which can quickly distinguish the vibration acceleration signals of coal and gangue under the influence of external factors such as impact position, velocity, and direction by using the different physical properties of coal and gangue particles. Therefore, the accuracy and real‐time of coal gangue recognition model established by different convolutional neural networks (CNN) structures and different position signal input are studied. First, to meet the real‐time requirements, an original CNN recognition model composed of single convolution layer and single pooling layer is established, and the data collected by seven sensors are input in the form of two‐dimensional matrix. However, the stability of the training and test results is insufficient. To solve this problem, once improved CNN (OI‐CNN) recognition model with multiconvolution layers and multipooling layers is built by deepening the network. The experimental results show that the stability and accuracy are improved, but the real‐time performance is poor. Furthermore, through parameter adjustment, the OI‐CNN is changed to the twice improved CNN (TI‐CNN), and the sensor data at different positions are input in the form of one‐dimensional vectors. The results show that the accuracy and real‐time performance of the TI‐CNN coal gangue recognition model are further improved. Finally, according to the research purpose of this paper, the weights of CNN indexes are given, and a multi‐index comprehensive evaluation system (MICES) is established. With the original CNN recognition model as the control, the OI‐CNN recognition model and the TI‐CNN recognition model at different positions are quantitatively compared to obtain the comprehensive evaluation scores of each model. The results show that the MICES of the coal gangue recognition model established based on the TI‐CNN structure and the data input of a single position sensor is the highest, while the sensor position has little effect on the recognition results. [ABSTRACT FROM AUTHOR]

This paper proposes normalizing flow‐based image super‐resolution techniques using attention modules. In the proposed method, the features of the low‐resolution images are extracted using a Swin Transformer. Furthermore, multi‐head attention in the flow layers makes effective use of the feature maps. This architecture enables the efficient injection of low‐resolution image features extracted by the transformer into the flow layer. Experimental results at x4 magnifications showed that the proposed method achieved state‐of‐the‐art performance for quantitative metrics and visual quality among single‐loss architectures. © 2024 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

Deep convolutional neural networks based remote sensing change detection has recently shown significant performance improvement. However, small region changes and global‐local features in high‐resolution remote sensing images are not fully explored. This paper introduces a hybrid U‐shaped and transformer network for change detection in high‐resolution remote sensing images. Specifically, a UNet++‐based backbone to facilitate feature learning across different scales. In addition, we introduce a transformer‐based feature fusion module for extracting long‐range dependencies, which can enhance the representation ability of the network. Furthermore, the introduced efficient channel attention mechanism can efficiently calibrate the feature representation and concentrate on more important feature information. Thanks to the above designs, the proposed method enjoys a strong ability to extract local and global features for remote sensing change detection. Extensive experimental results on different remote sensing images show that our method can achieve superior performance in comparison with state‐of‐the‐art change detection methods. [ABSTRACT FROM AUTHOR]

While recent years have witnessed the unprecedented success of deep convolutional neural networks (CNNs) and vision transformers in single‐image super‐resolution (SISR), the degradation assumptions are simple and usually bicubic downsampling. Thus, their performances will drop dramatically when the actual degradation does not match this assumption, and they lack the capability to handle multiple degradations (e.g. Gaussian noise, bicubic downsizing, and salt & pepper noise). To address the issues, in this paper, the authors propose a joint SR model (JIRSR) that can effectively handle multiple degradations in a single model. Specifically, the authors build the parallel Transformer and CNN branches that complement each other through bidirectional feature fusion. Moreover, the authors also adopt a random permutation of different kinds of noise and resizing operations to build the training datasets. Extensive experiments on classical SR, denoising, and multiple degradation removal demonstrate that the authors' JIRSR achieves state‐of‐the‐art (SOTA) performance on public benchmarks. Concretely, the authors' JIRSR outperforms the second‐best model by 0.23 to 0.74 dB for multiple degradations removal and is 0.20 to 0.36 dB higher than the SOTA methods on the Urban100 dataset under the ×4 SR task. [ABSTRACT FROM AUTHOR]

Tuberculosis (TB) is an extremely contagious illness caused by Mycobacterium tuberculosis. Chest tuberculosis classification is conducted based on a deep convolutional neural network architecture. In this research, a pre‐trained network is utilized to demonstrate the advantage of using the oversampling technique on the classification of TB and compare results with recent research that used the same dataset. Therefore, the dataset consists of 3500 uninfected TB cases and 700 infected with TB. This paper circumvents the imbalance by using the oversampling technique in X‐ray TB images to be fed into several pre‐trained networks for TB classification. The oversampling technique is crucial in enhancing the performance of TB classification compared with other pre‐trained models reported here. Inceptionv3 shows a promising result compared to other pre‐trained models; it achieves 99.94% accuracy, 99.88% precision, 100% recall, and 99.94% F1‐Score. [ABSTRACT FROM AUTHOR]

Background: Deep learning‐based unsupervised image registration has recently been proposed, promising fast registration. However, it has yet to be adopted in the online adaptive magnetic resonance imaging‐guided radiotherapy (MRgRT) workflow. Purpose: In this paper, we design an unsupervised, joint rigid, and deformable registration framework for contour propagation in MRgRT of prostate cancer. Methods: Three‐dimensional pelvic T2‐weighted MRIs of 143 prostate cancer patients undergoing radiotherapy were collected and divided into 110, 13, and 20 patients for training, validation, and testing. We designed a framework using convolutional neural networks (CNNs) for rigid and deformable registration. We selected the deformable registration network architecture among U‐Net, MS‐D Net, and LapIRN and optimized the training strategy (end‐to‐end vs. sequential). The framework was compared against an iterative baseline registration. We evaluated registration accuracy (the Dice and Hausdorff distance of the prostate and bladder contours), structural similarity index, and folding percentage to compare the methods. We also evaluated the framework's robustness to rigid and elastic deformations and bias field perturbations. Results: The end‐to‐end trained framework comprising LapIRN for the deformable component achieved the best median (interquartile range) prostate and bladder Dice of 0.89 (0.85–0.91) and 0.86 (0.80–0.91), respectively. This accuracy was comparable to the iterative baseline registration: prostate and bladder Dice of 0.91 (0.88–0.93) and 0.86 (0.80–0.92). The best models complete rigid and deformable registration in 0.002 (0.0005) and 0.74 (0.43) s (Nvidia Tesla V100‐PCIe 32 GB GPU), respectively. We found that the models are robust to translations up to 52 mm, rotations up to 15∘$^\circ$, elastic deformations up to 40 mm, and bias fields. Conclusions: Our proposed unsupervised, deep learning‐based registration framework can perform rigid and deformable registration in less than a second with contour propagation accuracy comparable with iterative registration. [ABSTRACT FROM AUTHOR]

This paper provides a method for improving the photovoltaic conversion efficiency and optical attributes of silicon solar cells manufactured from as‐cut boron doped p‐type multi‐crystalline silicon wafers using acid‐based chemical texturization via machine learning. A decreased reflectance, which can be attained by the right chemical etching conditions, is one of the key elements for raising solar cell efficiency. In this work, the mc‐Silicon wafer surface reflectance is obtained under (<2%) after optimization of wet chemical etching. The HF + HNO3 + CH3COOH chemical etchant is used in the ratio 1:3:2 at different conditions of the etching duration of 1 min, 2 min, 3 min, and 4 min, respectively. The as‐cut boron doped p‐type mc‐silicon wafers are analysed with ultraviolet–visible spectroscopy, optical microscopy, Fourier transforms infrared spectroscopy, thickness profilometer, and scanning electron microscopy before and after etching. The chemical etching solution produces good results in 3 min etched wafer, with a reflectivity value of <2%.The reflectivity and optical images are inputs to the convolutional neural network model and the linear regression model to obtain the etching rate for better reflectivity. The classification model provides 99.6% accuracy and the regression model results in the minimum mean squared error (MSE) of 0.062. [ABSTRACT FROM AUTHOR]

Non‐separable states of structured light have the analogous mathematical forms with quantum entanglement, which offer an effective way to simulate quantum process. However, the classical multi‐partite non‐separable states analogue to multi‐particle entanglements can only be controlled by bulky free‐space modulation of light through coupling multiple degrees of freedom (DoFs) with orbital angular momentum (OAM) to achieve high dimensionality and other DoFs to emulate multi‐parties. In this paper, a scheme is proposed to directly emit multi‐partite non‐separable states from a simple laser cavity to mimic multi‐particle quantum entanglement. Through manipulating three DoFs as OAM, polarization, and wavevector inside a laser cavity, the eight‐dimensional (8D) tripartite states and all Greenberger‐Horne‐Zeilinger (GHZ)‐like states can be generated and controlled on demand. In addition, an effective method is proposed to perform state tomography employing convolutional neural network (CNN), for measuring the generated GHZ‐like states with highest fidelity up to 95.11%. This work reveals a feasibility of intra‐cavity manipulation of high‐dimensional multipartite non‐separable states, opening a compact device for quantum‐classical analogy and paving the path for advanced quantum scenarios. [ABSTRACT FROM AUTHOR]

Inverse halftoning is a technology that converts a binary image into a continuous tone image. Due to the wide application of inverse halftoning, many scholars have proposed several deep convolutional neural networks (DCNN) to optimize their performance. According to the observation, there is still room for improvement in content generation and detail recovery of the inverse halftone images generated by using the existing methods. Therefore, an inverse halftoning method based on supervised DCNN is proposed in this paper. The method consists of two parts: the multi‐level feature extraction model uses the down‐sampling to extract the features from the halftone image and remove the halftone noise dots on flat areas, which is implemented by four convolutional layers; the image reconstruction model uses up‐sampling to reconstruct image information, which is realized by four convolutional layers and two dense residual blocks. At the same time, in order to further recover the details, the down‐sampling feature maps and up‐sampling feature maps of the same size are concatenated by addition layers. Experimental results show that compared with other methods, the inverse halftone images obtained by the proposed network have better results in both subjective and objective evaluations. [ABSTRACT FROM AUTHOR]

Video‐based emotion recognition has been a long‐standing research topic for computer scientists and psychiatrists. In contrast to traditional discrete emotional models, emotion recognition based on continuous emotional models can better describe the progression of emotions. Quantitative analysis of emotions will have crucial impacts on promoting the development of intelligent products. The current solutions to continuous emotion recognition still have many issues. The original continuous emotion dataset contains incomplete data annotations, and the existing methods often ignore temporal information between frames. The following measures are taken in response to the above problems. Initially, aiming at the problem of incomplete video labels, the correlation between discrete and continuous video emotion labels is used to complete the dataset labels. This correlation is used to propose a mathematical model to fill the missing labels of the original dataset without adding data. Moreover, this paper proposes a continuous emotion recognition network based on an optimized temporal convolutional network, which adds a feature extraction submodule and a residual module to retain shallow features while improving the feature extraction ability. Finally, validation experiments on the Aff‐wild2 dataset achieved accuracies of 0.5159 and 0.65611 on the valence and arousal dimensions, respectively, by adopting the above measures. [ABSTRACT FROM AUTHOR]

Text-independent speaker verification (TI-SV) is a crucial task in speaker recognition, as it involves verifying an individual's claimed identity from speech of arbitrary content without any human intervention. The target for TI-SV is to design a discriminative network to learn deep speaker embedding for speaker idiosyncrasy. In this paper, we propose a deep speaker embedding learning approach of a hybrid deep neural network (DNN) for TI-SV in FM broadcasting. Not only acoustic features are utilized, but also phoneme features are introduced as prior knowledge to collectively learn deep speaker embedding. The hybrid DNN consists of a convolutional neural network architecture for generating acoustic features and a multilayer perceptron architecture for extracting phoneme features sequentially, which represent significant pronunciation attributes. The extracted acoustic and phoneme features are concatenated to form deep embedding descriptors for speaker identity. The hybrid DNN demonstrates not only the complementarity between acoustic and phoneme features but also the temporality of phoneme features in a sequence. Our experiments show that the hybrid DNN outperforms existing methods and delivers a remarkable performance in FM broadcasting TI-SV. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the journal IET Generation, Transmission & Distribution. It discusses the use of artificial intelligence (AI) in reliable forecasting for energy sectors. The editorial highlights the challenges of integrating renewable energy sources and fluctuating electricity demand, and emphasizes the importance of accurate forecasting for system operators. The document also provides summaries of several papers included in a special issue on AI-empowered forecasting in energy sectors, covering topics such as load forecasting, wind power prediction, and control parameter optimization. The editorial concludes by recommending further research and practical implementations of AI approaches in the energy sectors. [Extracted from the article]

In recent years, deep learning techniques have been increasingly utilized to automate and reduce human errors in leukocyte classification. However, reliability and accuracy issues remain a challenge. This paper proposes CAB‐Net, an end‐to‐end deep learning‐based model that integrates a convolutional neural network with an attention mechanism and BLSTM. The model uses a stack of convolutional and pooling layers to extract initial features from input images, which are then fed into the attention block to generate class‐specific discriminative features and BLSTM employed to model deterministic class correlations between highlighted discriminative features and labels. Experimental results show that CAB‐Net outperforms state‐of‐the‐art methods in term of accuracy, precision, recall, F1‐Score, and AUC‐ROC. In addition, the CAB‐Net model demonstrates good performance even with low‐resolution images. Consequently, CAB‐Net can be considered as the current state‐of‐the‐art prediction model for improving leukocyte classification in clinical environments. [ABSTRACT FROM AUTHOR]

Background: Medical image segmentation is one of the most key steps in computer‐aided clinical diagnosis, geometric characterization, measurement, image registration, and so forth. Convolutional neural networks especially UNet and its variants have been successfully used in many medical image segmentation tasks. However, the results are limited by the deficiency in extracting high resolution edge information because of the design of the skip connections in UNet and the need for large available datasets. Purpose: In this paper, we proposed an edge‐attending polar UNet (EPolar‐UNet), which was trained on the polar coordinate system instead of classic Cartesian coordinate system with an edge‐attending construction in skip connection path. Methods: EPolar‐UNet extracted the location information from an eight‐stacked hourglass network as the pole for polar transformation and extracted the boundary cues from an edge‐attending UNet, which consisted of a deconvolution layer and a subtraction operation. Results: We evaluated the performance of EPolar‐UNet across three imaging modalities for different segmentation tasks: CVC‐ClinicDB dataset for polyp, ISIC‐2018 dataset for skin lesion, and our private ultrasound dataset for liver tumor segmentation. Our proposed model outperformed state‐of‐the‐art models on all three datasets and needed only 30%–60% of training data compared with the benchmark UNet model to achieve similar performances for medical image segmentation tasks. Conclusions: We proposed an end‐to‐end EPolar‐UNet for automatic medical image segmentation and showed good performance on small datasets, which was critical in the field of medical image segmentation. [ABSTRACT FROM AUTHOR]

The accurate segmentation of breast tumours is important for the diagnosis and treatment of breast cancer. When using the classic U‐Net, Attention‐UNet, and UNet++ to segment the tumour, there are problems of oversegmentation, incorrect segmentation, and poor edge continuity. In this paper, an effective tumour segmentation method, EfficientUNet, is proposed. EfficientUNet adopts a step‐by‐step enhancement method, combining ResNet18, a channel attention mechanism and deep supervision. ResNet18, as the encoder of the whole network, solves the problem of gradient disappearanceand improves the feature extraction ability of the model. The channel attention module makes the model more accurate in tumour edge processing. The deep supervision technology accelerates the model training and provides the convergence direction for the model. In addition, it is found that when adjusting the size of the image, the method of image filling before clipping (or zooming) is more conducive to model learning than the direct interpolation method. And a comparative experiment wasperformed on dataset B. Compared to U‐Net, Attention‐UNet and UNet++, EfficientUNet has the highest performance. Finally, the ablation experiment also indicated the effectiveness of each module in EfficientUNet. [ABSTRACT FROM AUTHOR]