Search

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

Herein, the challenge of accurately classifying the manufacturing origin of printing paper, including continent, country, and specific product, was addressed. One-dimensional convolutional neural network (1D CNN) models trained on infrared (IR) spectrum data acquired from printing paper samples were used for the task. The preprocessing of the IR spectra through a second-derivative transformation and the restriction of the spectral range to 1800 to 1200 cm-1 improved the classification performance of the model. The outcomes were highly promising. Models trained on second-derivative IR spectra in the 1800 to 1200-cm-1 range exhibited perfect classification for the manufacturing continent and country, with an impressive F1 score of 0.980 for product classification. Notably, the developed 1D CNN model outperformed traditional machine learning classifiers, such as support vector machines and feed-forward neural networks. In addition, the application of data point attribution enhanced the transparency of the decision-making process of the model, offering insights into the spectral patterns that affect classification. This study makes a considerable contribution to printing paper classification, with potential implications for accurate origin identification in various fields. [ABSTRACT FROM AUTHOR]

Microfluidic paper-based analytical devices (μPADs) have been widely used in point-of-care testing owing to their simple operation, low volume of the sample required, and the lack of the need for an external force. To obtain accurate semi-quantitative or quantitative results, μPADs need to respond to the challenges posed by differences in reaction conditions. In this paper, multi-layer μPADs are fabricated by the imprinting method for the colorimetric detection of C-reactive protein (CRP). Different lighting conditions and shooting angles of scenes are simulated in image acquisition, and the detection-related performance of μPADs is improved by using a machine learning algorithm. The You Only Look Once (YOLO) model is used to identify the areas of reaction in μPADs. This model can observe an image only once to predict the objects present in it and their locations. The YOLO model trained in this study was able to identify all the reaction areas quickly without incurring any error. These reaction areas were categorized by classification algorithms to determine the risk level of CRP concentration. Multi-layer perceptron, convolutional neural network, and residual network algorithms were used for the classification tasks, where the latter yielded the highest accuracy of 96%. It has a promising application prospect in fast recognition and analysis of μPADs. [ABSTRACT FROM AUTHOR]

The sliding window method is commonly used for non-intrusive load disaggregation. However, it is difficult to choose the appropriate window size, and the disaggregation effect is poor in low-frequency industrial environments. To better handle low-frequency industrial load data, in this paper, we propose a vertical non-intrusive load disaggregation model that is different from the sliding window method. By training multiple electrical parameters at a single point on the bus end with the corresponding load data at the branch end, the proposed method, called multiple electrical parameters to point (Mep2point), takes the electrical parameter data sampled at a single point on the bus end as its input and outputs the load data of the target device sampled at the corresponding point. First, the electrical parameters of the bus end are processed, and each item is normalized to the range from 0–1. Then, the electrical parameters are vertically arranged by their time point, and a convolutional neural network (CNN) is used to train the model. The proposed method is analyzed on low-frequency industrial user data sampled at a frequency of 1/120 Hz in the real world. We compare our method with three advanced sliding window methods, achieving an average improvement ranging from 9.23% to 22.51% in evaluation metrics, while showing substantial superiority in the actual decomposed images. Compared with three classical machine learning algorithms, our model, using the same amount of data, significantly outperforms these methods. Finally, we also compared our method with the multi-channel low window sequence-to-point (MLSP) method, which also selects multiple electrical parameters. Our model's complexity is much less than that of the MLSP model, and its performance remains high. The superiority of our model, as presented in this paper, is fully verified by experimental analysis, which can produce better actual load decomposition results from each branch and contribute to the analysis and monitoring of loads in industrial environments. [ABSTRACT FROM AUTHOR]

Tool condition monitoring technology is an indispensable part of intelligent manufacturing. Most current research focuses on complex signal processing techniques or advanced deep learning algorithms to improve prediction performance without fully leveraging the end-to-end advantages of deep learning. The challenge lies in transforming multi-sensor raw data into input data suitable for direct model feeding, all while minimizing data scale and preserving sufficient temporal interpretation of tool wear. However, there is no clear reference standard for this so far. In light of this, this paper innovatively explores the processing methods that transform raw data into input data for deep learning models, a process known as an input paradigm. This paper introduces three new input paradigms: the downsampling paradigm, the periodic paradigm, and the subsequence paradigm. Then an improved hybrid model that combines a convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM) was employed to validate the model's performance. The subsequence paradigm demonstrated considerable superiority in prediction results based on the PHM2010 dataset, as the newly generated time series maintained the integrity of the raw data. Further investigation revealed that, with 120 subsequences and the temporal indicator being the maximum value, the model's mean absolute error (MAE) and root mean square error (RMSE) were the lowest after threefold cross-validation, outperforming several classical and contemporary methods. The methods explored in this paper provide references for designing input data for deep learning models, helping to enhance the end-to-end potential of deep learning models, and promoting the industrial deployment and practical application of tool condition monitoring systems. [ABSTRACT FROM AUTHOR]

Understanding road conditions is essential for implementing effective road safety measures and driving solutions. Road situations encompass the day-to-day conditions of roads, including the presence of vehicles and pedestrians. Surveillance cameras strategically placed along streets have been instrumental in monitoring road situations and providing valuable information on pedestrians, moving vehicles, and objects within road environments. However, these video data and information are stored in large volumes, making analysis tedious and time-consuming. Deep learning models are increasingly utilized to monitor vehicles and identify and evaluate road and driving comfort situations. However, the current neural network model requires the recognition of situations using time-series video data. In this paper, we introduced a multi-directional detection model for road situations to uphold high accuracy. Deep learning methods often integrate long short-term memory (LSTM) into long-term recurrent network architectures. This approach effectively combines recurrent neural networks to capture temporal dependencies and convolutional neural networks (CNNs) to extract features from extensive video data. In our proposed method, we form a multi-directional long-term recurrent convolutional network approach with two groups equipped with CNN and two layers of LSTM. Additionally, we compare road situation recognition using convolutional neural networks, long short-term networks, and long-term recurrent convolutional networks. The paper presents a method for detecting and recognizing multi-directional road contexts using a modified LRCN. After balancing the dataset through data augmentation, the number of video files increased, resulting in our model achieving 91% accuracy, a significant improvement from the original dataset. [ABSTRACT FROM AUTHOR]

This paper introduces a novel one-dimensional convolutional neural network that utilizes clinical data to accurately detect choledocholithiasis, where gallstones obstruct the common bile duct. Swift and precise detection of this condition is critical to preventing severe complications, such as biliary colic, jaundice, and pancreatitis. This cutting-edge model was rigorously compared with other machine learning methods commonly used in similar problems, such as logistic regression, linear discriminant analysis, and a state-of-the-art random forest, using a dataset derived from endoscopic retrograde cholangiopancreatography scans performed at Olive View–University of California, Los Angeles Medical Center. The one-dimensional convolutional neural network model demonstrated exceptional performance, achieving 90.77% accuracy and 92.86% specificity, with an area under the curve of 0.9270. While the paper acknowledges potential areas for improvement, it emphasizes the effectiveness of the one-dimensional convolutional neural network architecture. The results suggest that this one-dimensional convolutional neural network approach could serve as a plausible alternative to endoscopic retrograde cholangiopancreatography, considering its disadvantages, such as the need for specialized equipment and skilled personnel and the risk of postoperative complications. The potential of the one-dimensional convolutional neural network model to significantly advance the clinical diagnosis of this gallstone-related condition is notable, offering a less invasive, potentially safer, and more accessible alternative. [ABSTRACT FROM AUTHOR]

With the continuous development of automotive intelligence, vehicle occupant detection technology has received increasing attention. Despite various types of research in this field, a simple, reliable, and highly private detection method is lacking. This paper proposes a method for vehicle occupant detection using millimeter-wave radar. Specifically, the paper outlines the system design for vehicle occupant detection using millimeter-wave radar. By collecting the raw signals of FMCW radar and applying Range-FFT and DoA estimation algorithms, a range–azimuth heatmap was generated, visually depicting the current status of people inside the vehicle. Furthermore, utilizing the collected range–azimuth heatmap of passengers, this paper integrates the Faster R-CNN deep learning networks with radar signal processing to identify passenger information. Finally, to test the performance of the detection method proposed in this article, an experimental verification was conducted in a car and the results were compared with those of traditional machine learning algorithms. The findings indicated that the method employed in this experiment achieves higher accuracy, reaching approximately 99%. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the International Journal of Uncertainty, Fuzziness & Knowledge-Based Systems. It discusses the potential of fuzzy-based systems in statistical learning theory and their ability to handle uncertainty and ambiguity in real-time data. The editorial highlights recent advancements in integrating fuzzy systems with deep learning architectures and other machine learning techniques. The special issue aims to explore the intersection of fuzzy logic and statistical learning theory and includes twelve accepted papers that investigate the capabilities of fuzzy-based systems. The document provides a brief summary of each paper, covering topics such as pop-up text recognition, alignment of laser images, knowledge graph reasoning, land use changes, 3D printing in vehicle design, defect detection in electronic components, digital management process improvement, spectrum sharing in IoV, deep clustering for time series data, anti-collision algorithms, missing data filling, and video action recognition. The guest editor expresses gratitude to the authors and reviewers for their contributions and to the Editor-in-Chief for the opportunity to curate the special issue. [Extracted from the article]

This document is an editorial for a special issue titled "Machine Learning in Computer Vision and Image Sensing: Theory and Applications." The editorial highlights the diverse applications of machine learning (ML) models in various domains such as medical imaging, signal processing, remote sensing, and human activity detection. The special issue includes 11 papers that cover topics such as image segmentation, fluvial navigation, Alzheimer's disease classification, pneumothorax detection, lung cancer malignancy prediction, amniotic fluid volume detection, COVID-19 detection, and Parkinson's disease detection. The papers showcase the progress and potential of ML models in computer vision applications and provide valuable insights for future research. [Extracted from the article]

This paper investigates a method for precise mapping of human arm movements using sEMG signals. A multi-channel approach captures the sEMG signals, which, combined with the accurately calculated joint angles from an Inertial Measurement Unit, allows for action recognition and mapping through deep learning algorithms. Firstly, signal acquisition and processing were carried out, which involved acquiring data from various movements (hand gestures, single-degree-of-freedom joint movements, and continuous joint actions) and sensor placement. Then, interference signals were filtered out through filters, and the signals were preprocessed using normalization and moving averages to obtain sEMG signals with obvious features. Additionally, this paper constructs a hybrid network model, combining Convolutional Neural Networks and Artificial Neural Networks, and employs a multi-feature fusion algorithm to enhance the accuracy of gesture recognition. Furthermore, a nonlinear fitting between sEMG signals and joint angles was established based on a backpropagation neural network, incorporating momentum term and adaptive learning rate adjustments. Finally, based on the gesture recognition and joint angle prediction model, prosthetic arm control experiments were conducted, achieving highly accurate arm movement prediction and execution. This paper not only validates the potential application of sEMG signals in the precise control of robotic arms but also lays a solid foundation for the development of more intuitive and responsive prostheses and assistive devices. [ABSTRACT FROM AUTHOR]

The advent of satellite-borne machine learning hardware accelerators has enabled the onboard processing of payload data using machine learning techniques such as convolutional neural networks (CNNs). A notable example is using a CNN to detect the presence of clouds in the multispectral data captured on Earth observation (EO) missions, whereby only clear sky data are downlinked to conserve bandwidth. However, prior to deployment, new missions that employ new sensors will not have enough representative datasets to train a CNN model, while a model trained solely on data from previous missions will underperform when deployed to process the data on the new missions. This underperformance stems from the domain gap, i.e., differences in the underlying distributions of the data generated by the different sensors in previous and future missions. In this paper, we address the domain gap problem in the context of onboard multispectral cloud detection. Our main contributions lie in formulating new domain adaptation tasks that are motivated by a concrete EO mission, developing a novel algorithm for bandwidth-efficient supervised domain adaptation, and demonstrating test-time adaptation algorithms on space deployable neural network accelerators. Our contributions enable minimal data transmission to be invoked (e.g., only 1% of the weights in ResNet50) to achieve domain adaptation, thereby allowing more sophisticated CNN models to be deployed and updated on satellites without being hampered by domain gap and bandwidth limitations. [ABSTRACT FROM AUTHOR]

In order to achieve impact load localization of complex structures such as ships, this paper proposes a multi-scale feature fusion convolutional neural network (MSFF-CNN) method for impact load localization. An end-to-end machine learning model is used, where the raw vibration signals of impact loads are directly fed into the network model to avoid the process of feature extraction. Automatic feature learning and feature concatenation of the signal are achieved through four independent convolutional layers, each using a different size of convolutional kernel. Data normalization and L2 regularization techniques are introduced to enhance the data and prevent overfitting. Classification and localization of impact loads are accomplished using a softmax classification layer. Validation experiments are carried out using a ship's stern compartment model. Our results show that the classification and localization accuracy of the impact load sample group of MSFF-CNN reaches 94.29% compared with a traditional CNN. The method further improves the ability of the network to extract state features, takes local perception and global vision into account, effectively improves the classification ability of the model, and has good prospects for engineering applications. [ABSTRACT FROM AUTHOR]

Advancements in Machine Learning (ML) and Computer Vision have led to notable improvements in the detection of breast cancer. However, the accuracy of the classifier is limited due to imbalanced datasets that cause overfitting. Thus, additional images are needed to improve the classifier's performance. Generative Adversarial Networks (GAN) are used for image augmentation. Still, its limitations, such as the random use of different types of GAN, can lead to a too-good discriminator, causing generator training to fail due to vanishing gradients. Therefore, selecting the appropriate GAN model for the given scenario is crucial for optimal performance. This paper proposes a novel Smart Generative Adversarial Network (Smart GAN) architecture to develop an efficient and computational classification model for a limited imbalanced dataset. Smart GAN uses a three-fold approach. Different types of GAN augment the dataset in the first phase of experimental work, and their evaluation metrics are calculated. In the second phase, the metric scores are used as rewards for the Reinforcement learning model (Q-learning approach). The best augmentation is chosen based on the best Q-values for each metric score. It compares three different Convolutional Neural Networks (CNN) and selects the best-suited network to classify the augmented datasets. The proposed Smart GAN architecture outperforms other existing approaches by giving a better accuracy of 89.62% and 89.91% on Mammographic Image Analysis Society (MIAS) and Digital Database for Screening Mammography (DDSM) augmented datasets, respectively, representing an approximately 10% increment in detection rate compared to non-augmented datasets. [ABSTRACT FROM AUTHOR]

In recent years, video surveillance has become an integral part of computer vision research, addressing a variety of challenges in security, memory management and content extraction from video sequences. This paper introduces the Robust Object Detection using Fire Hawks Optimizer with Deep Learning (ROD-FHODL) technique, a novel approach designed specifically for video surveillance applications. Combining object detection and classification the proposed technique employs a two-step procedure. Utilizing the power of the Mask Region-based Convolutional Neural Network (Mask-RCNN) for object detection, we optimize its hyperparameters using the Fire Hawks Optimizer (FHO) algorithm to improve its efficacy. Our experimental results on the UCSD dataset demonstrate the significant impact of the proposed work. It achieves an extraordinary RUNNT of 1.34 s on the pedestrian-1 dataset, significantly outperforming existing models. In addition, the proposed system surpasses in accuracy, with a pedestrian-1 accuracy rate of 97.45% and Area Under the Curve (AUC) values of 98.92%. Comparative analysis demonstrates the superiority of the proposed system in True Positive Rate (TPR) versus False Positive Rate (FPR) across thresholds. In conclusion, the proposed system represents a significant advancement in video surveillance, offering advances in speed, precision and robustness that hold promise for enhancing security, traffic management and public space monitoring in smart city infrastructure and other applications. [ABSTRACT FROM AUTHOR]

Nowadays, transfer learning has shown promising results in many applications. However, most deep transfer learning methods such as parameter sharing and fine‐tuning are still suffering from the lack of parameters transmission strategy. In this paper, we propose a new optimization model for parameter‐based transfer learning in convolutional neural networks named STP‐CNN. Indeed, we propose a Lasso transfer model supported by a regularization term that controls transferability. Moreover, we opt for the proximal gradient descent method to solve the proposed model. The suggested technique allows, under certain conditions, to control exactly which parameters, in each convolutional layer of the source network, which will be used directly or adjusted in the target network. Several experiments prove the performance of our model in locating the transferable parameters as well as improving the data classification. [ABSTRACT FROM AUTHOR]

In contemporary society, rich in mineral resources, efficiently and accurately identifying and classifying minerals has become a prominent issue. Recent advancements in artificial intelligence, particularly breakthroughs in deep learning, have offered new solutions for intelligent mineral recognition. This paper introduces a deep-learning-based object detection model for intelligent mineral identification, specifically employing the YOLOv8 algorithm. The model was developed with a focus on seven common minerals: biotite, quartz, chalcocite, silicon malachite, malachite, white mica, and pyrite. During the training phase, the model learned to accurately recognize and classify these minerals by analyzing and annotating a large dataset of mineral images. After 258 rounds of training, a stable model was obtained with high performance on key indicators such as Precision, Recall, mAP50, and mAP50–95, with values stable at 0.91766, 0.89827, 0.94300, and 0.91696, respectively. In the testing phase, using samples provided by the Geological and Mineral Museum at the School of Earth Sciences and Engineering, Sun Yat-sen University, the model successfully identified all test samples, with 83% of them having a confidence level exceeding 87%. Despite some potential misclassifications, the results of this study contribute valuable insights and practical experience to the development of intelligent mineral recognition technologies. [ABSTRACT FROM AUTHOR]

Recurrent neural networks (RNNs) have significantly advanced the field of machine learning (ML) by enabling the effective processing of sequential data. This paper provides a comprehensive review of RNNs and their applications, highlighting advancements in architectures, such as long short-term memory (LSTM) networks, gated recurrent units (GRUs), bidirectional LSTM (BiLSTM), echo state networks (ESNs), peephole LSTM, and stacked LSTM. The study examines the application of RNNs to different domains, including natural language processing (NLP), speech recognition, time series forecasting, autonomous vehicles, and anomaly detection. Additionally, the study discusses recent innovations, such as the integration of attention mechanisms and the development of hybrid models that combine RNNs with convolutional neural networks (CNNs) and transformer architectures. This review aims to provide ML researchers and practitioners with a comprehensive overview of the current state and future directions of RNN research. [ABSTRACT FROM AUTHOR]

Potholes and other road surface damages pose significant risks to vehicles and traffic safety. The current methods of in situ visual inspection for potholes or cracks are inefficient, costly, and hazardous. Therefore, there is a pressing need to develop automated systems for assessing road surface conditions, aiming to efficiently and accurately reconstruct, recognize, and locate potholes. In recent years, various methods utilizing (a) computer vision, (b) three-dimensional (3D) point clouds, or (c) smartphone data have been employed to map road surface quality conditions. Machine learning and deep learning techniques have increasingly enhanced the performance of these methods. This review aims to provide a comprehensive overview of cutting-edge computer vision and machine learning algorithms for pothole detection. It covers topics such as sensing systems for acquiring two-dimensional (2D) and 3D road data, classical algorithms based on 2D image processing, segmentation-based algorithms using 3D point cloud modeling, machine learning, deep learning algorithms, and hybrid approaches. The review highlights that hybrid methods combining traditional image processing and advanced machine learning techniques offer the highest accuracy in pothole detection. Machine learning approaches, particularly deep learning, demonstrate superior adaptability and detection rates, while traditional 2D and 3D methods provide valuable baseline techniques. By reviewing and evaluating existing vision-based methods, this paper clarifies the current landscape of pothole detection technologies and identifies opportunities for future research and development. Additionally, insights provided by this review can inform the design and implementation of more robust and effective systems for automated road surface condition assessment, thereby contributing to enhanced roadway safety and infrastructure management. [ABSTRACT FROM AUTHOR]

Short-term load forecasting is a challenging research problem and has a tremendous impact on electricity generation, transmission, and distribution. A robust forecasting algorithm can help power system operators to better tackle the ever-changing electric power demand. This paper presents a novel deep neural network for short-term electric load forecasting for the St. John's campus of Memorial University of Newfoundland (MUN). The electric load data are obtained from the Memorial University of Newfoundland and combined with metrological data from St. John's. This dataset is used to formulate a multivariate time-series forecasting problem. A novel deep learning algorithm is presented, consisting of a 1D Convolutional Neural Network, which is followed by an encoder–decoder-based network with attention. The input used for this model is the electric load consumption and metrological data, while the output is the hourly prediction of the next day. The model is compared with Gated Recurrent Unit (GRU) and Long Short Term Memory (LSTM)-based Recurrent Neural Network. A CNN-based encoder–decoder model without attention is also tested. The proposed model shows a lower mean absolute error (MAE), mean squared error (MSE), mean absolute percentage error (MAPE), and higher R2 score. These evaluation metrics show an improved performance compared to GRU and LSTM-based RNNs as well as the CNN encoder–decoder model without attention. [ABSTRACT FROM AUTHOR]

The transmission of high-frequency signals over long distances depends on the ionosphere's reflective properties, with the selection of operating frequencies being closely tied to variations in the ionosphere. The accurate prediction of ionospheric critical frequency foF2 and other parameters in low latitudes is of great significance for understanding ionospheric changes in high-frequency communications. Currently, deep learning algorithms demonstrate significant advantages in capturing characteristics of the ionosphere. In this paper, a state-of-the-art hybrid neural network is utilized in conjunction with a temporal pattern attention mechanism for predicting variations in the foF2 parameter during high- and low-solar activity years. Convolutional neural networks (CNNs) and bidirectional long short-term memory (BiLSTM), which is capable of extracting spatiotemporal features of ionospheric variations, are incorporated into a hybrid neural network. The foF2 data used for training and testing come from three observatories in Brisbane (27°53′S, 152°92′E), Darwin (12°45′S, 130°95′E) and Townsville (19°63′S, 146°85′E) in 2000, 2008, 2009 and 2014 (the peak or trough years of solar activity in solar cycles 23 and 24), using the advanced Australian Digital Ionospheric Sounder. The results show that the proposed model accurately captures the changes in ionospheric foF2 characteristics and outperforms International Reference Ionosphere 2020 (IRI-2020) and BiLSTM ionospheric prediction models. [ABSTRACT FROM AUTHOR]

In this paper, we propose a machine learning approach for detecting superficial defects in metal surfaces using point cloud data. We compare the performance of two popular deep learning architectures, multilayer perceptron networks (MLPs) and fully convolutional networks (FCNs), with varying feature sets. Our results show that FCNs (F1=0.94) outperformed MLPs (F1=0.52) in terms of precision, recall, and F1-score. We found that transfer learning with pre-trained models can improve performance when the amount of available data is limited. Our study highlights the importance of considering the amount and quality of training data in developing machine learning models for defect detection in industrial settings with 3D images. [ABSTRACT FROM AUTHOR]

In many modern machine learning (ML) models, attention mechanisms (AMs) play a crucial role in processing data and identifying significant parts of the inputs, whether these are text or images. This selective focus enables subsequent stages of the model to achieve improved classification performance. Traditionally, AMs are applied as a preprocessing substructure before a neural network, such as in encoder/decoder architectures. In this paper, we extend the application of AMs to intermediate stages of data propagation within ML models. Specifically, we propose a generalized attention mechanism (GAM), which can be integrated before each layer of a neural network for classification tasks. The proposed GAM allows for at each layer/step of the ML architecture identification of the most relevant sections of the intermediate results. Our experimental results demonstrate that incorporating the proposed GAM into various ML models consistently enhances the accuracy of these models. This improvement is achieved with only a marginal increase in the number of parameters, which does not significantly affect the training time. [ABSTRACT FROM AUTHOR]

Identifying causal sentences from nuclear incident reports is essential for advancing nuclear safety research and applications. Nonetheless, accurately locating and labeling causal sentences in text data is challenging, and might benefit from the usage of automated techniques. In this paper, we introduce LERCause, a labeled dataset combined with labeling methods meant to serve as a foundation for the classification of causal sentences in the domain of nuclear safety. We used three BERT models (BERT, BioBERT, and SciBERT) to 10,608 annotated sentences from the Licensee Event Report (LER) corpus for predicting sentence labels (Causal vs. non-Causal). We also used a keyword-based heuristic strategy, three standard machine learning methods (Logistic Regression, Gradient Boosting, and Support Vector Machine), and a deep learning approach (Convolutional Neural Network; CNN) for comparison. We found that the BERT-centric models outperformed all other tested models in terms of all evaluation metrics (accuracy, precision, recall, and F1 score). BioBERT resulted in the highest overall F1 score of 94.49% from the ten-fold cross-validation. Our dataset and coding framework can provide a robust baseline for assessing and comparing new causal sentences extraction techniques. As far as we know, our research breaks new ground by leveraging BERT-centric models for causal sentence classification in the nuclear safety domain and by openly distributing labeled data and code to enable reproducibility in subsequent research. [ABSTRACT FROM AUTHOR]

This paper presents a new edge detection process implemented in an embedded IoT device called Bee Smart Detection node to detect catastrophic apiary events. Such events include swarming, queen loss, and the detection of Colony Collapse Disorder (CCD) conditions. Two deep learning sub-processes are used for this purpose. The first uses a fuzzy multi-layered neural network of variable depths called fuzzy-stranded-NN to detect CCD conditions based on temperature and humidity measurements inside the beehive. The second utilizes a deep learning CNN model to detect swarming and queen loss cases based on sound recordings. The proposed processes have been implemented into autonomous Bee Smart Detection IoT devices that transmit their measurements and the detection results to the cloud over Wi-Fi. The BeeSD devices have been tested for easy-to-use functionality, autonomous operation, deep learning model inference accuracy, and inference execution speeds. The author presents the experimental results of the fuzzy-stranded-NN model for detecting critical conditions and deep learning CNN models for detecting swarming and queen loss. From the presented experimental results, the stranded-NN achieved accuracy results up to 95%, while the ResNet-50 model presented accuracy results up to 99% for detecting swarming or queen loss events. The ResNet-18 model is also the fastest inference speed replacement of the ResNet-50 model, achieving up to 93% accuracy results. Finally, cross-comparison of the deep learning models with machine learning ones shows that deep learning models can provide at least 3–5% better accuracy results. [ABSTRACT FROM AUTHOR]

The success of near-infrared spectroscopy (NIRS) analysis hinges on the precision and robustness of the calibration model. Shallow learning (SL) algorithms like partial least squares discriminant analysis (PLS-DA) often fall short in capturing the interrelationships between adjacent spectral variables, and the analysis results are easily affected by spectral noise, which dramatically limits the breadth and depth of applications of NIRS. Deep learning (DL) methods, with their capacity to discern intricate features from limited samples, have been progressively integrated into NIRS. In this paper, two discriminant analysis problems, including wheat kernels and Yali pears as examples, and several representative calibration models were used to research the robustness and effectiveness of the model. Additionally, this article proposed a near-infrared calibration model, which was based on the Gramian angular difference field method and coordinate attention convolutional neural networks (G-CACNNs). The research results show that, compared with SL, spectral preprocessing has a smaller impact on the analysis accuracy of consensus learning (CL) and DL, and the latter has the highest analysis accuracy in the modeling results using the original spectrum. The accuracy of G-CACNNs in two discrimination tasks was 98.48% and 99.39%. Finally, this research compared the performance of various models under noise to evaluate the robustness and noise resistance of the proposed method. [ABSTRACT FROM AUTHOR]

Sign language is undoubtedly a common way of communication among deaf and non-verbal people. But it is not common among hearing people to use sign language to express feelings or share information in everyday life. Therefore, a significant communication gap exists between deaf and hearing individuals, despite both groups experiencing similar emotions and sentiments. In this paper, we developed a convolutional neural network–squeeze excitation network to predict the sign language signs and developed a smartphone application to provide access to the ML model to use it. The SE block provides attention to the channel of the image, thus improving the performance of the model. On the other hand, the smartphone application brings the ML model close to people so that everyone can benefit from it. In addition, we used the Shapley additive explanation to interpret the black box nature of the ML model and understand the models working from within. Using our ML model, we achieved an accuracy of 99.86% on the KU-BdSL dataset. The SHAP analysis shows that the model primarily relies on hand-related visual cues to predict sign language signs, aligning with human communication patterns. [ABSTRACT FROM AUTHOR]

Deep learning has brought great development to radar emitter identification technology. In addition, specific emitter identification (SEI), as a branch of radar emitter identification, has also benefited from it. However, the complexity of most deep learning algorithms makes it difficult to adapt to the requirements of the low power consumption and high-performance processing of SEI on embedded devices, so this article proposes solutions from the aspects of software and hardware. From the software side, we design a Transformer variant network, lightweight convolutional Transformer (LW-CT) that supports parameter sharing. Then, we cascade convolutional neural networks (CNNs) and the LW-CT to construct a one-dimensional-CNN-Transformer(1D-CNN-Transformer) lightweight neural network model that can capture the long-range dependencies of radar emitter signals and extract signal spatial domain features meanwhile. In terms of hardware, we design a low-power neural network accelerator based on an FPGA to complete the real-time recognition of radar emitter signals. The accelerator not only designs high-efficiency computing engines for the network, but also devises a reconfigurable buffer called "Ping-pong CBUF" and two-level pipeline architecture for the convolution layer for alleviating the bottleneck caused by the off-chip storage access bandwidth. Experimental results show that the algorithm can achieve a high recognition performance of SEI with a low calculation overhead. In addition, the hardware acceleration platform not only perfectly meets the requirements of the radar emitter recognition system for low power consumption and high-performance processing, but also outperforms the accelerators in other papers in terms of the energy efficiency ratio of Transformer layer processing. [ABSTRACT FROM AUTHOR]

Mapping sea ice in the Arctic is essential for maritime navigation, and growing vessel traffic highlights the necessity of the timeliness and accuracy of sea ice charts. In addition, with the increased availability of satellite imagery, automation is becoming more important. The AutoICE Challenge investigates the possibility of creating deep learning models capable of mapping multiple sea ice parameters automatically from spaceborne synthetic aperture radar (SAR) imagery and assesses the current state of the automatic-sea-ice-mapping scientific field. This was achieved by providing the tools and encouraging participants to adopt the paradigm of retrieving multiple sea ice parameters rather than the current focus on single sea ice parameters, such as concentration. The paper documents the efforts and analyses, compares, and discusses the performance of the top-five participants' submissions. Participants were tasked with the development of machine learning algorithms mapping the total sea ice concentration, stage of development, and floe size using a state-of-the-art sea ice dataset with dual-polarised Sentinel-1 SAR images and 22 other relevant variables while using professionally labelled sea ice charts from multiple national ice services as reference data. The challenge had 129 teams representing a total of 179 participants, with 34 teams delivering 494 submissions, resulting in a participation rate of 26.4 %, and it was won by a team from the University of Waterloo. Participants were successful in training models capable of retrieving multiple sea ice parameters with convolutional neural networks and vision transformer models. The top participants scored best on the total sea ice concentration and stage of development, while the floe size was more difficult. Furthermore, participants offered intriguing approaches and ideas that could help propel future research within automatic sea ice mapping, such as applying high downsampling of SAR data to improve model efficiency and produce better results. [ABSTRACT FROM AUTHOR]

The transient stability assessment based on machine learning faces challenges such as sample data imbalance and poor generalization. To address these problems, this paper proposes an intelligent enhancement method for real-time adaptive assessment of transient stability. In the offline phase, a convolutional neural network (CNN) is used as the base classifier. A model training method based on contrastive learning is introduced, aiming to increase the spatial distance between positive and negative samples in the mapping space. This approach effectively improves the accuracy of the model in recognizing unbalanced samples. In the online phase, when real data with different distribution characteristics from the offline data are encountered, an active transfer strategy is employed to update the model. New system samples are obtained through instance transfer from the original system, and an active sampling strategy considering uncertainty is designed to continuously select high-value samples from the new system for labeling. The model parameters are then updated by fine-tuning. This approach drastically reduces the cost of updating while improving the model's adaptability. Experiments on the IEEE39-node system verify the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Indoor construction environments, with their high density and detailed components, are complex areas for progress monitoring and reporting. Traditional manual monitoring systems, often constrained by poor lighting and accessibility, are inaccurate and time-consuming. With recent technological advancements, deep learning-based object recognition models have achieved considerable attention in construction. This paper introduces a novel method for progress monitoring and reporting of construction operations, employing digital imaging and the You Only Look At CoefficienTs (YOLACT++) deep learning algorithm to automatically recognize mechanical, electrical, and plumbing (MEP) components in challenging indoor settings. Data augmentation techniques and transfer learning were applied to improve the model's generalization and adaptability. The study distinctively focuses on complex components in complicated indoor environments, a less explored area in current research that mainly centered on outdoor or simpler indoor settings. To achieve this, the study enhanced the dataset quality by generating synthetic images that closely represent actual indoor conditions including different lighting, object complexity and scale, occlusion, clutter, and viewpoints. This study also evaluated different mixes of synthetic and real images to determine the optimum combination for effective training. Moving beyond commonly used algorithms such as Mask R-CNN and You Only Look Once (YOLO), the method applied in this work is the YOLACT++ with deformable convolutional neural networks v2 (DCNv2), enhancing the model's ability to handle objects with different scales, postures, rotations, and viewpoints in the images that are essential in indoor environments. The model is validated on a large test dataset, including real images from construction sites, to cover different indoor scenarios. The model achieved a precision of 84.80% and a recall of 85.58% for HVAC duct detection and a precision of 86.87% and a recall of 73.93% for pipe detection, demonstrating its effectiveness under challenging conditions. This method contributes to more accurate automated progress monitoring in indoor environments by reducing manual and error prone inspections. [ABSTRACT FROM AUTHOR]

On construction sites, the principal means of communication between crane operator and crane signalman is mainly hand signaling. Often these hand signals are received and interpreted incorrectly, leading to communication errors and accidents. This paper describes the development of a sensor-based smart construction glove that uses a 3-axis accelerometer, 3-axis gyroscope, and 3-axis magnetometer to measure the hand's orientation with the help of quaternions, and flex-sensors to measure the intensity of bend in the fingers. The noises in the sensors are removed using a complementary filter fusion algorithm. Four machine-learning models— k -nearest neighbor, support vector machine, decision tree, and convolutional neural network–long short-term memory (CNN-LSTM)—are proposed for crane signalman hand-signal classification. The models are trained, validated, and tested using the sensor data collected from the smart construction glove. The best performance in the test data set is achieved by CNN-LSTM, which is found to achieve a precision of 84.3%, recall of 83.9%, an F1-score of 84%, and an average accuracy of 94.22% in the test data set. For real-time crane signalman hand-signal classification, an Android-based mobile application is developed. The application receives the data in text format from the smart construction glove via Bluetooth and converts it into speech output. The smart construction glove can classify 18 different crane signalman hand signals used on construction sites. The CNN-LSTM model is found to achieve the highest overall accuracy (93.87%) in real-time implementation. [ABSTRACT FROM AUTHOR]

This paper presents a detailed analysis of a convolutional neural network based on multi-valued neurons (CNNMVN) and a fully connected multilayer neural network based on multi-valued neurons (MLMVN), employed here as a convolutional neural network in the frequency domain. We begin by providing an overview of the fundamental concepts underlying CNNMVN, focusing on the organization of convolutional layers and the CNNMVN learning algorithm. The error backpropagation rule for this network is justified and presented in detail. Subsequently, we consider how MLMVN can be used as a convolutional neural network in the frequency domain. It is shown that each neuron in the first hidden layer of MLMVN may work as a frequency-domain convolutional kernel, utilizing the Convolution Theorem. Essentially, these neurons create Fourier transforms of the feature maps that would have resulted from the convolutions in the spatial domain performed in regular convolutional neural networks. Furthermore, we discuss optimization techniques for both networks and compare the resulting convolutions to explore which features they extract from images. Finally, we present experimental results showing that both approaches can achieve high accuracy in image recognition. [ABSTRACT FROM AUTHOR]

As part of the field of DNA methylation identification, this study tackles the challenge of enhancing recognition performance by introducing a specialized deep learning framework called DeepPGD. DNA methylation, a crucial biological modification, plays a vital role in gene expression analyses, cellular differentiation, and the study of disease progression. However, accurately and efficiently identifying DNA methylation sites remains a pivotal concern in the field of bioinformatics. The issue addressed in this paper is the presence of methylation in DNA, which is a binary classification problem. To address this, our research aimed to develop a deep learning algorithm capable of more precisely identifying these sites. The DeepPGD framework combined a dual residual structure involving Temporal convolutional networks (TCNs) and bidirectional long short-term memory (BiLSTM) networks to effectively extract intricate DNA structural and sequence features. Additionally, to meet the practical requirements of DNA methylation identification, extensive experiments were conducted across a variety of biological species. The experimental results highlighted DeepPGD's exceptional performance across multiple evaluation metrics, including accuracy, Matthews' correlation coefficient (MCC), and the area under the curve (AUC). In comparison to other algorithms in the same domain, DeepPGD demonstrated superior classification and predictive capabilities across various biological species datasets. This significant advancement in algorithmic prowess not only offers substantial technical support, but also holds potential for research and practical implementation within the DNA methylation identification domain. Moreover, the DeepPGD framework shows potential for application in genomics research, biomedicine, and disease diagnostics, among other fields. [ABSTRACT FROM AUTHOR]

Skeleton-based action recognition is an important but challenging task in the study of video understanding and human-computer interaction. However, existing methods suffer from two deficiencies. On the one hand, most methods usually involve manually designed convolution kernel which cannot capture spatial-temporal joint dependencies of complex regions. On the other hand, some methods just use the self-attention mechanism, ignoring its theoretical explanation. In this paper, we proposed a unified spatio-temporal graph convolutional network with a self-attention mechanism (SA-GCN) for low-quality motion video data with fixed viewing angle. SA-GCN can extract features efficiently by learning weights between joint points of different scales. Specifically, the proposed self-attention mechanism is end-to-end with mapping strategy for different nodes, which not only characterizes the multi-scale dependencies of joints, but also integrates the structural features of the graph and an ability of self-learning fusion features. Moreover, the attention mechanism proposed in this paper can be theoretically explained by GCN to some extent, which is usually not considered in most existing models. Extensive experiments on two widely used datasets, NTU-60 RGB+D and NTU-120 RGB+D, demonstrated that SA-GCN significantly outperforms a series of existing mainstream approaches in terms of accuracy. [ABSTRACT FROM AUTHOR]

Recent research has revealed that subtle imperceptible perturbations can deceive well-trained neural network models, leading to inaccurate outcomes. These instances, known as adversarial examples, pose significant threats to the secure application of machine learning techniques in safety-critical systems. In this paper, we delve into the study of one-pixel attacks in deep neural networks, recently reported as a kind of adversarial examples. To identify such one-pixel attacks, most existing methodologies rely on the differential evolution method, which utilizes random selection from the current population to escape local optima. However, the differential evolution technique might waste search time and overlook good solutions if the number of iterations is insufficient. Hence, in this paper, we propose a gradient ascent with momentum approach to efficiently discover good solutions for the one-pixel attack problem. As our method takes a more direct route to the goal compared to existing methods relying on blind random walks, it can effectively identify one-pixel attacks. Our experiments conducted on popular CNNs demonstrate that, in comparison with existing methodologies, our technique can detect one-pixel attacks significantly faster. [ABSTRACT FROM AUTHOR]

The aptness of machine learning (ML) to learn from large datasets, discover trends, and make predictions has demonstrated its potential to metamorphose the medical field. Medical data analysis with ML algorithms can improve patient outcomes in terms of both treatment and diagnosis. This paper investigates the numerous possibilities of ML in the medical industries, including radiology, pathology, genomics, and clinical decision‐making. It also goes over the benefits and drawbacks of ML in various sectors as well as the limitations that come with its application. It illustrates the potential advantages of ML, such as better accuracy and efficiency in diagnosis and individualized treatment programs, through a review of previous studies. Lastly, it provides perspectives on prospective advancements and prospects for the discipline. This study also intends to investigate the applications of deep learning (DL) in the medical field. DL algorithms have performed exceptionally satisfactorily in several healthcare‐related fields. The main conclusions of the study are summarized, and their ramifications for the healthcare sector are discussed in this paper's conclusion. This paper intends to contribute to a greater understanding of the prevailing state of the discipline and the possibility for future developments by emphasizing the prospects of these methodologies to alter medical study and clinical practice. [ABSTRACT FROM AUTHOR]

Under the premise of ensuring the safe and stable operation of a wind–thermal–storage power system, this paper proposes an optimization model aimed at improving its overall economic efficiency and effectively reducing the peak-to-valley load difference. The model transforms the multi-objective optimization problem to solve a feasible interval of weight coefficients. We introduce a novel fusion model, where a Convolutional Neural Network (CNN) is melded with a Long Short-Term Memory Network (LSTM) to form the target network structure. Additionally, for datasets with limited samples, we incorporate a Self-Attention Mechanism (SAM) into the Model-Agnostic Meta-Learning (MAML). Ultimately, we build an MAML-SAM-CNN-LSTM network model to solve the interval of weight coefficients. An arithmetic validation of a modified IEEE 30-node system demonstrates that the MAML-SAM-CNN-LSTM network proposed in this paper can adeptly solve the feasible intervals of weight coefficients in the optimization model of the wind-thermal storage system. This is achieved under the constraints of the specified wind-thermal storage power system operation indexes. The evaluation indexes of the network model, including its accuracy, precision, recall, and F1 score, all exceed 98.72%, 98.57%, 98.30%, and 98.57%, respectively. This denotes a superior performance compared to the other three network models, offering an effective reference for optimizing decision-making and facilitating the enhanced realization of multi-objective, on-demand scheduling in the wind-thermal storage power system. [ABSTRACT FROM AUTHOR]

Intelligent fault diagnosis utilizing deep learning algorithms is currently a topic of great interest. When developing a new Convolutional Neural Network (CNN) architecture to address machine diagnosis problem, it is common to use a deep model, with many layers, many feature maps, and large kernels. These models are capable of learning complex relationships and can potentially achieve superior performance on test data. However, not only does a large network potentially impose undue computational complexity for training and eventual deployment, it may also lead to more brittleness—where data outside of the curated dataset used in CNN training and evaluation is poorly handled. Accordingly, this paper will investigate a methodical approach for identifying a quasi-optimal CNN architecture to maximize robustness when a model is trained under one set of operating conditions, and deployed under a different set of conditions. Optuna software will be used to optimize a baseline CNN model for robustness to different rotational speeds and bearing Model #'s. To further improve the network generalization capabilities, this paper proposes the addition of white Gaussian noise to the raw vibration training data. Results indicate that the number of trainable weights and associated multiplications in the optimized model were reduced by almost 95% without jeopardizing the network classification accuracy. Additionally, moderate Additive White Gaussian Noise (AWGN) improved the model adaptation capabilities. [ABSTRACT FROM AUTHOR]

For insulated gate bipolar transistor (IGBT) modules using wire bonding as the interconnection method, the main failure mechanism is cracking of the bonded interface. Studying the mechanical properties of the bonded interface is crucial for assessing the reliability of IGBT modules. In this paper, first, shear tests are conducted on the bonded interface to test the bonded interface's strength. Then, finite element–cohesive zone modeling (FE-CZM) is established to describe the mechanical behavior of the bonded interface. A novel machine learning (ML) architecture integrating a convolutional neural network (CNN) and a long short-term memory (LSTM) network is used to identify the shape and parameters of the traction separation law (TSL) of the FE-CZM model accurately and efficiently. The CNN-LSTM architecture not only has excellent feature extraction and sequence-data-processing abilities but can also effectively address the long-term dependency problem. A total of 1800 sets of datasets are obtained based on numerical computations, and the CNN-LSTM architecture is trained with load–displacement (F–δ) curves as input parameters and TSL shapes and parameters as output parameters. The results show that the error rate of the model for TSL shape prediction is only 0.186%. The performance metric's mean absolute percentage error (MAPE) is less than 3.5044% for all the predictions of the TSL parameters. Compared with separate CNN and LSTM architectures, the proposed CNN-LSTM-architecture approach exhibits obvious advantages in recognizing TSL shapes and parameters. A combination of the FE-CZM and ML methods in this paper provides a promising and effective solution for identifying the mechanical parameters of the bonded interfaces of IGBT modules. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNNs) play a prominent role in solving problems in various domains such as pattern recognition, image tasks, and natural language processing. In recent years, neural architecture search (NAS), which is the automatic design of neural network architectures as an optimization algorithm, has become a popular method to design CNN architectures against some requirements associated with the network function. However, many NAS algorithms are characterised by a complex search space which can negatively affect the efficiency of the search process. In other words, the representation of the neural network architecture and thus the encoding of the resulting search space plays a fundamental role in the designed CNN performance. In this paper, to make the search process more effective, we propose a novel compact representation of the search space by identifying network blocks as elementary units. The study in this paper focuses on a popular CNN called DenseNet. To perform the NAS, we use an ad-hoc implementation of the particle swarm optimization indicated as PSO-CNN. In addition, to reduce size of the final model, we propose a segmentation method to cut the blocks. We also transfer the final model to different datasets, thus demonstrating that our proposed algorithm has good transferable performance. The proposed PSO-CNN is compared with 11 state-of-the-art algorithms on CIFAR10 and CIFAR100. Numerical results show the competitiveness of our proposed algorithm in the aspect of accuracy and the number of parameters. [ABSTRACT FROM AUTHOR]

The main purpose of this paper is to provide information on how to create a convolutional neural network (CNN) for extracting features from EEG signals. Our task was to understand the primary aspects of creating and fine-tuning CNNs for various application scenarios. We considered the characteristics of EEG signals, coupled with an exploration of various signal processing and data preparation techniques. These techniques include noise reduction, filtering, encoding, decoding, and dimension reduction, among others. In addition, we conduct an in-depth analysis of well-known CNN architectures, categorizing them into four distinct groups: standard implementation, recurrent convolutional, decoder architecture, and combined architecture. This paper further offers a comprehensive evaluation of these architectures, covering accuracy metrics, hyperparameters, and an appendix that contains a table outlining the parameters of commonly used CNN architectures for feature extraction from EEG signals. [ABSTRACT FROM AUTHOR]

Automated and accurate detection of power quality (PQ) events is important from the point of view of safety as well as maintaining the reliability of the power transmission and distribution network. However, detection of multiple PQ events in a noisy environment is challenging task. Another important issue is the choice of meaningful features that can directly influence the accuracy of PQ detection. Considering these two aforesaid facts, this paper presents a novel framework for automated classification of PQ signals in a noisy environment employing cross Stockwell Transform (XST). The XST proposed in this paper has better noise suppression capability compared to conventional Stockwell Transform. Here, XST was used to convert 1D PQ signals to 2D time–frequency (T–F) images. To improve the accuracy of PQ detection, an automated feature extraction method employing deep learning is implemented in this work. The noise free T–F images obtained using XST were fed as inputs to several pre-trained convolutional neural networks (CNNs) for deep feature extraction. Transfer learning technique was implemented to reduce the computational cost. The extracted deep features were further undergone selection using one-way analysis of variance test followed by false discovery rate correction. The statistically significant deep features were subsequently fed to three benchmark machine learning classifiers for classification of PQ signals. In addition, tests were also carried out on real-life PQ signals to verify the practicability of the proposed framework. Investigations revealed that the proposed method returned mean accuracy of 99.72% and 96.45% for classification of simulated and real-life PQ signals, respectively. [ABSTRACT FROM AUTHOR]

This article discusses a special issue of the International Conference on Computing and Communications Networks (ICCCN 2022), which focuses on various topics in computing and networking. The special issue includes 12 selected papers that cover a range of subjects, such as code-mixed language identification, sentiment analysis, sleep quality assessment, gait analysis, cervical precancerous lesion classification, marine radar monitoring, text summarization, software optimization, fault diagnosis, imbalanced data analysis, neonatal hypoglycemia brain injury, and feature selection for classification problems. The authors present their research methodologies, experimental results, and conclusions for each paper. The guest editors hope that the research contributions in this special issue will be beneficial to readers. [Extracted from the article]

The growing development of the agricultural e-commerce industry is promoting the Digital transformation of agricultural production and logistics. Aiming at the problem of labor shortage in apple picking, this paper proposes a performance control method for robot apple picking based on a nonlinear wide convolutional neural network (NLWCNN) and multi-objective cooperative distance transformation algorithm (MOCDTA). This method utilizes deep learning algorithms and visual sensing technology to enable robots to accurately recognize apples and perform autonomous picking operations based on their maturity and position. We have designed a machine learning-based algorithm that enables robots to accurately recognize and distinguish apples of different maturity levels through training on a large amount of sample data. At the same time, we also combined the motion control algorithm of the robot to enable efficient picking operations based on the position and maturity information of the apples. The experimental results indicate that the NLWCNN method can significantly improve the efficiency and accuracy of apple picking, ensure the safety and traceability of agricultural products, increase consumer trust, and promote agricultural product transactions. [ABSTRACT FROM AUTHOR]

Autonomous driving involves collaborative data sensing and traffic sign recognition. Emerging artificial intelligence technology has brought tremendous advances to vehicular networks. However, it is challenging to guarantee privacy and security when using traditional centralized machine learning methods for traffic sign recognition. It is urgent to introduce a distributed machine learning approach to protect private data of connected vehicles. In this paper, we propose a local differential privacy-based binary encoding federated learning approach. The binary encoding techniques and random perturbation methods are used in distributed learning scenarios to enhance the efficiency and security of data transmission. For the vehicle layer in this approach, the model is trained locally, and the model parameters are uploaded to the central server through encoding and perturbing. The central server designs the corresponding decoding, correction scheme, and regression statistical method for the received binary string. Then, the model parameters are aggregated and updated in the server and transmitted to the vehicle until the learning model is trained. The performance of the proposed approach is verified using the German Traffic Sign Recognition Benchmark data set. The simulation results show that the convergence of the approach is better with the increase in the learning cycle. Compared with baseline methods, such as the convolutional neural network, random forest, and backpropagation, the proposed approach achieves higher accuracy in the process of traffic sign recognition, with an increase of 6%. [ABSTRACT FROM AUTHOR]

In this paper, we introduce a U-Net model of deep learning algorithms for reconstructions of the 3D peculiar velocity field, which simplifies the reconstruction process with enhanced precision. We test the adaptability of the U-Net model with simulation data under more realistic conditions, including the redshift space distortion effect and halo mass threshold. Our results show that the U-Net model outperforms the analytical method that runs under ideal conditions, with a 16% improvement in precision, 13% in residuals, 18% in correlation coefficient, and 27% in average coherence. The deep learning algorithm exhibits exceptional capacities to capture velocity features in nonlinear regions and substantially improve reconstruction precision in boundary regions. We then apply the U-Net model trained under Sloan Digital Sky Survey (SDSS) observational conditions to the SDSS Data Release 7 data for observational 3D peculiar velocity reconstructions. [ABSTRACT FROM AUTHOR]

Lung cancer is an uncontrolled growth of tissue causing a lump in the human lung. If lung cancer can be detected early, it can increase the survival rate. Therefore, a multi-classification approach of lung nodule detection with high computational effectiveness is required. In this paper, a multi-classification approach of lung nodule detection and classification is proposed using artificial intelligence on computed tomography (CT) scan images. Different preprocessing steps are applied for resizing, smoothing, and enhancement of the CT images. Then, two different approaches for feature extraction using VGG16 transfer learning and morphological segmentation are proposed. Morphological segmentation and feature extraction are applied for the segmentation of the region of interest and to extract the distinct features. Finally, the proposed deep learning architecture and seven different machine learning algorithms are applied on the preprocessed data and the extracted features for the classification of lung nodules into three classes: malignant, benign, and normal. It is observed that the stacked ensemble model of deep learning convolutional neural network (CNN) and VGG16 transfer learning models (CNN+VGG16) can achieve 99.55% accuracy using preprocessed data. It is also observed that all the ML algorithms perform with reasonably high accuracy using the low-dimensional morphological features. It is observed from the fivefold cross-validation results that logistic regression performs with 99.36% accuracy in 23.71 s time using the preprocessed data. Whereas, using the morphological features, k-nearest neighbor, and the support vector machine perform with the highest accuracy of 99.76% with very reduced computational time of 0.017 and 0.008 s, respectively. [ABSTRACT FROM AUTHOR]

The most recent and precise biological and healthcare knowledge is critical in the current outbreak such as COVID. In today's small world, everyone needs timely and appropriate medical information to prevent contagious diseases. Extraction of important information from medical conversations and dissemination to patients and doctors may benefit in the treatments of doctor tiredness and patient amnesia. Problem: Automatic text summarizing is essential for gaining great knowledge in any topic in an efficient and productive manner. The material included in health records is vital to our understanding of kind illness and its manifestations. Creating a comprehensive and standard kind of content is becoming an unavoidable and crucial problem in the medical process as a result of the massive amounts of fragmented data created in many sectors. Approach: The purpose of this study is to employ NLP‐based deep learning algorithms for text summary that perform well on linguistic text summarization data, and then modify/adapt these for biomedical domain‐specific text summarization. This paper provides an approach developed in‐house for condensing ill‐punctuated or unpunctuated discussion transcripts into more intelligible summaries, which combines topic modelling and phrase selection with punctuation restorations. For autonomous synthesis of medical reports from biomedical transcripts, this research proposes using an end‐to‐end summarization technique, Deep Dense Long Short Term Memory Network (LSTM), followed by Convolutional Neural Network (CNN). Results: Extensive testing, examination, and comparing have demonstrated that this summarizer works well for medical transcript summarization. The suggested approach achieved an average ROUGE score of 93.5% using a single document summary. Furthermore, by comparing new techniques to previous ones, the utility and accuracy of novel strategies would be shown. The results reveal that models trained on ordinary language provide comparable results on a biomedical testing set, with one model outperforming the linguistic test set. [ABSTRACT FROM AUTHOR]

The crucial part of the software development cycle is software maintenance. The demands included in the software management are fault fixes and request to change or bring a new feature. If priority is not given to these demands, then it may lead to customer dissatisfaction, inefficient planning, and software failure as well. Therefore, it is important to study the severity of the bug reports to maintain the efficiency of the software. Various research has been conducted in the past to predict the severity of the paper using text mining focusing only on the content of the bug reports. The sentiment of the user while reporting a bug also plays a vital role. In this study, we will be focusing on two aspects, that is, sentiment and content to improve the prediction. We propose a prediction model based on LDA to study the content aspect and emotion analysis to study the sentiment aspect. The model is validated on the datasets collected from the Eclipse project using Convolutional Neural Network (CNN). The results show that the CNN model effectively utilizes the content and sentiment aspect of the data to handle the severity prediction. CNN has weight sharing feature that decreases the number of parameters used for training. It also improves generalization and overfitting is avoided The Accuracy, Precision, Recall, and F‐measure are improved when both aspects are taken into account rather than considering only content. [ABSTRACT FROM AUTHOR]