Search

Accurate shelf-life estimation of food products has the potential to improve the safety, reliability, and sustainability of food supply chains. Here, a scalable system for accurately indicating the freshness-related information of salmon for consumers was developed and characterized. The system comprises two parts, an optically changeable colorimetric sensor by dye incorporated with sol-gel functionalized paper sensor and a deep convolutional neural network (DCNN)-based freshness estimation system based on images. The paper sensor was produced based on paper and immersed, coated, or printed with (3-aminopropyl) triethoxysilane (APTMS) and tetraethyl orthosilicate (TEOS) sol-gel particles and indicators (e.g., pH indicator, ammonia gas indicator, oxidation indicator, and other volatile organic compounds indicators). After being augmented by machine learning, the limit of detection reaches as low as 17.1 ppm for ammonia detection and the accuracy achieved up to 99.2% for salmon freshness estimation, which satisfied the application in food supply chains. The system balanced the trade-off between detection sensitivity, stability, and cost with the ability for scalable batch production. [ABSTRACT FROM AUTHOR]

[Display omitted] • 3D-ACM involves two rounds of Hilbert transform and tensor product operations. • It significantly enhances the equivalent frequency points and sample numbers. • The R-squared values for PLS-LR, KNN, RF and CNN models approach or equal 1. • These supervised models are comparable to unsupervised models such as PCA-LR. We have developed a novel 3D asynchronous correlation method (3D-ACM) designed for the classification and identification of Chinese handmade paper samples using Raman spectra and machine learning. The 3D-ACM approach involves two rounds of tensor product and Hilbert transform operations. In the tensor product process, the outer product of the spectral data from different samples within the same category is computed, establishing inner connections among all samples within that category. The Hilbert transform introduces a 90-degree phase shift, resulting in a true three-dimensional spectral data structure. This expansion significantly increases the number of equivalent frequency points and samples within each category. This enhancement substantially boosts spectral resolution and reveals more hidden information within the spectral data. To maximize the potential of 3D-ACM, we employed six machine learning models: principal component analysis (PCA) with linear regression (LR), support vector machine (SVM) with LR, k-Nearest Neighbors (KNN), random forest (RF), and convolutional neural network (CNN). When applied to the 3D-ACM data preprocessing method, R-squared values of PLS-LR, KNN, RF and CNN supervised models, approached or equaled 1. This indicates exceptional performance comparable to unsupervised models like PCA. 3D-ACM stands as a versatile mathematical technique not confined to spectral data. It also eliminates the necessity for additional experimental setups or external control conditions, distinct from traditional two-dimensional correlation spectroscopy. Moreover, it preserves the original experimental data, setting it apart from conventional data preprocessing methods. This positions 3D-ACM as a promising tool for future material classification and identification in conjunction with machine learning. [ABSTRACT FROM AUTHOR]

Municipal papers and polyethylene terephthalate (PET) wastes are primary constituents of municipal solid waste (MSW) which necessitates effective disposal. Co-pyrolysis is an efficient transformation technology for the production of valuable gas and liquid fuels. Therefore, co-pyrolysis characteristics, kinetics, gas and liquid products of cellulose and PET mixtures were investigated in a two-stage reactor by multiple characterizations coupling with deep learning approach. The results indicated that there exhibited positive interaction for cellulose and PET co-pyrolysis in terms of mass difference (δ m) and mass loss rate difference (δ r) between experimental and calculated values. The thermal decomposition process and synergistic effects (δ m and δ r) were accurately predicted by deep learning approaches (R 2 =0.9823–0.9993) using temperature, catalyst, mixing ratio and heating rate variables. Feature importance revealed that the temperature, catalyst, heating rate and mixing ratio were in the descending order to affect the remaining mass from TG curves. And the temperature played a predominant role in synergistic effects. The Flynn-Wall-Ozawa (FWO) method was more suitable for fitting the pyrolysis process to obtain activation energy (E a) with higher R 2 (0.94714–0.99640) compared with Kissinger-Akahira-Sunose (KAS) method. When the mixing ratio of cellulose and PET was 1:1, the E a was significantly reduced to 80.73 KJ/mol, and further reduced to 73.04 KJ/mol by introducing the catalyst, as compared to E a of individual cellulose (178.95 KJ/mol) and PET (198.34 KJ/mol). Co-pyrolysis of cellulose and PET led to a reduction of carbohydrates, furans, alcohols, ketones, and phenols, while the content of acids was remarkably increased which was consistent with the observation in FTIR that the absorption peak of C＝O became sharp and strong. The introduction of ZSM-11 resulted in an increase in aromatics and a decrease in acids content owing to aromatization and deoxygenation. This work is expected to offer beneficial guidance for the efficient disposal of MSW and the application of deep learning methods. [Display omitted] • The interactive pathway for catalytic co-pyrolysis of cellulose and PET was proposed. • The activation energy reached the lowest 73.04 KJ/mol when the mixing ratio was 1:1. • Optimized convolutional neural network predicted synergistic effects with R 2 > 0.99. • Feature importance for TG was temperature > catalyst > heating rate > mixing ratio. [ABSTRACT FROM AUTHOR]

Both the ABO and Rhesus (Rh) blood groups play crucial roles in blood transfusion medicine. Herein, we report a simple and low-cost paper-based analytical device (PAD) for phenotyping red blood cell (RBC) antigens. Using this Rh typing format, 5 Rh antigens on RBCs can be simultaneously detected and macroscopically visualized within 12 min. The proposed Rh phenotyping relies on the presence or absence of hemagglutination in the sample zones after immobilizing the antibodies targeting each Rh antigen. The PAD was optimized in terms of filter paper type, antibodies, and distance of the visualization zone. In this study, the optimal conditions were Whatman filter paper Grade 4; anti-D, –C, -E, -c, and -e antibodies; RBC suspension of 30%; and a visualization zone of 1 cm above the sample zone. The accuracy of simultaneously phenotyping the five Rh RBC antigens in the blood samples (n = 4692) was 99.19%, comparable with the accuracy of the gold-standard tube method used by blood bank laboratories in several regions of Thailand. Furthermore, decision making based on this method can be assisted by deep learning. After implementing a two-stage objective detection algorithm (YOLO v4-tiny) and classification model (DenseNet-201), the ambiguous images (n = 48) were interpreted with 100% accuracy. The PAD integrated with customized-region convolutional neural networks can reduce the interpretation discrepancies in RBC antigen phenotyping in any laboratory. [Display omitted] • Five Rh antigens typing PADs combined with deep learning algorithm for an assisted human-decision. • Rh antigens typing PADs were tested with real blood samples and compared with the standard tube method. • Dataset of photographs following Rh PADs testing were trained and evaluated by the in-house deep learning platform CiRA CORE. • Misinterpretation caused by weak or ambiguous reactions was solved by the CiRA CORE platform. [ABSTRACT FROM AUTHOR]

[Display omitted] • In-field measurement of nitrite as carcinogen is important for food safety. • A fully integrated colorimetric detection system for nitrite is offered. • APP is combined with DCNN as visual monitoring platform. • Validity period of test paper is prolonged from 7 d to more than 30 d. • The accuracy of food classification is high as 91.33–100% Nitrite is one of the most common carcinogens in daily food. Its simple, rapid, inexpensive, and in-field measurement is important for food safety, based on the requirements of the standard from Codex Alimentarius Commission and China. Using polyacrylonitrile (PAN) and thin layer silica gel (SG), p-aminophenylcyclic acid (SA) and naphthalene ethylenediamine hydrochloride (NEH), as carriers and chromogenic agents, respectively, PAN-NSS as nitrite color sensor is proposed. After fixing and protecting of SA and NEH with layer-upon-layer PAN, the validity period of the test paper can be prolonged from 7 days to more than 30 days. The reproducibility of PAN-NSS preparation is ensured by electrospinning. Combined with PAN-NSS, deep convolutional neural network (DCNN) and APP as a visual monitoring platform, which has the functions of rapid sampling, data processing and transmission, intuitive feedback, etc., and provides a fully integrated detection system for field detection. [ABSTRACT FROM AUTHOR]

An Election is a method of selection of individuals to hold the public office in democracy. Ballot is basically a piece of paper that is used to cast vote during election. In ballot paper voting system each voter uses a ballot paper which is not shared and basically it is a paper printed with the name and symbols of the candidates. The Electronic Voting Machine is basically a memory recorder which records the vote casted by the voters. In this paper, main advantages of E-voting systems for country is highlighted. For constructing E-voting systems, every countries need to do great attention to Verification and Validation requirements. In this research, E-voting scheme with face recognition using deep learning technique is proposed. The process of casting vote is accomplished by blockchain technology and blind signature mechanism. The main objective of the proposed scheme is to explore the positive effects of security and safety in online voting system. • The Election is a method of selection of individuals to hold the public office in democracy. • The Electronic Voting Machine is basically a memory recorder which records the vote casted by the voters. • The aim of the research is to E-voting scheme with face recognition using deep learning technique is proposed. • The main objective of the proposed scheme is to explore the positive effects of security and safety in online voting system. [ABSTRACT FROM AUTHOR]

The accumulation of lipid oxidation and biogenic amines is the primary cause of pork sausage spoilage during storage. Therefore, this study aimed to develop a colorimetric microfluidic paper analytical device (μPAD) that specifically responded to these two factors to evaluate sausage spoilage during storage. A dataset consisting of 4096 images of μPADs was collected, and a convolutional neural networks (CNN)-based classification model (Resnet50) was trained and tested with an accuracy, F1 score, and recall rate of 97.10%, 97.14%, and 99.17%, respectively. Additionally, the CNN-based model was integrated into a smartphone application with user-friendly interfaces catering to both professional and non-professional users. Furthermore, the classification method was validated by predicting the shelf life of sausages stored at different temperatures. Compared to conventional methods, this approach provided a cost-effective, rapid, and portable detection method for assessing pork sausage freshness while broadening the application of smartphone-based colorimetric μPADs in food safety and quality control. • A microfluidic paper-based analytical device (μPAD) was prepared. • A CNN model (Resnet50) was trained and embedded in a smartphone application. • TBARs and biogenic amines were colorimetric indicators of pork sausages' freshness. • The predictive model's accuracy was above 97% and validated by shelf-life. • The operation was low-cost and user-friendly. [ABSTRACT FROM AUTHOR]

Diabetic retinopathy (DR) poses a significant challenge in diabetes management, with its progression often asymptomatic until advanced stages. This underscores the urgent need for cost-effective and reliable screening methods. Consequently, the integration of artificial intelligence (AI) tools presents a promising avenue to address this need effectively. We provide an overview of the current state of the art results and techniques in DR screening using AI, while also identifying gaps in research for future exploration. By synthesizing existing database and pinpointing areas requiring further investigation, this paper seeks to guide the direction of future research in the field of automatic diabetic retinopathy screening. There has been a continuous rise in the number of articles detailing deep learning (DL) methods designed for the automatic screening of diabetic retinopathy especially by the year 2021. Researchers utilized various databases, with a primary focus on the IDRiD dataset. This dataset consists of color fundus images captured at an ophthalmological clinic situated in India. It comprises 516 images that depict various stages of DR and diabetic macular edema. Each of the chosen papers concentrates on various DR signs. Nevertheless, a significant portion primarily focused on detecting exudates, which remains insufficient to assess the overall presence of this disease. Various AI methods have been employed to identify DR signs. Among the chosen papers, 4.7 % utilized detection methods, 46.5 % employed classification techniques, 41.9 % relied on segmentation, and 7 % opted for a combination of classification and segmentation. Metrics calculated from 80 % of the articles employing preprocessing techniques demonstrated the significant benefits of this approach in enhancing results quality. In addition, multiple DL techniques, starting by classification, detection then segmentation. Researchers used mostly YOLO for detection, ViT for classification, and U-Net for segmentation. Another perspective on the evolving landscape of AI models for diabetic retinopathy screening lies in the increasing adoption of Convolutional Neural Networks for classification tasks and U-Net architectures for segmentation purposes; however, there is a growing realization within the research community that these techniques, while powerful individually, can be even more effective when integrated. This integration holds promise for not only diagnosing DR, but also accurately classifying its different stages, thereby enabling more tailored treatment strategies. Despite this potential, the development of AI models for DR screening is fraught with challenges. Chief among these is the difficulty in obtaining the high-quality, labeled data necessary for training models to perform effectively. This scarcity of data poses significant barriers to achieving robust performance and can hinder progress in developing accurate screening systems. Moreover, managing the complexity of these models, particularly deep neural networks, presents its own set of challenges. Additionally, interpreting the outputs of these models and ensuring their reliability in real-world clinical settings remain ongoing concerns. Furthermore, the iterative process of training and adapting these models to specific datasets can be time-consuming and resource-intensive. These challenges underscore the multifaceted nature of developing effective AI models for DR screening. Addressing these obstacles requires concerted efforts from researchers, clinicians, and technologists to develop new approaches and overcome existing limitations. By doing so, a full potential of AI may transform DR screening and improve patient outcomes. [ABSTRACT FROM AUTHOR]

Offshore wind-hydrogen systems operate in harsh marine environments for extended periods, posing risks of low accessibility and high failure rates. This paper proposes a data-driven fault detection framework for offshore wind-hydrogen systems, aiming to promptly detect potential faults based on the system's physical parameters. The research establishes a comprehensive model based on the operating principles of offshore wind-hydrogen systems. The study uses fault injection techniques to simulate common partial faults in offshore wind-hydrogen systems and collects relevant physical parameters (such as wind turbine power generation, energy storage battery charging/discharging current, and electrolyzer hydrogen production rate). A fault detection model was constructed using a combination of Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to enable precise detection of potential faults in the system. The established model provides theoretical support for designing, optimizing, and operating offshore wind-hydrogen systems, reducing reliance on actual experiments and lowering project risks and costs. Introducing artificial faults can evaluate the system's performance in different fault scenarios. This paper proposes a CNN-BiLSTM fault detection method that achieves automatic feature extraction and high-precision classification of time-series fault data, confirming the practicality and feasibility of offshore wind-hydrogen systems. This investigation realizes the integration of the offshore wind-hydrogen system model and deep learning, as well as a fully automated learning process from data to fault detection. By calculating and comparing results, it is verified that the framework has a high accuracy of 96.9%. This innovative research offers new methods and perspectives for enhancing the reliability and efficiency of fault detection in offshore wind-hydrogen systems. • A comprehensive multi-system simulation model for offshore wind-hydrogen systems is established. • Fault injection is employed to acquire data samples for offshore wind-hydrogen systems. • Utilizing the CNN-BiLSTM method, a high-accuracy deep learning fault detection model is crafted. • A simulation model-based data-driven deep learning framework for fault detection is devised in this study. [ABSTRACT FROM AUTHOR]

In order to accurately estimate the period of X-ray pulsars to improve navigation performance, this paper proposes a pulsar period estimation method based on photon energy using reverse Hilbert coding and double Convolutional Neural Networks (CNNs) discrimination. This method uses photon energy information to perform epoch folding. It converts one-dimensional contour information into two-dimensional image signals through reverse Hilbert curve and recognizes contour image features through CNN models to determine the optimal period. According to the simulation results, the period estimation accuracy of this method is 0.5350 ns, which is 65.71% higher than the χ 2 epoch folding method. The contour phase accuracy is 0.0004767, which is 41.93% higher than the χ 2 epoch folding method. At the same time, the observation time and noise interference that may affect the accuracy of period estimation are also quantitatively analyzed. In addition, in order to simulate real navigation scenarios, this paper also conducts dynamic period estimation experiments on PSR B0531+21 pulsar in a specific period of time. The method proposed in this paper has the advantages of high precision, fast calculation speed, strong anti-interference ability and accurate dynamic period estimation, which can significantly improve the navigation performance of X-ray pulsars. • The proposed period estimation method uses photon energy information for contour weighted folding. • The proposed method uses reverse Hilbert curve to convert one-dimensional contour information into two-dimensional image information. • Convolutional Neural Network models are used to optimize pulsar period estimation. [Display omitted] [ABSTRACT FROM AUTHOR]

In recent years, image semantic segmentation technology has developed rapidly, but image annotation usually requires a significant amount of human and financial resources, especially for remote sensing image annotation, which can be expensive and sometimes even unaffordable. To address this issue, this paper integrates the idea of curriculum learning into the self-training method and screens reliable pseudo-labels through computing image-level confidence, significantly reducing the confirmation error problem. Furthermore, the semi-supervised model in this paper combines implicit semantic enhancement with strong data augmentation, which can reduce the coupling between the teacher model and the student model's prediction distribution and enhance the model's robustness. Finally, the proposed semi-supervised method is experimentally verified using the ISPRS competition dataset and compared with existing state-of-the-art (SOTA) methods. Experimental results show that the proposed semi-supervised segmentation method achieves higher segmentation accuracy compared to self-training methods. Moreover, despite not using iterative training to simplify the training process, the proposed method still yields satisfactory segmentation results. [ABSTRACT FROM AUTHOR]

This paper discusses the role of Transfer Learning (TL) and transformers in cancer detection based on image analysis. With the enormous evolution of cancer patients, the identification of cancer cells in a patient's body has emerged as a trend in the field of Artificial Intelligence (AI). This process involves analyzing medical images, such as Computed Tomography (CT) scans and Magnetic Resonance Imaging (MRIs), to identify abnormal growths that may help in cancer detection. Many techniques and methods have been realized to improve the quality and performance of cancer classification and detection, such as TL, which allows the transfer of knowledge from one task to another with the same task or domain. TL englobes many methods, particularly those used in image analysis, such as transformers and Convolutional Neural Network (CNN) models trained on the ImageNet dataset. This paper analyzes and criticizes each method of TL based on image analysis and compares the results of each method, showing that transformers have achieved the best results with an accuracy of 97.41% for colon cancer detection and 94.71% for Histopathological Lung cancer. Future directions for cancer detection based on image analysis are also discussed. [ABSTRACT FROM AUTHOR]

The integration of deep learning, computer vision, and advanced algorithms has ushered in a transformative era in the prediction of human driving behavior, consequently revolutionizing road safety. This paper focuses on an innovative convergence of technology that addresses critical issues like driver fatigue and distracted driving by automatically identifying and categorizing diverse driving behaviors. Neural network architectures, such as VGG16, AlexNet, and ResNet are described in this paper that have propelled accuracy in behavior classification to remarkable levels. However, the quest for safer roads remains ongoing, with promising avenues lying ahead. First and foremost, the creation of extensive, diverse, and meticulously annotated datasets is paramount. These datasets serve as the bedrock upon which future models can be trained, enhancing their robustness and generalizability across a spectrum of driving scenarios. Real-time models represent another pivotal frontier. These models hold the potential to provide timely interventions and support systems for drivers, thus preventing accidents proactively. The exploration of hybrid techniques that amalgamate the strengths of various neural network architectures presents an exciting avenue, promising to further push the boundaries of prediction accuracy. Furthermore, this paper also discusses the fusion of multi-modal data, encompassing sensor data from IoT and smartphone devices, that holds immense promise. This holistic approach promises a more comprehensive understanding of driver behavior by integrating diverse data sources, ultimately contributing to the creation of safer road environments.In this research paper, we also explore these cutting-edge developments in deep learning and computer vision, emphasizing technical novelty and innovation. Through an interdisciplinary approach, we envision a future where the synergy of technology, data, and human behavior leads to a substantial reduction in road accidents and improved road safety. [ABSTRACT FROM AUTHOR]

Skin cancer is one of the most prevalent forms of cancer around the world. Initial diagnosis relies on visual assessment of the affected area, followed by detailed dermoscopic analysis. The development of an automated system for classifying skin lesions poses a considerable challenge due to inherent noise and subtle variability in lesion images. Deep convolutional neural networks have demonstrated exceptional proficiency in image classification tasks spanning diverse domains. This paper demonstrates an end-to-end classification architecture built on top of transfer learning with data augmentation. The proposed model capitalizes on pre-trained architectures such as DenseNet, VGG-16, and Inception for feature extraction, and employs fully connected dense layers for categorizing seven distinct types of lesions. Several data augmentation techniques are also used to handle the class imbalance problem. Extensive experimentation encompassing various hyperparameters, imbalanced data scenarios, and balanced datasets was conducted to refine the automated skin lesion system. The proposed approach achieved a notable accuracy of 98% on the HAM10000 dataset and 94% on the ISIC-2019 dataset. Importantly, the experimental findings surpassed the performance of current state-of-the-art models for lesion classification. Furthermore, this paper examines the impact of class imbalance and data augmentation on the model's accuracy. [ABSTRACT FROM AUTHOR]

Major Depressive Disorder (MDD) is characterized by low mood, loss of interest and even suicidal ideation. Electroencephalogram based diagnosis of a variety of neurological conditions has been conducted in recent years using modern neurocomputing and deep learning approaches. Privacy is a high concern for medical data over distributed training scenarios. Hence, this paper aims to develop an EEG-based privacy-preserved system to identify MDD through the Federated Learning (FL) approach. In this study, training for 3-channel EEG-based MDD screening is introduced over FL using deep learning (DL) algorithms such as Long Short-Term Memory (LSTM), Bidirectional LSTM (Bi-LSTM), Gated Recurrent Unit (GRU), and One Dimensional Convolutional Neural Network (1D-CNN). A privacy-preserving solution for MDD patients utilizing FL is advantageous because clinical data is sensitive and most people do not want to share their personal information. Hence, the analysis of the comparative results for multiple applicable strategies including Independent and Identically Disturbed (IID) data, non-IID data, and algorithms provide proof that FL can be used to train DL models. The MODMA dataset of 3-channel EEG with 26 MDD and 29 non-MDD individuals is used in this paper. Future study on MDD has several potential areas of use and these FL approaches can also be coupled with new technologies. [ABSTRACT FROM AUTHOR]

In an era where the demand for efficient and practical machine learning (ML) solutions on resource-constrained devices is evergrowing, the realm of tiny machine learning (TinyML) emerges as a promising frontier. Motivated by the need for lightweight, low-power models that can be deployed on edge devices, this research paper presents an innovative TinyML model tailored to recognize Arabic hand gestures executed in mid-air. With a primary emphasis on the precise classification of Arabic numbers through these expressive hand movements, the paper unveils a comprehensive dataflow architecture. This intricate architecture processes accelerometer and gyroscope data to derive exact 2D gesture coordinates, a fundamental component of the recognition process. The cornerstone of the proposed model is the integration of Convolutional Neural Networks (CNNs), elucidating their exceptional role in achieving an impressive 93.8% accuracy rate in the classification of diverse Arabic Numbers gestures. This remarkable level of precision underscores the model's efficacy and resilience, rendering it an ideal candidate for real-time deployment in various gesture recognition scenarios. [ABSTRACT FROM AUTHOR]

Autonomous spacecraft relative navigation via monocular images became a hot topic in the past few years and, recently, received a further push thanks to the constantly growing field of artificial neural networks and the publication of several spaceborne image datasets. Despite the proliferation of spacecraft relative-state initialization algorithms developed, most architectures adopt computationally expensive solutions relying on convolutional neural networks (CNNs) that provide accurate output at the cost of a high computational burden that seems unfeasible for current spaceborne hardware. The paper addresses this issue by proposing a novel pose initialization algorithm based on lightweight CNNs. Inspired by previous state-of-the-art algorithms, the developed architecture leverages a fast and accurate target detection CNN followed by a line segment detection CNN capable of running with low inference time on mobile devices. The line segments and their junctions are grouped into complex geometrical groups, reducing the solution search space, and subsequently, they are adopted to extract the final pose estimate. As a main outcome, the analyses demonstrate that the lightweight architecture developed scores high accuracy in the pose estimation task, with a mean estimation error of less than 10 cm in translation and 2.5°in rotation. The baseline algorithm scores a mean SLAB error of 0.04552 with a standard deviation of 0.22972 in the test dataset. Detailed analyses demonstrate that the uncertainties on the overall pose score are driven mainly by errors in the relative attitude, which gives the highest contribution to the pose error metric adopted. The analyses on the error distributions point out that the uncertainties on the estimated relative position are higher in the camera boresight axis direction. Concerning the relative attitude, the algorithm proposed has higher uncertainties in estimating directions of the target x and y axes due to ambiguities related to the target geometry. Notably, the target detection CNN trained in this work outperforms the previous top scores in the benchmark dataset. The performances of the proposed algorithm have been investigated further by analyzing the effects on the accuracy due to the relative distance and the presence of background in the images. Lastly, the paper delves into the possibility of adopting a sub-portion of the 2D-to-3D match matrix made by the most complex perceptual groups identified that positively affects the overall run-time, pointing out the performances in terms of accuracy of the estimates and providing a comparison of both the baseline and the reduced match matrix versions against state-of-the-art algorithms concerning relative position and attitude errors and solution availability, highlighting the high accuracy and solution availability of the proposed architectures. • New relative pose initialization algorithm based on the detection of line segments. • Detailed literature review and description of available spaceborne image datasets. • Improvement of state of the art in spacecraft detection using lightweight CNN. • Assessment of accuracy of the proposed architecture and error sources analyses. • Proven feasibility of the approach via comparison with other architectures. [ABSTRACT FROM AUTHOR]

This paper introduces a novel application of neural style transfer to video sequences, leveraging pre-trained Convolutional Neural Network (CNN) models. By combining content and style losses in an optimization process, the approach transforms video frames into visually captivating compositions, opening new avenues for artistic expression in visual storytelling and filmmaking. The procedure begins with meticulous preprocessing of video frames to align them with the specifications of the powerful VGG16 model. A content model is then constructed to extract activations from the 14th layer of the VGG network, forming the groundwork for nuanced content depiction. Style information is computed by aggregating data from a combination of convolutional layers, resulting in a multifaceted, artistically complex tapestry. The paper introduces a well-balanced loss function that combines style and content losses, serving as the foundation for the ensuing optimization procedure. This careful balancing between style adherence and content authenticity yields visually stunning synthesis, enhancing video sequence quality and artistic resonance. The paper also delves into a detailed analysis of hyper parameters, particularly style weights, and introduces a novel pixel value scaling method for enhanced visual coherence. Experimental findings demonstrate the efficiency and adaptability of the proposed approach, showcasing the seamless integration of content and style for an immersive visual experience. This accomplishment marks a significant stride toward unlocking the creative potential of video content, ushering in a period of enhanced visual storytelling. [ABSTRACT FROM AUTHOR]

Renewable energy sources, driven by the global concern for climate change and the urgent need to reduce greenhouse gas emissions, are gaining increasing importance. Among them, solar energy stands out as a crucial renewable source and accurate solar irradiance forecasting is vital for its effective utilisation. Deep learning (DL) techniques have emerged as state-of-the-art solar irradiance forecasting methods in past years. However, traditional models that are widely used have inferior accuracy in forecasting. To bridge this gap, this paper presents an improved state-of-the-art model that leverages the convolutional property to forecast the time series data. We got a reduction of 8.32% in MAE compared to the base model. The paper's findings highlight the potential of DL-based approaches to significantly improve the accuracy of solar irradiance forecasts. [ABSTRACT FROM AUTHOR]

Cancer is a condition in which abnormal cells uncontrollably split and damage the body tissues. Hence, detecting cancer at an early stage is highly essential. Currently, medical images play an indispensable role in detecting various cancers; however, manual interpretation of these images by radiologists is observer-dependent, time-consuming, and tedious. An automatic decision-making process is thus an essential need for cancer detection and diagnosis. This paper presents a comprehensive survey on automated cancer detection in various human body organs, namely, the breast, lung, liver, prostate, brain, skin, and colon, using convolutional neural networks (CNN) and medical imaging techniques. It also includes a brief discussion about deep learning based on state-of-the-art cancer detection methods, their outcomes, and the possible medical imaging data used. Eventually, the description of the dataset used for cancer detection, the limitations of the existing solutions, future trends, and challenges in this domain are discussed. The utmost goal of this paper is to provide a piece of comprehensive and insightful information to researchers who have a keen interest in developing CNN-based models for cancer detection. [ABSTRACT FROM AUTHOR]

Deep neural networks have achieved outstanding performance in computer vision tasks. Convolutional Neural Networks (CNNs) typically operate in the spatial domain with raw images, but in practice, images are usually stored and transmitted in their compressed representation where JPEG is one of the most widely used encoder. Also, these networks are computationally intensive and slow. This paper proposes performing the learning and inference processes in the compressed domain in order to reduce the computational complexity and improve the speed of popular CNNs. For this purpose, a novel graph-based frequency channel selection method is proposed to identify and select the most important frequency channels. The computational complexity is reduced by retaining the important frequency components and discarding the insignificant ones as well as eliminating the unnecessary layers of the network. Experimental results show that the modified ResNet-50 operating in the compressed domain is up to 70% faster than the spatial-based traditional ResNet-50 while resulting in similar classification accuracy. Moreover, this paper proposes a preprocessing step with partial encoding to improve the resilience to distortions caused by low-quality encoded images. Finally, we show that training a network with highly compressed data can achieve a good classification accuracy with up to 93% reduction in the storage requirements of the training data. [ABSTRACT FROM AUTHOR]

With the development of artificial intelligence, robots are widely used in various fields, grasping detection has been the focus of intelligent robot research. A dual manipulator grasping detection model based on Markov decision process is proposed to realize the stable grasping with complex multiple objects in this paper. Based on the principle of Markov decision process, the cross entropy convolutional neural network and full convolutional neural network are used to parameterize the grasping detection model of dual manipulators which are two-finger manipulator and vacuum sucker manipulator for multi-objective unknown objects. The data set generated in the simulated environment is used to train the two grasping detection networks. By comparing the grasping quality of the detection network output the best grasping by the two grasping methods, the network with better detection effect corresponding to the two grasping methods of two-finger and vacuum sucker is determined, and the dual manipulator grasping detection model is constructed in this paper. Robot grasping experiments are carried out, and the experimental results show that the proposed dual manipulator grasping detection method achieves 90.6% success rate, which is much higher than the other groups of experiments. The feasibility and superiority of the dual manipulator grasping detection method based on Markov decision process are verified. [ABSTRACT FROM AUTHOR]

The effect of target tracking is not ideal when facing various complex tracking scenarios such as non-rigid deformation of target, frequent occlusion, clutter of target background and interference of similar objects. In this paper, the feature based on deep convolutional neural network is used for target tracking in moving scenes, and a sliding window target segmentation method is proposed to study the impact of data normalization and data set expansion on the final result. In order to select more distinguishing features, principal component analysis is used to process the features of Deep Convolution Neural Network (DCNN), and the features of different network layers of DCNN are compared. The feature coding algorithm is studied, and the extracted DCNN features are encoded by Fisher Vectors algorithm, and compared with the locality-constrained linear encoding technique. Experiments show that the feature based on deep convolutional neural network in this paper can obtain higher accuracy than the traditional feature fusion method. According to the result analysis, the tracking accuracy of deep convolutional neural network algorithm is improved under the condition of illumination variation. In the case of local occlusion, the tracking accuracy is also improved. [ABSTRACT FROM AUTHOR]

In document forensics, identifying ink mismatches is crucial for detecting forgeries and determining document authenticity. However, identifying and separating specific inks from paper can be challenging. Hyperspectral imaging can capture unique spectral patterns exhibited by inks composed of different materials, even when their colors appear identical. Hyperspectral document analysis (HSDI) can be employed to authenticate documents by analyzing the ink. Earlier studies had insufficiently accurate black ink detection, so this paper proposes a novel approach using deep learning and pre-processing methods to improve black ink detection accuracy. The proposed approach uses supervised deep learning to identify ink mismatches in hyperspectral document images. The study evaluated the performance of the proposed model using a hyperspectral image dataset consisting of UWA (University of Western Australia) writing ink in both blue and black colors and different types of artificially identical color inks mixed in various ratios to find ink mismatches. The results showed that the proposed system performed better than other systems reported in the literature, improving the average accuracy by up to 0.18% for blue and 0.36% for black. The proposed method accurately detects ink mismatches and identifies various inks based on their unique spectral response, rendering it highly beneficial for applications in document forensics. [ABSTRACT FROM AUTHOR]

• A new method is proposed for the behavioral analysis of bars charts images from documents. • The method consists of supervised learning combined with formal analysis. • Extracted information is mapped into Stochastic Petri-net to deduce the monotonic behavior of the chart data. • User-based and mathematical evaluation against state of-the-art tools proves the efficiency of our approach. The accurate understanding of documents depends on the effective processing of its individual modalities such as text, diagrams, tables, charts, and etc. While many research papers focus on extracting the illustrated values in bars charts, little work has been conduced regarding the analysis of this data to deduce behavioral information. In this paper, we present a methodology for the recognition and behavioral analysis of bar chart images. In particular, a Convolutional Neural Network model is trained for the initial chart classification and keypoints are extracted for the translation of identified columns into curves. By analyzing the curves associations and interactions with each other, and converting them into Stochastic Petri-nets, the methodology can perform behavioral analysis and deduce their functional characteristics. Empirical evaluation against state-of-the-art chart analysis tools shows high user-approval scores for the proposed method regarding the depth of extracted information and quality of responses. [ABSTRACT FROM AUTHOR]

• Proposing physics-informed DCNN for HFI-SCB temperature field reconstruction. • Proposing Deep MC-QR method to quantify data uncertainty caused by noise. • Proposing HFI-SCB reliability analysis method based on interval multilevel BN. Temperature field reconstruction is essential for analyzing the reliability of a high-density functionally integrated satellite circuit board (HFI-SCB). As a representative deep learning model, the deep convolutional neural network (DCNN) is a powerful tool for reconstructing the HFI-SCB temperature field. However, DCNN needs a lot of labeled data to learn its parameters, which is contrary to the fact that actual satellite engineering can only acquire noisy unlabeled data. Thus, this paper proposes an unsupervised method, i.e., the physics-informed deep Monte Carlo quantile regression method, for reconstructing the HFI-SCB temperature field and quantifying the data uncertainty caused by sensor noise. The proposed method combines a DCNN with known physics knowledge to reconstruct an accurate HFI-SCB temperature field using only monitoring point temperatures. Besides, the proposed method can quantify the data uncertainty by the Monte Carlo quantile regression. Based on the reconstructed temperature field and the quantified data uncertainty, this paper builds an interval multilevel Bayesian Network to analyze the HFI-SCB reliability. Two case studies are used to validate the proposed method. [ABSTRACT FROM AUTHOR]

Overheating of power transformers, low-voltage panels, and medium-voltage components in Electric Transformer Rooms (ETRs) can result from various factors, such as contact issues, irregular loads, and other similar problems. Thermal imaging shows significant potential for detecting faults in power equipment. However, its effectiveness is hindered by the complex thermal patterns of faults and variability in equipment and environmental conditions, making accurate fault detection challenging. This paper aims to study the effectiveness of transfer learning architectures for automating equipment classification in ETRs. This work applies four transfer learning architectures: AlexNet, SqueezeNet, VGG19, and GoogLeNet. The findings of the testing phase demonstrated that the use of transfer learning by fine-tuning pre-trained convolutional neural networks was highly effective in the classification of thermal images captured from ETRs, with the models achieving accuracy rates between 86.98% and 100%, and F 1 -Scores between 86.79% and 100%. [Display omitted] • Transfer learning is applied to automate the classification of thermal images of equipment in ETRs. • A thermal imaging dataset is set up and augmented to improve the generalization abilities of proposed models. • Establish standard comparisons among four transfer learning architectures. [ABSTRACT FROM AUTHOR]

Automatic modulation recognition (AMR) stands as a pivotal operation within industrial cognitive radio systems. State-of-the-art real-valued convolutional neural networks (CNNs) have innovated modulation recognition but view complex signal components as separate real inputs, impairing signal phase integrity and model interpretability. This paper presents an innovative AMR method known as the CVCNN-LSTM. Our study aims to leverage CNNs in conjunction with a long short-term memory network (LSTM) to harness the strengths of both networks while mitigating their weaknesses. This approach enhances the learning of original I/Q signal features, thus improving recognition performance. The proposed network is composed of multiple LFLBs and an LSTM layer. Each LFLBs is primarily composed of a convolutional layer and an average pooling layer, which play a key role in enabling local correlation learning and hierarchical correlation extraction. Recognizing that I/Q data inherently possesses a complex-valued structure, we advocate using end-to-end complex-valued CNN and complex-valued LSTM instead of dual-channel real-valued networks for modulation recognition. We conduct experiments to evaluate complex-valued networks and demonstrate that our method surpasses current state-of-the-art approaches in the AMR field. [ABSTRACT FROM AUTHOR]

Switchgear is a vital component of modern power systems, responsible for regulating the flow of electrical power. Contact issues, irregular loads, and other similar problems can cause switchgear to overheat, leading to unexpected disturbances and potential damage to the power equipment. Thermal imaging shows significant potential and is increasingly employed to detect faults in power equipment. However, the unique characteristics of thermal images often pose challenges to accurate fault detection. This research aims to study the effectiveness of transfer learning architectures for switchgear fault detection. This paper applies eleven transfer learning architectures, including SqueezeNet, GoogLeNet, InceptionV3, DenseNet201, ResNet50, Xception, InceptionResNetV2, ShuffleNet, EfficientNetB0, AlexNet, and VGG19. The results of the testing phase demonstrated that the application of transfer learning by fine-tuning pre-trained convolutional neural network architectures was highly effective in the classification of thermal images captured from switchgear units. The models achieved accuracy rates between 83.87% and 98.38%, and values of F 1 -Scores between 83.11% and 98.34% in the pre-trained architectures. [Display omitted] • Transfer learning is applied to address the unique characteristics of thermal images for switchgear fault detection. • A thermal image dataset is setup and augmented to improve the classification performance. • Establish standard comparisons among eleven transfer learning architectures. • Achieve rapid and precise classification with the proposed transfer learning architectures. [ABSTRACT FROM AUTHOR]

• Integration of AI to boost the analysis of defects of architectural coverings layers. • The synergy of AI enhances the sound analysis of customized hardware called PICUS. • A multi-class classification accuracy up to 85% in identifying defective areas. • Up to 99% in binary classification, demonstrating the highest precision. • The method revolutionizes the approach to detection and analysis of defective areas. This paper aims is to show an automated intelligent measurement system for the detection of adhesion defects between architectural antique plaster layers. The method emulates the traditional conservators' procedure based on acoustical perturbations, auscultation, detection and classification. The system makes use of a hardware device, known in literature as PICUS, for the generation and acquisition of acoustic signals, while the processing of the acquired signals is handled by a deep learning (DL) architecture designed ad hoc. After a brief description of the PICUS system and the acoustic data acquisition procedure, the whole architecture of the DL system is carefully described. The proposed method has been validated by a significant case study. The system shows an accuracy of up to 82% (± 2%) in multi-class classification and up to 99% (± 1%) in binary classification. In particular, the obtained results suggest a satisfactory precision in the detection of areas where stabilization is necessary. [ABSTRACT FROM AUTHOR]

Convolutional neural networks trained with satellite image time series have demonstrated their potential in land cover classification in recent years. Nevertheless, the rationale leading to their decisions remains obscure by nature. Methods for providing relevant and simplified explanations of their decisions as well as methods for understanding their inner functioning have thus emerged. However, both kinds of methods generally work separately and no explicit connection between their findings is made available. This paper presents an innovative method for refining the explanations provided by channel-based attention mechanisms. It consists in identifying correspondence rules between neuronal activation levels and the presence of spatiotemporal patterns in the input data for each channel and target class. These rules provide both class-level and instance-level explanations, as well as an explicit understanding of the network operations. They are extracted using a state-of-the-art redescription mining algorithm. Experiments on the Reunion Island Sentinel-2 dataset show that both correct and incorrect decisions can be explained using convenient spatiotemporal visualizations. [ABSTRACT FROM AUTHOR]

In Computer-Controlled Optical Surfacing technology, the precision of the removal function directly affects the accuracy of computer-aided processing software predictions, which in turn influences subsequent polishing machine processing. A key parameter for constructing the removal function is the material removal rate, which is often challenging to obtain accurately. Currently, the Preston equation is widely used to describe the principles of material removal. However, as a linear equation that omits many factors, it struggles to accurately model the removal function in complex machining scenarios. Therefore, this paper proposes a hybrid neural network model combining Convolutional Neural Networks and Bidirectional Long Short-Term Memory to predict the material removal rate. The model's parameters are optimized using an improved Grey Wolf Optimization algorithm, ultimately establishing a removal function closely consistent with an actual removal function. We first tested our method on the PHM2016 Data Challenge dataset, achieving a mean squared error of 6.19 and an R2 of 0.9949, outperforming other mainstream neural network prediction models developed in recent years. Additionally, we further validated the performance of the neural network using a small grinding head polishing dataset, achieving MSE and R2 values of 1.9035 and 0.99902, respectively. Finally, we applied this method to construct the removal function on an actual small grinding head production line. Compared to the traditional Preston equation-based removal function, the predicted residual surface's PV and RMS errors were reduced from 28.24 % to 35.58 %–4.563 % and 4.86 %, respectively. These validation results demonstrate that the proposed method not only facilitates easier acquisition of the removal function model but also significantly enhances the accuracy of computer-aided processing software predictions, thereby better guiding ultra-precision machining processes. • Proposed a CNN-BiLSTM hybrid neural network to predict material removal rates. • First to construct a small grinding head removal function using a BiLSTM Predictor. • Optimized the neural network parameter sets using an improved Grey Wolf algorithm. • Achieved MSE of 6.19 and R2 of 0.9949 on the PHM2016 Data Challenge dataset. • Reduced polishing residual surface PV and RMS prediction errors to 4.563 % and 4.86 %. [ABSTRACT FROM AUTHOR]

Identifying gusts and turbulence events is of primary importance for designing future gust load alleviation systems, calculating airframe load, and analysing incidents. Due to the impossibility of their direct measurement, indirect methods are used and ad hoc experiments are necessary to validate the methodology. This paper employs Convolutional Neural Network and Long Short Term Memory (CNN-LSTM) as well as CNN models for in-flight gust identification. Two aeroelastic models, with different levels of fidelity, representative of a civil and commercial aircraft, are used to generate gust responses to train and test the Deep Learning (DL) models. The results highlight the capability of both LSTM-CNN and CNN models in reconstructing gusts across the entire flight envelope of a civil commercial aircraft. The CNN model demonstrated its ability to identify gusts and turbulence when they occur concurrently, similar to real-world scenarios, in a significantly shorter amount of time. Furthermore, its application to wind tunnel gust response measurements, where the inflow has previously been characterised, demonstrated the effectiveness of the proposed methodology for experimental measurements. • CNN-LSTM and CNN models employed for accurate gust identification. • Methods rigorously applied to both numerical and experimental data. • Utilizing aeroelastic aircraft models with varied fidelity for identification • Identified gusts compared with those from gust generator characterization. • Results showcase significant capability in accurate gust prediction. [ABSTRACT FROM AUTHOR]

• Transformer-based multitask network is designed for spacecraft pose estimation. • Matrix Fisher & Gaussian distributions are utilized for the pose uncertainty. • The robust neural network-based network vision navigation pipeline is created. Spacecraft pose estimation (SPE) plays a vital role in the relative navigation system for on-orbit servicing and active debris removal. Current deep learning-based methods have made great achievements on object pose estimation. However, towards the challenging onboard SPE missions, most existing Convolutional Neural Network (CNN) methods failed to capture remote vision attention, leading to the reduction of accuracy and robustness. In this paper, we presented an end-to-end multi-task Pyramid Transformer SPE network (PVSPE) consisting of two novel feature extraction modules: EnhancedPVT (EnPVT) and SlimGFPN. The EnPVT module is designed to combine global spatial and channel attention, while the Slim GFPN module can fuse features more effectively. Matrix Fisher and multivariate Gaussian distributions are further employed to model the uncertainty of pose regression to increase its accuracy. Extensive experiments are carried out on challenging SPEED + and SHIRT datasets, to validate the performances on pose estimation and vision-based navigation, respectively. The results show that the proposed PVSPE model achieved high accuracy for SPE on the SPEED + dataset even under different scales and severe illumination, demonstrating its robustness and high generalization. Leveraging the insightful uncertainty model of PVSPE, the vision-based navigation pipeline, combined with Kalman filters, accurately estimated the satellite pose under challenging rendezvous scenarios on the SHIRT dataset, with degree-level attitude errors and centimeter-level translation accuracy at steady-state. [ABSTRACT FROM AUTHOR]

Accurately evaluating the remaining useful life (RUL) of aircraft engines is crucial for ensuring operational safety and reliability, and serves as a critical foundation for making informed maintenance decisions. In this paper, a novel prediction framework is proposed for forecasting the RUL of engines, which utilizes a dual-frequency enhanced attention network architecture built upon separable convolutional neural networks. First, the information volume criterion (IVC) index and information content threshold (CIT) equation are designed, which are applied to quantitatively quantify the degradation features of the sensor and remove redundant information. In addition, this paper introduces two trainable frequency-enhanced modules, namely the Fourier transform module (FMB-f) and the wavelet transform module (FMB-w), to incorporate physical rules information into the prediction framework, dynamically capture the global trend and local details of the degradation index, and further improve the prediction performance and robustness of the prediction model. Furthermore, the proposed efficient channel attention block generates a unique set of weights for each possible vector sample, which establishes the interdependence among different sensors, thereby augmenting the prediction stability and precision of the framework. The experimental demonstrate that the proposed RUL prediction framework can deliver accurate RUL predictions. • The IVC and CIT are used to quantify and eliminate degradation information. • A dual-frequency block(FEB-f and FEB-w) with trainable parameters is proposed. • FEB-w and FEB-f jointly trained with SDFEPN for dynamic coordination. • The integration of physical rules into the SDFEPN enhances the interpretability. [ABSTRACT FROM AUTHOR]

Thanks to its richness in extractable features, Hyperspectral images (HSI) find an accelerated use in medical, industrial, agricultural, and environmental fields. In this paper, we present a wavelet-based reduction technique that creates a Hypercube containing the most significant features extracted from the original HSI and representing a multi-dimensional array that is utilized for training a Convolutional Neural Network (CNN), which is designed here to classify different types of surfaces or materials. The performance of this approach is tested and proved using two distinct datasets. Then, we compare the same approach with the PCA, a widely used reduction method. The most important contribution of this paper is the implementation of an FPGA-based parallel accelerator to train the same suggested CNN in only 10% of the computational time compared to the classical CPU-based techniques. The Microblaze will be explained and exploited here to play the role of an embedded microprocessor. • A Wavelet-based technique gives a reduced Hypercube rich in pixels spectrum features. • A CNN is designed to classify different types of surfaces or materials. • An FPGA-based parallel design is created to reduce 90% of the CNN training time. • The Microblaze is used to play the role of an embedded microprocessor. [ABSTRACT FROM AUTHOR]

Accurate prediction of PV power is essential to ensuring the safe and economic operation of power systems with high PV penetration. The current PV power prediction scheme considering the spatio-temporal correlation characteristics is relatively simple in data processing, resulting in low prediction accuracy; at the same time, the missing data also poses a great problem to the prediction. Therefore, in order to improve the prediction accuracy and solve the problem of missing data, this paper proposes a PV power spatio-temporal prediction model considering time-shift correction and a multi-station information fusion strategy Firstly, relevant power station clusters are constructed using hierarchical clustering, and a similar daily data filtering model considering the variation characteristics of daily power characteristic curves is proposed to filter the data; Secondly, multiple BP neural network models are constructed and multiple reference power stations with high relevance are predicted using irradiance information; Thirdly, the prediction results of multiple reference power stations are input to the data processing module for time-shift analysis and spatial correlation information fusion correction, which solves the missing data problem of the target power station to be predicted. Finally, it is input to One-dimensional Convolutional Neural Network(1DCNN) to achieve the power prediction of the target power station with missing data. The simulation analysis shows that the root mean square error (RMSE) of a sunny day forecast is 3.31%; the RMSE of a non-sunny day forecast is 9.65%, which proves the accuracy of this two-layer neural network is higher compared to other model structures, so the proposed scheme has certain reliability and accuracy in the prediction of PV power with missing data. • The paper examines the current issues and challenges with PV power forecasting. • A similar daily data filter considering the various characteristics of the daily PV power output is proposed. • A BP-1DCNN network considering spatio-temporal sharing is designed to predict the PV power of the missing data plants. • A time-shift correction and spatially relevant information fusion strategy are used to connect the two networks. • The spatio-temporally corrected network prediction model has higher accuracy and solves the problem of missing data. [ABSTRACT FROM AUTHOR]

Tactile sensing provides robots the ability of object recognition, fine operation, natural interaction, etc. However, in the actual scenario, robotic tactile recognition of similar objects still faces difficulties such as low efficiency and accuracy, resulting from a lack of high-performance sensors and intelligent recognition algorithms. In this paper, a flexible sensor combining a pyramidal microstructure with a gradient conformal ionic gel coating was demonstrated, exhibiting excellent signal-to-noise ratio (48 dB), low detection limit (1 Pa), high sensitivity (92.96 kPa−1), fast response time (55 ms), and outstanding stability over 15,000 compression-release cycles. Furthermore, a Pressure-Slip Dual-Branch Convolutional Neural Network (PSNet) architecture was proposed to separately extract hardness and texture features and perform feature fusion. In tactile experiments on different kinds of leaves, a recognition rate of 97.16% was achieved, and surpassed that of human hands recognition (72.5%). These researches showed the great potential in a broad application in bionic robots, intelligent prostheses, and precise human–computer interaction. [ABSTRACT FROM AUTHOR]

Cameras are rapidly becoming the choice for on-board sensors towards space rendezvous due to their small form factor and inexpensive power, mass, and volume costs. When it comes to docking, however, they typically serve a secondary role, whereas the main work is done by active sensors such as lidar. This paper documents the development of a proposed AI-based (artificial intelligence) navigation algorithm intending to mature the use of on-board visible wavelength cameras as a main sensor for docking and on-orbit servicing (OOS), reducing the dependency on lidar and greatly reducing costs. Specifically, the use of AI enables the expansion of the relative navigation solution towards multiple classes of scenarios, e.g., in terms of targets or illumination conditions, which would otherwise have to be crafted on a case-by-case manner using classical image processing methods. Multiple convolutional neural network (CNN) backbone architectures are benchmarked on synthetically generated data of docking manoeuvres with the International Space Station (ISS), achieving position and attitude estimates close to 1 % range-normalised and 1 deg, respectively, an established rule of thumb for the navigation measurement accuracy during final approach. The integration of the solution with a physical prototype of the refuelling mechanism is validated in laboratory using a robotic arm to simulate a berthing procedure. • A novel AI-based solution for spacecraft docking and refuelling is presented. • First demonstration of deep learning for vision-based pose estimation in docking. • Various CNN backbones are benchmarked on photorealistic ISS refuelling datasets. • ResNet-101 reports average 1.19% error in position, 0.29 ∘ in attitude per trajectory. • Prototypes of the developed mechanism are validated in lab with 7-DOF manipulator. [ABSTRACT FROM AUTHOR]

• The paper presents deep learning models to detect damage typology in patterned tiles. • Images of 5 classes of patterned tile damages were collected and annotated. • A new procedure based on a deep learning is proposed for damage detection in tiles. • Limitations in detecting damages on patterned tile surfaces are discussed. A prominent feature in Portuguese historic architecture is Portugal's azulejos or tiles that cover cultural heritage buildings with colorful patterns. However, tiles are prone to deterioration due to the quality of masonry materials, exposure over time, and natural and human factors. A careful approach is necessary to detect and assess tile damage in time to conserve cultural heritage. Deep learning (DL) methods are applied to detect deterioration and damage by automating vision-based monitoring. This study uses the You Only Look Once (YOLO), method to detect deterioration in tiles automatically. To obtain the initial dataset, over 5000 images of damage were collected, including cracks, craters, glaze detachment, and tile lacunae, as well as images with no defects. Additionally, a MobileNet model was used for binary classification of damaged and intact tiles to compare classification and detection approaches. Through the fine-tuning of hyperparameters and updating the dataset, an overall accuracy of over 72% for YOLO (multiple classification) and 97% accuracy for binary classification was achieved, demonstrating the adequacy of the tool for real-world applications. [ABSTRACT FROM AUTHOR]

Impact crater detection is one of the most important and critical studies of the geological history of planetary surfaces. Recent literature on crater identification demonstrates the powerful potential of deep-learning algorithms. However, these methods potentially assumed that the detection is conducted in devices with sufficient computing resources, and used networks with massive learnable parameters to obtain superb performance. In this paper, we proposed a lightweight tensorial convolutional neural network (CNN) for lunar impact crater detection. Specifically, we develop a tensorial you only look once (TYOLO) network by representing the convolutional kernels in tensor train (TT) decomposition. Thus, the parameter redundancy of TYOLO can be greatly reduced. To the best of our knowledge, this is the first work that considers the lightweight CNN model for impact crater detection. We demonstrate the lunar impact crater detection results over the ChangE-2 lunar digital orthophotos model (DOM) and digital evaluated model (DEM). Experimental results show that the proposed TYOLO network can obtain 1.44 × speed up and 39 × compression with 2.4 % improvement in crater detection. Overall, the proposed network demonstrates great potential in spacecraft with emerging computing resource constraints. [ABSTRACT FROM AUTHOR]

Recently, computer vision and artificial intelligence are being used as enabling technologies for plant phenotyping studies, since they allow the analysis of large amounts of data gathered by the sensors. Plant phenotyping studies can be devoted to the evaluation of complex plant traits either on the aerial part of the plant as well as on the underground part, to extract meaningful information about the growth, development, tolerance, or resistance of the plant itself. All plant traits should be evaluated automatically and quantitatively measured in a non-destructive way. This paper describes a novel approach for identifying plant roots from images of the root system architecture using a convolutional neural network (CNN) that operates on small image patches calculating the probability that the center point of the patch is a root pixel. The underlying idea is that the CNN model should embed as much information as possible about the variability of the patches that can show chaotic and heterogeneous backgrounds. Results on a real dataset demonstrate the feasibility of the proposed approach, as it overcomes the current state of the art. • Root systems must be monitored to assess the growth and well-being of a plant. • State-of-the-art approaches mainly use classic ML or U-networks for segmentation. • CNNs can be used for monitoring considering patch-based information. • These models are simpler and faster, and provide better segmentation performance. [ABSTRACT FROM AUTHOR]

Although studied for decades, constructing effective image retrieval remains an open problem in a wide range of relevant applications. Impressive advances have been made to represent image content, mainly supported by the development of Convolution Neural Networks (CNNs) and Transformer-based models. On the other hand, effectively computing the similarity between such representations is still challenging, especially in collections in which images are structured in manifolds. This paper introduces a novel solution to this problem based on dimensionality reduction techniques, often used for data visualization. The key idea consists in exploiting the spatial relationships defined by neighbor embedding data visualization methods, such as t-SNE and UMAP, to compute a more effective distance/similarity measure between images. Experiments were conducted on several widely-used datasets. Obtained results indicate that the proposed approach leads to significant gains in comparison to the original feature representations. Experiments also indicate competitive results in comparison with state-of-the-art image retrieval approaches. • Manifold information encoded by the Neighbor Embedding framework for image retrieval. • Use of 2D spatial relationships given by Neighbor Embedding for similarity definition. • A simple, yet effective and efficient image retrieval scheme is proposed. • A late fusion method is used to combine distance given by t-SNE and UMAP projections. • Significant gains obtained on diverse datasets and features based on CNNs and Transformers. [ABSTRACT FROM AUTHOR]

Face image synthesis detection is considerably gaining attention because of the potential negative impact on society that this type of synthetic data brings. In this paper, we propose a data-agnostic solution to detect the face image synthesis process. Specifically, our solution is based on an anomaly detection framework that requires only real data to learn the inference process. It is therefore data-agnostic in the sense that it requires no synthetic face images. The solution uses the posterior probability with respect to the reference data to determine if new samples are synthetic or not. Our evaluation results using different synthesizers show that our solution is very competitive against the state-of-the-art, which requires synthetic data for training. • We use an anomaly detection framework to detect synthetic data. • Our proposed solution requires only real data to detect the synthesis process. • Our solution achieves very competitive performance, outperforming existing solutions. [ABSTRACT FROM AUTHOR]

In the past few years, the lane detection technique has become a key factor for autonomous driving systems and self-driving cars on the road. Among the various vehicle subsystems, the lane detection module is one of the essential parts of the Advanced Driver Assistance System (ADAS). Conventional lane detection approaches use machine vision algorithms to find straight lines in road scene images. However, it is challenging to identify straight or curved lane markings in complex environments. To deal with this problem, this paper presents a lane detection technique based on deep learning. It is combined with a 3D convolutional network, so the temporal information is added to the network architecture. Using the front camera images, the system can immediately detect the lane marking information ahead. Moreover, we propose an approach for improvement by adding the time axis to the network architecture. In addition to using 3D-ResNet50, the temporal convolution and spatial convolution are separated for processing. The accuracy is 91.34% improved after adding time and space split convolution with LeakyReLU. The experiments carried out using real scene images have demonstrated the feasibility of the proposed technique for applications to various complex scenes. [ABSTRACT FROM AUTHOR]

• AI improves infectious waste management. • Ensemble model exceeds 97.81% accuracy. • Reinforcement learning optimizes classification. • Geometric augmentation boosts model robustness. • Study addresses urgent urban waste challenges. This research paper focuses on effective infectious municipal waste management in urban settings, highlighting a dearth of dedicated research in this domain. Unlike general or specific waste types, infectious waste poses distinct health and environmental risks. Leveraging advanced artificial intelligence techniques, we prioritize infectious waste categorization and optimization, integrating metaheuristics into optimization methods to create a robust dual-ensemble framework. Our model, the "Enhanced Artificial Intelligence for Infectious Municipal Waste Classification System," combines ensemble image segmentation methods and diverse convolutional neural network models. Innovative geometric image augmentation enhances model robustness, diversifies training data, and improves accuracy across waste types. A pivotal aspect is the integration of a reinforcement learning-differential evolution algorithm as a decision fusion strategy, optimizing classification by harmonizing outputs from ensemble methods and convolutional neural network models. Computational results, using a newly collected dataset, demonstrate our model's accuracy exceeding 96.54% while using the existing solid waste dataset we achieve the accuracy of 97.81%, outperforming advanced approaches by margins ranging from 2.02% to 8.80%. This research significantly advances sustainable waste management, showcasing artificial intelligence's transformative potential in addressing intricate waste challenges. It establishes a foundational framework prioritizing efficiency, effectiveness, and sustainability for future waste management solutions. Acknowledging the importance of diverse datasets, customization for urban contexts, and practical integration into existing infrastructures, our work contributes to the broader discourse on the role of artificial intelligence in evolving waste management practices. [ABSTRACT FROM AUTHOR]

Energy hubs (EHs) represent a pivotal paradigm in achieving optimal resource utilization across various energy domains. This paper presents an advanced framework for the optimal management of a smart island, leveraging the synergies within the water-electricity nexus. By integrating diverse resources, including electricity, water, heat, and hydrogen, the proposed EH model aims to meet the multifaceted demands of consumers on the island. To enhance operational efficiency, this study delves into the nuanced impacts of key EH components, elucidating their roles in meeting demand profiles and minimizing operational costs. Formulated as a mixed integer linear programming (MILP) model, the EH optimization problem is addressed using the GAMS optimization tool. The overarching objective is to fulfill consumer demand while concurrently optimizing resource utilization, considering factors such as storage degradation costs and emissions from fossil-fuel-based units. In addition to strategic optimization, this study pioneers a novel approach to stochastic parameter forecasting, integrating convolutional neural networks (CNNs) and long-short-term memory networks (LSTMs). By harnessing the capabilities of these advanced forecasting techniques, the EH model can anticipate dynamic changes in demand patterns with heightened accuracy and precision. The empirical results underscore the transformative potential of the proposed EH framework, showcasing significant reductions—up to 30%—in emission costs. Moreover, the study underscores the pivotal role of EHs as enablers for scaling up renewable energy penetration, offering a robust foundation for sustainable energy transitions in island communities and beyond. Additionally, implementing a load-shifting demand response program can lower total costs by approximately $257 per day, offering significant savings for EHs over extended periods. [Display omitted] • Modeling a mixed integer linear programming for energy management of an energy hub. • Comprehensive study on hydrogen and electric storage systems. • Uncertainty modeling using convolutional and long short-term memory networks. • Modeling water–electricity nexus to meet water and electricity demand. [ABSTRACT FROM AUTHOR]

In this paper, we address the image denoising problem in presence of speckle degradation typically arising in ultra-sound images. Variational methods and Convolutional Neural Networks (CNNs) are considered well-established methods for specific noise types, such as Gaussian and Poisson noise. Nonetheless, the advances achieved by these two classes of strategies are limited when tackling the de-speckle problem. In fact, variational methods for speckle removal typically amounts to solve a non-convex functional with the related issues from the convergence viewpoint; on the other hand, the lack of large datasets of noise-free ultra-sound images has not allowed the extension of the state-of-the-art CNN denoiser methods to the case of speckle degradation. Here, we aim at combining the classical variational methods with the predictive properties of CNNs by considering a weighted total variation regularized model; the local weights are obtained as the output of a statistically inspired neural network that is trained on a small and composite dataset of natural and synthetic images. The resulting non-convex variational model, which is minimized by means of the Alternating Direction Method of Multipliers (ADMM) is proven to converge to a stationary point. Numerical tests show the effectiveness of our approach for the denoising of natural and satellite images. • An hybrid strategy for the despeckling problem combining convolutional neural networks and variational methods is proposed. • The proposed neural architecture is statistically-inspired and not requires the training on a large data-set of images. • A proof of convergence to a stationary point for the alternating direction method is given. [ABSTRACT FROM AUTHOR]

Timely and effective fault diagnosis is crucial to guarantee the reliability and durability of proton exchange membrane fuel cell (PEMFC). Segmented cell technology has been proven to be a powerful tool for exploring the internal characteristics of fuel cells, yet it is seldom applied for fault diagnosis. This paper proposes a data-driven fault diagnosis method that combines segmented cell and deep learning technology for PEMFC water management fault diagnosis. The dynamic characteristics of the current distribution of the fuel cell under different levels of faults are explored with segmented cell technology. A dual-input convolutional neural network is applied to combine current distribution data and sensor data for a more comprehensive system status for fault diagnosis. The results show that the model can efficiently identify flooding and drying faults with more than 98.5% accuracy, faster and more accurately than other algorithms. This work highlights the significance of segmented cell technology for the comprehension of water management inside PEMFC and provides a new concept for PEMFC fault diagnosis. [Display omitted] • The segmented cell technology is applied to investigate the current distribution during flooding and drying process. • A dual-input CNN is adopted to establish a fault diagnosis model for PEMFC water management. • The proposed method exhibits excellent diagnostic performance, with an accuracy rate of over 98.5%. [ABSTRACT FROM AUTHOR]