Search

Detecting defects on aerospace surfaces is critical to ensure safety and maintain the integrity of aircraft structures. Traditional methods often need more precision and efficiency for effective defect detection. This paper proposes an innovative approach that leverages deep learning and infrared imaging techniques to detect defects with high precision. The core contribution of our work lies in accurately detecting the size and depth of defects. Our method involves segmenting the size of the defect and calculating its centre to determine its depth. We achieve a more comprehensive and precise assessment of defects by integrating deep learning with infrared imaging based on the U-net model for segmentation and the CNN model for classification. The proposed model was rigorously tested on both a simulation dataset and an experimental dataset, demonstrating its robustness and effectiveness in accurately identifying and assessing defects on aerospace surfaces. The results indicate significant improvements in detection accuracy and computational efficiency, showing advancements over state-of-the-art methods and paving the way for enhanced maintenance protocols in the aerospace industry.

Process automation utilizes specialized technology and equipment to automate and enhance production processes, leading to higher manufacturing efficiency, higher productivity, and cost savings. The aluminum die casting industry has significantly gained from the implementation of process automation solutions in manufacturing, serving safety-critical sectors such as automotive and aerospace industries. However, this method of component fabrication is very susceptible to generating manufacturing flaws, hence necessitating adequate non-destructive testing (NDT) to ascertain the fitness for use of such components. Machine learning has taken the center stage in recent years as a tool for developing automated solutions for detecting and classifying flaws in digital X-ray radiography. These machine learning-based solutions have increasingly been developed and deployed for component inspection, to keep pace with the high production throughput in manufacturing industries. This work focuses on the development of a defect grading algorithm that assesses detected flaws to ascertain if they constitute a defect that could render a component unfit for use. Guided by ASTM 2973-15; Standard Digital Reference Images for Inspection of Aluminum and Magnesium Die Castings, a grading pipeline utilizing K-D (k-dimensional) trees was developed to effectively structure detected flaws, enabling the system to make decisions based on acceptable grading terms. This solution is dynamic in terms of its conformity to different grading criteria and offers the possibility to achieve automated decision making (Accept/Reject) in digital X-ray radiography applications.

Infrared thermography has been widely applied in real industrial inspection of aerospace, energy management systems, engines, and electric systems. However, two-dimensional imaging modality limits its development. Here, a technique named frequency multiplexed photothermal correlation tomography (FM-PCT) was developed to enable non-destructive and contactless cross-sectional imaging for manufactured material evaluation and characterization. By combining advantages of photothermal tomography and pulsed thermography, FM-PCT facilitates the generation of three-dimensional thermal images through temporal superposition (stacking) of two-dimensional images from sequential subsurface depths. FM-PCT image processing involves pulsed excitation signals to which frequency delay and matched filtering techniques are applied. Major features of FM-PCT are high-resolution three-dimensional tomographic imaging under low camera frame-rate conditions with self-correcting capability for diffusion (blurring) correction of subsurface images due to cross-correlation processing of individual frequencies in the Fourier decomposition spectrum of the excitation pulse. Furthermore, FM-PCT extends truncated-correlation photothermal coherence tomography from chirp and pulsed signals to more general linear heating sources. Lock-in thermography and x-ray computed tomography validation demonstrate that 3D FM-PCT imaging accurately reveals subsurface discontinuities/defects in solids despite the diffusive nature of thermal-wave imaging.

This study reviews advanced methods for corrosion detection and characterization in pipes using thermography, with a focus on addressing the limitations posed by small datasets. Thermography captures temperature distributions on the surface of pipes to identify subsurface defects. The challenges of sequential data processing, neural network performance, feature extraction, and dataset size are discussed, with proposed solutions such as advanced algorithms, feature selection techniques, and data augmentation. Given the significant gap in the current literature, there is a need for larger, more diverse datasets to train more robust and accurate machine learning models. A case study combining experimental data with Finite Element Method (FEM) simulations demonstrates that augmenting datasets with synthetic data significantly improves defect detection accuracy. These findings highlight the potential of integrating thermography with machine learning to enhance defect detection, providing insights for future research and practical applications.

In contrast to conventional non-destructive testing (NDT) and non-destructive evaluation (NDE) methodologies, including radiography, ultrasound, and eddy current analysis, coplanar capacitive sensing technique emerges as a novel and promising avenue within the field. This paper endeavors to elucidate the efficacy of coplanar capacitive sensing, also referred to as capacitive imaging (CI), within the realm of NDT. Leveraging extant scholarly discourse, this review offers a comprehensive and methodical examination of the coplanar capacitive technique, encompassing its fundamental principles, factors influencing sensor efficacy, and diverse applications for defect identification across various NDT domains. Furthermore, this review deliberates on extant challenges and anticipates future trajectories for the technique. The manifold advantages inherent to coplanar capacitive sensing vis-à-vis traditional NDT methodologies not only afford its versatility in application but also underscore its potential for pioneering advancements in forthcoming applications.

Efficient image stitching plays a vital role in the Non-Destructive Evaluation (NDE) of infrastructures. An essential challenge in the NDE of infrastructures is precisely visualizing defects within large structures. The existing literature predominantly relies on high-resolution close-distance images to detect surface or subsurface defects. While the automatic detection of all defect types represents a significant advancement, understanding the location and continuity of defects is imperative. It is worth noting that some defects may be too small to capture from a considerable distance. Consequently, multiple image sequences are captured and processed using image stitching techniques. Additionally, visible and infrared data fusion strategies prove essential for acquiring comprehensive information to detect defects across vast structures. Hence, there is a need for an effective image stitching method appropriate for infrared and visible images of structures and industrial assets, facilitating enhanced visualization and automated inspection for structural maintenance. This paper proposes an advanced image stitching method appropriate for dual-sensor inspections. The proposed image stitching technique employs self-supervised feature detection to enhance the quality and quantity of feature detection. Subsequently, a graph neural network is employed for robust feature matching. Ultimately, the proposed method results in image stitching that effectively eliminates perspective distortion in both infrared and visible images, a prerequisite for subsequent multi-modal fusion strategies. Our results substantially enhance the visualization capabilities for infrastructure inspection. Comparative analysis with popular state-of-the-art methods confirms the effectiveness of the proposed approach.

Efficient multi-modal image fusion plays an important role in the non-destructive evaluation (NDE) of infrastructures, where an essential challenge is the precise visualizing of defects. While automatic defect detection represents a significant advancement, the determination of the precise location of both surface and subsurface defects simultaneously is crucial. Hence, visible and infrared data fusion strategies are essential for acquiring comprehensive and complementary information to detect defects across vast structures. This paper proposes an infrared and visible image registration method based on Euclidean evaluation together with a trade-off between key-point threshold and non-maximum suppression. Moreover, we employ a multi-modal fusion strategy to investigate the robustness of our image registration results.

The thermographic inspection of buildings is a powerful and non-invasive method for monitoring and diagnosing building performance and structural integrity. It can effectively detect moisture, evaluate heat loss, and assess building’s roofs. The early detection of problems in a building allows owners to fix issues before they become more severe and costly. One of the challenges in automating thermal analysis for building inspections comes in the form of distinguishing between different surfaces. This paper presents an automated process pipeline using coupled thermal and visible images for building inspections to assist inspectors in adapting strategies and methods to discriminate the thermal signatures between different kinds of surfaces. A deep learning method is employed to segment visible images texturally. Thermal images are then analyzed based on the resulting segmentation. Moreover, a multi-modal dataset is introduced, presenting coupled thermal and visible images acquired during multiple building inspections.

Defects in in-service pipelines, including corrosion under insulation (CUI) and thickness loss, pose significant challenges to asset integrity in the oil and gas industry. These defects are particularly hazardous as they often remain unnoticed. The automation of defect detection processes can assist inspectors in reducing analysis time, costs, and human error. However, recent attempts to adopt machine learning for automated defect detection from thermal images have been hindered by limited data availability. This paper presents a novel approach to address this issue by utilizing thermal data augmentation, generating synthetic sub-surface defects via finite element modeling. The resulting synthetic thermal images, combined with real images, are then used to train a deep learning model for the automatic detection of potential defects. Additionally, this study explores the efficacy of synthetic thermal images in enhancing the generalization of the detection model.

Infrared thermography (IRT), is one of the most interesting techniques to identify different kinds of defects, such as delamination and damage existing for quality management of material. Objective detection and segmentation algorithms in deep learning have been widely applied in image processing, although very rarely in the IRT field. In this paper, spatial deep-learning image processing methods for defect detection and identification were discussed and investigated. The aim in this work is to integrate such deep-learning (DL) models to enable interpretations of thermal images automatically for quality management (QM). That requires achieving a high enough accuracy for each deep-learning method so that they can be used to assist human inspectors based on the training. There are several alternatives of deep Convolutional Neural Networks for detecting the images that were employed in this work. These included: 1. The instance segmentation methods Mask–RCNN (Mask Region-based Convolutional Neural Networks) and Center–Mask; 2. The independent semantic segmentation methods: U-net and Resnet–U-net; 3. The objective localization methods: You Only Look Once (YOLO-v3) and Faster Region-based Convolutional Neural Networks (Fast-er-RCNN). In addition, a regular infrared image segmentation processing combination method (Absolute thermal contrast (ATC) and global threshold) was introduced for comparison. A series of academic samples composed of different materials and containing artificial defects of different shapes and nature (flat-bottom holes, Teflon inserts) were evaluated, and all results were studied to evaluate the efficacy and performance of the proposed algorithms.

Nondestructive testing (NDT) of composite materials is of paramount importance to the aerospace industry. Several NDT methods have been adopted for the inspection of components during production and all through the aircraft service life, with infrared thermography (IRT) techniques, such as line scan thermography (LST) and pulsed thermography (PT), gaining popularity thanks to their rapidity and versatility. On one hand, LST is an attractive solution for the fast inspection of large and complex geometry composite parts during production. On the other hand, PT can be employed for the characterization of composite materials, e.g., the determination of thermal diffusivity and defect depth estimation. In this study, the use of LST with an uncooled microbolometer camera is explored for the identification of artificially produced porosity and barely visible impact damage (BVID) on academic samples. The performance of LST is quantitatively assessed with respect to PT (considered the gold standard in this case) using a high-definition cooled camera through the contrast-to-noise ratio (CNR) criterium. It is concluded that, although in most cases the measured CNR values were higher for PT than for LST (as expected since a high-definition camera and longer acquisition times were used), the majority of the defects were clearly detected (CNR ≥ 2.5) by LST without the need of advanced signal processing, proving the suitability of LST for the inspection of aerospace composite components. Furthermore, the deepest defect investigated herein (z ≈ 3 mm) was detected solely by LST combined with signal processing and spatial filtering (CNR = 3.6) and not by PT (since pulse heating was not long enough for this depth). In addition, PT was used for the determination of the thermal diffusivity of all samples and the subsequent depth estimation of porosity and damaged areas by pulsed phase thermography (PPT).

The drone-based multi-modal inspection of industrial structures is a relatively new field of research gaining interest among companies. Multi-modal inspection can significantly enhance data analysis and provide a more accurate assessment of the components’ operability and structural integrity, which can assist in avoiding data misinterpretation and providing a more comprehensive evaluation, which is one of the NDT4.0 objectives. This paper investigates the use of coupled thermal and visible images to enhance abnormality detection accuracy in drone-based multi-modal inspections. Four use cases are presented, introducing novel process pipelines for enhancing defect detection in different scenarios. The first use case presents a process pipeline to enhance the feature visibility on visible images using thermal images in pavement crack detection. The second use case proposes an abnormality classification method for surface and subsurface defects using both modalities and texture segmentation for piping inspections. The third use case introduces a process pipeline for road inspection using both modalities. A texture segmentation method is proposed to extract the pavement regions in thermal and visible images. Further, the combination of both modalities is used to detect surface and subsurface defects. The texture segmentation approach is employed for bridge inspection in the fourth use case to extract concrete surfaces in both modalities.

Composite materials are one of the primary structural components in most current transportation applications, such as the aerospace industry. Composite material diagnostics is a promising area in the fight against structural damage in aircraft and spaceships. Detection and diagnostic technologies often provide analysts with a valuable and rapid mechanism to monitor the health and safety of composite materials. Although many attempts have been made to develop damage detection techniques and make operations more efficient, there is still a need to develop/improve existing methods. Pulsed thermography (PT) technology was used in this study to obtain healthy and defective data sets from custom-designed composite samples having similar dimensions but different thicknesses (1.6 and 3.8). Ten carbon fibre-reinforced plastic (CFRP) panels were tested. The samples were subjected to impact damage of various energy levels, ranging from 4 to 12 J. Two different methods have been applied to detect and classify the damage to the composite structures. The first applied method is the statistical analysis, where seven different statistical criteria have been calculated. The final results have proved the possibility of detecting the damaged area in most cases. However, for a more accurate detection technique, a machine learning method was applied to thermal images; specifically, the Cube Support Vector Machine (SVM) algorithm was selected. The prediction accuracy of the proposed classification models was calculated within a confusion matrix based on the dataset patterns representing the healthy and defective areas. The classification results ranged from 78.7% to 93.5%, and these promising results are paving the way to develop an automated model to efficiently evaluate the damage to composite materials based on the non-distractive testing (NDT) technique.

In the present study, a relatively novel non-destructive testing (NDT) method called the coplanar capacitive sensing technique was applied in order to detect different sizes of rebars in a reinforced concrete (RC) structure. This technique effectively detects changes in the dielectric properties during scanning in various sections of concrete with and without rebars. Numerical simulations were carried out by three-dimensional (3D) finite element modelling (FEM) in COMSOL Multiphysics software to analyse the impact of the presence of rebars on the electric field generated by the coplanar capacitive probe. In addition, the effect of the presence of a surface defect on the rebar embedded in the concrete slab was demonstrated by the same software for the first time. Experiments were performed on a concrete slab containing rebars, and were compared with FEM results. The results showed that there is a good qualitative agreement between the numerical simulations and experimental results.

Industrial radiography is a pivotal non-destructive testing (NDT) method that ensures quality and safety in a wide range of industrial sectors. Nevertheless, the conventional human-based approaches to carrying out industrial radiography are prone to challenges that negatively impact the accuracy and efficiency of defect detection. To solve this challenge, numerous computer-based alternatives have been developed, including Automated Defect Recognition (ADR) using deep learning algorithms. At the core of training, these ADR algorithms demand large volumes of qualitative data that should be representative of real-world cases to be expected during deployment. However, the availability of digital X-ray radiography data, especially for open research, is limited by non-disclosure contractual terms in the industry. In this study, we present a pipeline that is capable of modelling synthetic images based on real digital X-ray radiography images. This is achieved through a systematic analysis of the intensity distribution, considering grey value (GV) statistical uniqueness related to exposure conditions used during image acquisition, type of imaged component, material thickness variations, X-ray beam divergence, anode heel effect, scatter radiation, edge delineation, etc. The generated synthetic images were exclusively utilized to train a deep learning model, yielding an impressive model performance with mean intersection over union (IoU) of 0.93, and mean dice coefficient of 0.96 when tested on real unseen digital X-ray radiography images. The presented methodology is scalable and adaptable, making it suitable for diverse industrial applications.