32 results on '"surface defect detection"'
Search Results
2. 基于深度学习的PCB表面缺陷检测研究进展.
- Author
-
郭渊, 许伟佳, and 董振标
- Subjects
ELECTRONIC equipment ,CONVOLUTIONAL neural networks ,SURFACE defects ,PRINTED circuits ,MACHINE learning ,DEEP learning - Abstract
Copyright of Machine Tool & Hydraulics is the property of Guangzhou Mechanical Engineering Research Institute (GMERI) and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
- Published
- 2024
- Full Text
- View/download PDF
3. DEU-Net: A Multi-Scale Fusion Staged Network for Magnetic Tile Defect Detection.
- Author
-
Huang, Yifan, Huang, Zhiwen, and Jin, Tao
- Subjects
CONVOLUTIONAL neural networks ,SURFACE defects ,PIXELS ,ELECTROCHEMICAL cutting ,TILES - Abstract
Surface defect detection is a critical task in the manufacturing industry to ensure product quality and machining efficiency. Image-based precise defect detection faces significant challenges due to defects lacking fixed shapes and the detection being heavily influenced by lighting conditions. Addressing the efficiency demands of defect detection algorithms, often deployed on embedded devices, and the highly imbalanced pixel ratio between foreground and background images, this paper introduces a multi-scale fusion staged U-shaped convolutional neural network (DEU-Net). The network provides segmentation results for defect anomalies while indicating the probability of defect presence. It enables the model to train with fewer parameters, a crucial requirement for practical applications. The proposed model achieves an MIoU of 66.94 and an F1 score of 74.89 with lower Params (36.675) and Flops (19.714). Comparative analysis with FCN, U-Net, Deeplab v3+, U-Net++, Attention U-Net, and Trans U-Net demonstrates the superiority of the proposed approach in surface defect detection. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
4. LGP-YOLO: an efficient convolutional neural network for surface defect detection of light guide plate.
- Author
-
Wan, Yan and Li, Junfeng
- Subjects
CONVOLUTIONAL neural networks ,SURFACE defects ,LIQUID crystal displays ,DISPLAY systems ,INDUSTRIAL sites ,MAXIMUM power point trackers ,TASK performance - Abstract
Light guide plate (LGP) is a key component of liquid crystal display (LCD) display systems, so its quality directly affects the display effect of LCD. However, LGPs have complex background texture, low contrast, varying defect size and numerous defect types, which makes realizing efficient and accuracy-satisfactory surface defect automatic detection of LGPS still a big challenge. Therefore, combining its optical properties, dot distribution, defect imaging characteristics and detection requirements, a surface defect detection algorithm based on LGP-YOLO for practical industrial applications is proposed in this paper. To enhance the feature extraction ability of the network without dimensionality reduction, expand the effective receptive field and reduce the interference of invalid targets, we built the receptive field module (RFM) by combining the effective channel attention network (ECA-Net) and reviewing large kernel design in CNNs (RepLKNet). For the purpose of optimizing the performance of the network in downstream tasks, enhance the network's expression ability and improve the network's ability of detecting multi-scale targets, we construct the small detection module (SDM) by combining space-to-depth non-strided convolution (SPDConv) and omini-dimensional dynamic convolution (ODConv). Finally, an LGP defect dataset is constructed using a set of images collected from industrial sites, and a multi-round experiment is carried out to test the proposed method on the LGP detect dataset. The experimental results show that the proposed LGP-YOLO network can achieve high performance, with mAP and F1-score reaching 99.08% and 97.45% respectively, and inference speed reaching 81.15 FPS. This demonstrates that LGP-YOLO can strike a good balance between detection accuracy and inference speed, capable of meeting the requirements of high-precision and high-efficiency LGP defect detection in LGP manufacturing factories. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
5. LGP-YOLO: an efficient convolutional neural network for surface defect detection of light guide plate
- Author
-
Yan Wan and Junfeng Li
- Subjects
Light guide plate ,Surface defect detection ,Convolutional neural network ,Deep learning ,Electronic computers. Computer science ,QA75.5-76.95 ,Information technology ,T58.5-58.64 - Abstract
Abstract Light guide plate (LGP) is a key component of liquid crystal display (LCD) display systems, so its quality directly affects the display effect of LCD. However, LGPs have complex background texture, low contrast, varying defect size and numerous defect types, which makes realizing efficient and accuracy-satisfactory surface defect automatic detection of LGPS still a big challenge. Therefore, combining its optical properties, dot distribution, defect imaging characteristics and detection requirements, a surface defect detection algorithm based on LGP-YOLO for practical industrial applications is proposed in this paper. To enhance the feature extraction ability of the network without dimensionality reduction, expand the effective receptive field and reduce the interference of invalid targets, we built the receptive field module (RFM) by combining the effective channel attention network (ECA-Net) and reviewing large kernel design in CNNs (RepLKNet). For the purpose of optimizing the performance of the network in downstream tasks, enhance the network's expression ability and improve the network’s ability of detecting multi-scale targets, we construct the small detection module (SDM) by combining space-to-depth non-strided convolution (SPDConv) and omini-dimensional dynamic convolution (ODConv). Finally, an LGP defect dataset is constructed using a set of images collected from industrial sites, and a multi-round experiment is carried out to test the proposed method on the LGP detect dataset. The experimental results show that the proposed LGP-YOLO network can achieve high performance, with mAP and F1-score reaching 99.08% and 97.45% respectively, and inference speed reaching 81.15 FPS. This demonstrates that LGP-YOLO can strike a good balance between detection accuracy and inference speed, capable of meeting the requirements of high-precision and high-efficiency LGP defect detection in LGP manufacturing factories.
- Published
- 2023
- Full Text
- View/download PDF
6. Multiscale Local and Global Feature Fusion for the Detection of Steel Surface Defects.
- Author
-
Zhang, Li, Fu, Zhipeng, Guo, Huaping, Sun, Yange, Li, Xirui, and Xu, Mingliang
- Subjects
SURFACE defects ,CONVOLUTIONAL neural networks ,STEEL ,INDUSTRIAL goods - Abstract
Steel surface defects have a significant impact on the quality and performance of many industrial products and cause huge economic losses. Therefore, it is meaningful to detect steel surface defects in real time. To improve the detection performance of steel surface defects with variable scales and complex backgrounds, in this paper, a novel method for detecting steel surface defects through a multiscale local and global feature fusion mechanism is proposed. The proposed method uses a convolution operation with a downsampling mechanism in the convolutional neural network model to obtain rough multiscale feature maps. Then, a context-extraction block (CEB) is proposed to adopt self-attention learning on the feature maps extracted by the convolution operation at each scale to obtain multiscale global context information to make up for the shortcomings of convolutional neural networks (CNNs), thus forming a novel multiscale self-attention mechanism. Afterwards, using the feature pyramid structure, multiscale feature maps are fused to improve multiscale object detection. Finally, the channel and spatial attention module and the WIOU (Wise Intersection over Union) loss function are introduced. The model achieved 78.2% and 71.9% mAP respectively on the NEU-DET and GC10-DET dataset. Compared to algorithms such as Faster RCNN and EDDN, this method is effective in improving the detection performance of steel surface defects. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
7. DEU-Net: A Multi-Scale Fusion Staged Network for Magnetic Tile Defect Detection
- Author
-
Yifan Huang, Zhiwen Huang, and Tao Jin
- Subjects
surface defect detection ,convolutional neural network ,computer vision ,segmentation network ,stage-wise network ,Technology ,Engineering (General). Civil engineering (General) ,TA1-2040 ,Biology (General) ,QH301-705.5 ,Physics ,QC1-999 ,Chemistry ,QD1-999 - Abstract
Surface defect detection is a critical task in the manufacturing industry to ensure product quality and machining efficiency. Image-based precise defect detection faces significant challenges due to defects lacking fixed shapes and the detection being heavily influenced by lighting conditions. Addressing the efficiency demands of defect detection algorithms, often deployed on embedded devices, and the highly imbalanced pixel ratio between foreground and background images, this paper introduces a multi-scale fusion staged U-shaped convolutional neural network (DEU-Net). The network provides segmentation results for defect anomalies while indicating the probability of defect presence. It enables the model to train with fewer parameters, a crucial requirement for practical applications. The proposed model achieves an MIoU of 66.94 and an F1 score of 74.89 with lower Params (36.675) and Flops (19.714). Comparative analysis with FCN, U-Net, Deeplab v3+, U-Net++, Attention U-Net, and Trans U-Net demonstrates the superiority of the proposed approach in surface defect detection.
- Published
- 2024
- Full Text
- View/download PDF
8. A pixel-wise framework based on convolutional neural network for surface defect detection
- Author
-
Guozhen Dong
- Subjects
surface defect detection ,pixel-wise detection ,convolutional neural network ,multi-scale context information ,cross integrate ,Biotechnology ,TP248.13-248.65 ,Mathematics ,QA1-939 - Abstract
The automatic surface defect detection system supports the real-time surface defect detection by reducing the information and high-lighting the critical defect regions for high level image under-standing. However, the defects exhibit low contrast, different textures and geometric structures, and several defects making the surface defect detection more difficult. In this paper, a pixel-wise detection framework based on convolutional neural network (CNN) for strip steel surface defect detection is proposed. First we extract the salient features by a pre-trained backbone network. Secondly, contextual weighting module, with different convolutional kernels, is used to extract multi-scale context features to achieve overall defect perception. Finally, the cross integrate is employed to make the full use of these context information and decoded the information to realize feature information complementation. The experimental results of this study demonstrate that the proposed method outperforms against the previous state-of-the-art methods on strip steel surface defect dataset (MAE: 0.0396; Fβ: 0.8485).
- Published
- 2022
- Full Text
- View/download PDF
9. Result Weighting-Based Resnet Feature Pyramid Network Architecture for Surface Defect Detection
- Author
-
Hüseyin ÜZEN, Muammer TÜRKOĞLU, and Davut HANBAY
- Subjects
surface defect detection ,pyramid feature network ,convolutional neural network ,segmentation ,Engineering (General). Civil engineering (General) ,TA1-2040 ,Science ,Science (General) ,Q1-390 - Abstract
Surface defect detection is very important in manufacturing systems to ensure high quality products. Unlike manual inspections under human supervision, automatic surface defect detection is both efficient and highly accurate. In this study, a Result Weighting-based Resnet Feature Pyramid Network (SA-RÖPA) model has been developed for automatic pixel-level surface defect detection. In the first stage of the proposed model, the pre-trained Resnet50 network was used, and feature maps were extracted from the different levels of this network. In the second stage, Feature Pyramid Model was applied to these feature maps in order to hierarchically share important information in defect detection. In the third stage, 4 different error detection results were obtained by using these feature maps. In the last stage, four different results obtained using the developed Result Weighting (SA) module were effectively combined. The proposed SA-ROPA model has been tested with MT, MVTex-Doku, and AITEX datasets, which are widely used in defect detection studies. In experimental studies, the mIoU value obtained for the MT and AITEX datasets using the proposed model was calculated as 79.92%, 76.37%, and 82.72%, respectively. These results have shown that the proposed SA- ROPA model is more successful than other state-of-the-art models.
- Published
- 2021
- Full Text
- View/download PDF
10. Efficient online surface defect detection using multiple instance learning.
- Author
-
Xu, Guang, Ren, Ming, and Li, Guozhi
- Subjects
- *
CONVOLUTIONAL neural networks , *SURFACE defects , *ARTIFICIAL intelligence - Abstract
Artificial intelligence (AI)-empowered defect detection has emerged as a promising solution for enhancing quality control in manufacturing. While prevalent object detection-based methods have achieved competitive performance, they do carry inherent limitations that necessitate further refinement prior to their practical application in online surface defect detection. This study introduces an efficient online surface defect detection method that makes predictions on the presence of defects based on image-level labels. The method leverages the multiple instance learning (MIL) framework, and utilizes convolutional neural network (CNN) as feature extractor. Extensive experiments are conducted on two real-world datasets to evaluate the method with a custom CNN and Resnet50 as feature extractors (referred to as MIL-CNN and MIL-Resnet50). The results demonstrate the superiority of the proposed method compared with the well-established benchmark methods, especially highlighting the advantage of MIL-Resnet50. Without requiring fine-grained labeling, MIL-Resnet50 enhances F1-macro by 2.5% and 1.5% within the two datasets compared to the second-ranking. Notably, it excels in detecting small-object defects. It also exhibits advantages in terms of detection speed, and are lightweight, making it easy to deploy even in resource-limited scenarios. Additionally, MIL-Resnet50 exhibits the capability to provide approximate defect localization through feature maps. These findings highlight the significant potential of the proposed method within industrial applications. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
11. A Lightweight Fully Convolutional Neural Network of High Accuracy Surface Defect Detection
- Author
-
Li, Yajie, Chen, Yiqiang, Gu, Yang, Ouyang, Jianquan, Wang, Jiwei, Zeng, Ni, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Woeginger, Gerhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Farkaš, Igor, editor, Masulli, Paolo, editor, and Wermter, Stefan, editor
- Published
- 2020
- Full Text
- View/download PDF
12. Surface Defect Detection of Fresh-Cut Cauliflowers Based on Convolutional Neural Network with Transfer Learning.
- Author
-
Li, Yaodi, Xue, Jianxin, Wang, Kai, Zhang, Mingyue, and Li, Zezhen
- Abstract
A fresh-cut cauliflower surface defect detection and classification model based on a convolutional neural network with transfer learning is proposed to address the low efficiency of the traditional manual detection of fresh-cut cauliflower surface defects. Four thousand, seven hundred and ninety images of fresh-cut cauliflower were collected in four categories including healthy, diseased, browning, and mildewed. In this study, the pre-trained MobileNet model was fine-tuned to improve training speed and accuracy. The model optimization was achieved by selecting the optimal combination of training hyper-parameters and adjusting the different number of frozen layers; the parameters downloaded from ImageNet were optimally integrated with the parameters trained on our own model. A comparison of test results was presented by combining VGG19, InceptionV3, and NASNetMobile. Experimental results showed that the MobileNet model's loss value was 0.033, its accuracy was 99.27%, and the F1 score was 99.24% on the test set when the learning rate was set as 0.001, dropout was set as 0.5, and the frozen layer was set as 80. This model had better capability and stronger robustness and was more suitable for the surface defect detection of fresh-cut cauliflower when compared with other models, and the experiment's results demonstrated the method's feasibility. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
13. ACA-Net: An Adaptive Convolution and Anchor Network for Metallic Surface Defect Detection.
- Author
-
Chen, Faquan, Deng, Miaolei, Gao, Hui, Yang, Xiaoya, and Zhang, Dexian
- Subjects
SURFACE defects ,METALLIC surfaces ,CONVOLUTIONAL neural networks ,INDUSTRIAL goods - Abstract
Metallic surface defect detection is critical to ensure the quality of industrial products. Recently, human-advanced surface defect detection algorithms have been proposed. Most of these algorithms rely on convolutional neural networks (CNN) and an anchoring scheme. However, a convolution unit only samples the input feature maps at fixed shapes and locations. Similarly, a set of anchors are uniformly predefined with fixed scales and shapes, which increases the difficulties of bounding box regression. Therefore, we propose an adaptive convolution and anchor network for metallic surface defect detection, named ACA-Net. Specifically, an adaptive convolution and anchor (ACA) module is proposed, which mainly consists of adaptive convolution and an adaptive anchor. Firstly, an adaptive convolution module (ACM) is designed, which adaptively determines the location and shape of each convolution unit. In addition, a multi-scale feature adaptive fusion (MFAF) is proposed, which is used in ACM to extract and integrate multi-scale features. Then, an adaptive anchor module (AAM) is proposed to yield more suitable anchor boxes by adaptively adjusting shapes. Extensive experiments on NEU-DET dataset and GC10 dataset validate the performance of the proposed approach. ACA-Net achieves 1.8% on NEU-DET dataset higher Average Precision (AP) than GA-RetinaNet. Furthermore, the proposed ACA module is also adopted in GA-Faster R-CNN, improving the AP by 1.2% on NEU-DET dataset. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
14. A Weakly Supervised Surface Defect Detection Based on Convolutional Neural Network
- Author
-
Liang Xu, Shuai Lv, Yong Deng, and Xiuxi Li
- Subjects
Surface defect detection ,quality control ,weak supervision ,convolutional neural network ,localization network ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
Surface defect detection is a critical task in product quality assurance for manufacturing lines. The deep learning-based methods recently developed for defect detection are typically trained using a supervised learning strategy and large defect sample sets. Conventional methods often require additional pixel-level labeling or bounding boxes to predict the location of defects. However, the number of required samples and the time-intensive annotation process limits the practical use of these algorithms. As such, this study proposes a weakly supervised detection framework in which a CNN model is trained to identify surface cracks in motor commutators. The model was trained using small subsets of defect samples (~5-30) and does not require a pre-trained network. This approach consists of localization and decision networks that simultaneously predict both the location and probability of defects. A new loss function was also developed to identify abnormal regions in a sample with accessible image-level labels. A collaboration learning strategy was then applied to utilize the loss function and compensate for imbalances at the pixel level. Experimental results using a small number of image-level training labels from a real industrial dataset exhibited a 99.5% recognition accuracy, which is comparable to relevant methods using pixel-level labels.
- Published
- 2020
- Full Text
- View/download PDF
15. SDDNet: A Fast and Accurate Network for Surface Defect Detection.
- Author
-
Cui, Lisha, Jiang, Xiaoheng, Xu, Mingliang, Li, Wanqing, Lv, Pei, and Zhou, Bing
- Subjects
- *
SURFACE defects , *CONVOLUTIONAL neural networks - Abstract
This article proposes a fast and accurate network for surface defect detection, termed SDDNet. SDDNet mainly addresses two challenging issues—large texture variation and small size of defects—by introducing two modules: feature retaining block (FRB) and skip densely connected module (SDCM). FRB fuses multiple pyramidal feature maps with different resolutions and is plugged on the top of pooling layers, aiming to preserve the texture information, which may be lost because of downsampling. SDCM is designed to propagate the fine-grained details from low- to high-level feature maps for better prediction of defects, especially small defects. Extensive experiments conducted on the publicly available data sets NEU-DET (88.8% mAP), DAGM (99.1% mAP), and Magnetic-Tile (93.4% mAP) have demonstrated the effectiveness of the proposed SDDNet and its feasibility for real-time industrial applications. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
16. A Pixel-Level Segmentation Convolutional Neural Network Based on Deep Feature Fusion for Surface Defect Detection.
- Author
-
Cao, Jingang, Yang, Guotian, and Yang, Xiyun
- Subjects
- *
CONVOLUTIONAL neural networks , *SURFACE defects , *PIXELS , *QUALITY control - Abstract
Surface defect detection is very important for the quality control of product and routine maintenance of facilities, but it is still a big challenge due to the diversity and complexity of defects and environmental factors. To improve the accuracy of defect detection, we proposed a pixel-level segmentation network based on deep feature fusion for surface defect detection. The network adopts encoder–decoder structure, and it extracts low-, middle-, and high-level features via ResNet50 first. Second, by fusing adjacent feature maps at all levels and integrating the highest level feature map, multilevel feature aggregation module makes all feature maps contain context information and more details of defects. Then, multibranch decoder adopts attention modules and a multibranch structure to recover the details of defects gradually and improve the accuracy of defects segmentation. Finally, the segmentation result is produced by fusion of all branches outputs. We have evaluated the proposed network on three public data sets: MT, RSDD, and CFD. The results indicate that our proposed method outperforms the other compared methods in terms of F-measure and intersection of union (MT:73.7%, RSDD:85%, CFD:60.1%). [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
17. Surface Defect Detection of Fresh-Cut Cauliflowers Based on Convolutional Neural Network with Transfer Learning
- Author
-
Yaodi Li, Jianxin Xue, Kai Wang, Mingyue Zhang, and Zezhen Li
- Subjects
fresh-cut cauliflower ,surface defect detection ,convolutional neural network ,transfer learning ,classification ,Chemical technology ,TP1-1185 - Abstract
A fresh-cut cauliflower surface defect detection and classification model based on a convolutional neural network with transfer learning is proposed to address the low efficiency of the traditional manual detection of fresh-cut cauliflower surface defects. Four thousand, seven hundred and ninety images of fresh-cut cauliflower were collected in four categories including healthy, diseased, browning, and mildewed. In this study, the pre-trained MobileNet model was fine-tuned to improve training speed and accuracy. The model optimization was achieved by selecting the optimal combination of training hyper-parameters and adjusting the different number of frozen layers; the parameters downloaded from ImageNet were optimally integrated with the parameters trained on our own model. A comparison of test results was presented by combining VGG19, InceptionV3, and NASNetMobile. Experimental results showed that the MobileNet model’s loss value was 0.033, its accuracy was 99.27%, and the F1 score was 99.24% on the test set when the learning rate was set as 0.001, dropout was set as 0.5, and the frozen layer was set as 80. This model had better capability and stronger robustness and was more suitable for the surface defect detection of fresh-cut cauliflower when compared with other models, and the experiment’s results demonstrated the method’s feasibility.
- Published
- 2022
- Full Text
- View/download PDF
18. ACA-Net: An Adaptive Convolution and Anchor Network for Metallic Surface Defect Detection
- Author
-
Faquan Chen, Miaolei Deng, Hui Gao, Xiaoya Yang, and Dexian Zhang
- Subjects
surface defect detection ,convolutional neural network ,feature fusion ,anchor box ,computer vision ,Technology ,Engineering (General). Civil engineering (General) ,TA1-2040 ,Biology (General) ,QH301-705.5 ,Physics ,QC1-999 ,Chemistry ,QD1-999 - Abstract
Metallic surface defect detection is critical to ensure the quality of industrial products. Recently, human-advanced surface defect detection algorithms have been proposed. Most of these algorithms rely on convolutional neural networks (CNN) and an anchoring scheme. However, a convolution unit only samples the input feature maps at fixed shapes and locations. Similarly, a set of anchors are uniformly predefined with fixed scales and shapes, which increases the difficulties of bounding box regression. Therefore, we propose an adaptive convolution and anchor network for metallic surface defect detection, named ACA-Net. Specifically, an adaptive convolution and anchor (ACA) module is proposed, which mainly consists of adaptive convolution and an adaptive anchor. Firstly, an adaptive convolution module (ACM) is designed, which adaptively determines the location and shape of each convolution unit. In addition, a multi-scale feature adaptive fusion (MFAF) is proposed, which is used in ACM to extract and integrate multi-scale features. Then, an adaptive anchor module (AAM) is proposed to yield more suitable anchor boxes by adaptively adjusting shapes. Extensive experiments on NEU-DET dataset and GC10 dataset validate the performance of the proposed approach. ACA-Net achieves 1.8% on NEU-DET dataset higher Average Precision (AP) than GA-RetinaNet. Furthermore, the proposed ACA module is also adopted in GA-Faster R-CNN, improving the AP by 1.2% on NEU-DET dataset.
- Published
- 2022
- Full Text
- View/download PDF
19. 基于Faster R-CNN 的零件表面缺陷检测算法.
- Author
-
黄凤荣, 李杨, 郭兰申, 钱法, and 朱雨晨
- Abstract
Copyright of Journal of Computer-Aided Design & Computer Graphics / Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao is the property of Gai Kan Bian Wei Hui and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
- Published
- 2020
- Full Text
- View/download PDF
20. PSIC-Net: Pixel-Wise Segmentation and Image-Wise Classification Network for Surface Defects
- Author
-
Linjian Lei, Shengli Sun, Yue Zhang, Huikai Liu, and Wenjun Xu
- Subjects
surface defect detection ,pixel-wise segmentation ,image-wise classification ,convolutional neural network ,deep learning ,Mechanical engineering and machinery ,TJ1-1570 - Abstract
Recent years have witnessed the widespread research of the surface defect detection technology based on machine vision, which has spawned various effective detection methods. In particular, the rise of deep learning has allowed the surface defect detection technology to develop further. However, these methods based on deep learning still have some drawbacks. For example, the size of the sample data is not large enough to support deep learning; the location and recognition of surface defects are not accurate enough; the real-time performance of segmentation and classification is not satisfactory. In the context, this paper proposes an end-to-end convolutional neural network model: the pixel-wise segmentation and image-wise classification network (PSIC-Net). With the innovative design of a three-stage network structure, improved loss function and a two-step training mode, PSIC-Net can accurately and quickly segment and classify surface defects with a small dataset of training data. This model was evaluated with three public datasets, and compared with the most advanced defect detection methods. All the performance metrics prove the effectiveness and advancement of PSIC-Net.
- Published
- 2021
- Full Text
- View/download PDF
21. EDSV-Net: An efficient defect segmentation network based on visual attention and visual perception.
- Author
-
Huang, Yanqing, Jing, Junfeng, Sheng, Siyu, and Wang, Zhen
- Subjects
- *
CONVOLUTIONAL neural networks , *SURFACE defects , *VISUAL perception , *FEATURE extraction , *ATTENTION - Abstract
In industrial production, surface defect detection algorithms based on convolutional neural networks have been widely studied to improve production quality. However, for practical applications, there are still many issues to be solved, such as the complexity and diversity of defect categories, the difficulty of obtaining defect samples, and the difficulty of existing algorithms in accurately segmenting defects. To solve these issues, we present an effective defect segmentation network based on visual attention and visual perception termed EDSV-Net. Specifically, we use ResNet18 as the backbone network in EDSV-Net. Then a multi-scale feature extraction (MSFE) module is introduced to enhance the scale invariance of high-level features and the diversity of contextual features. In addition, a spatial attention (SA) model combined with a channel attention (CA) model is applied to low level features and MSFE features, respectively, to extract more effective spatial and semantic information. Moreover, a depthwise separable convolution is introduced to reduce the network complexity. Finally, due to the issues of existing defect detection algorithms ignoring structural similarity and defects being difficult to obtain, we design a balanced defect and structural measure loss function. Meanwhile, we propose a structural similarity measure, which combines the pixel similarity for evaluation. EDSV-Net only requires no more than 60 random abnormal samples to obtain accurate segmentation results and the real-time performance meets the requirements of actual industrial production. Based on three challenging real-world defect datasets, the results of the evaluation demonstrate that EDSV-Net outperforms seven state-of-the-art methods on accuracy and real-time performance. • An efficient, general and real-time surface defect segmentation network is designed. • An attention combination mechanism for high and low feature fusion is proposed. • A novel loss function combining pixel and structural similarity measures is proposed. • A structural similarity evaluation method is proposed for surface defect segmentation. • The network detection speed meets the industrial real-time requirements. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
22. Convolutional Neural Networks for Steel Surface Defect Detection from Photometric Stereo Images
- Author
-
Soukup, D., Huber-Mörk, R., Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Kobsa, Alfred, Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Bebis, George, editor, Boyle, Richard, editor, Parvin, Bahram, editor, Koracin, Darko, editor, McMahan, Ryan, editor, Jerald, Jason, editor, Zhang, Hui, editor, Drucker, Steven M., editor, Kambhamettu, Chandra, editor, El Choubassi, Maha, editor, Deng, Zhigang, editor, and Carlson, Mark, editor
- Published
- 2014
- Full Text
- View/download PDF
23. Image and Video Processing and Recognition Based on Artificial Intelligence.
- Author
-
Park, Kang Ryoung, Kim, Euntai, Lee, Sangyoun, and Park, Kang Ryoung
- Subjects
Technology: general issues ,GC-LSTM model ,HKPolyU-DB ,K-nearest neighbors ,Krawtchouk polynomials ,Marr wavelets ,RANSAC ,SDUMLA-HMT-DB ,Tchebichef polynomials ,action recognition ,active learning ,armature ,artificial image generation ,artificial intelligence ,autoencoders ,bag of deep features ,binarized statistical image features ,biometrics ,body orientation ,bounding box regression ,brain computer interface ,building extraction ,camera position ,channel interaction ,character recognition ,common spatial patterns ,computer vision ,continuous wavelet transform ,convolutional neural network ,convolutional neural networks ,crowd counting ,cycle-consistent adversarial networks ,data augmentation ,deep convolutional neural networks ,deep learning ,depth map ,domain adaptation ,edges to photos ,emotion recognition ,entropy and response ,epidermis ,face image analysis ,face parsing ,face recognition ,facial attributes classification ,fast approximation ,feature distillation ,finger position ,finger-vein recognition ,fully convolutional networks ,generative adversarial net ,generative adversarial network ,generative adversarial network (GAN) ,generative models ,global context ,graph matching ,guidance ,helicopter footage ,heterogeneous database ,high-resolution remote sensing image ,homotopy iterative hard thresholding ,image de-raining ,image processing ,image pyramid ,image-to-image conversion ,infrared circumferential scanning system ,joint attention ,label to photos ,lighting ,local context ,loss function ,malignant thyroid nodule ,mask R-CNN ,medical image fusion ,monocular depth estimation ,multi resolution network ,multi-person ,multi-scale decomposition ,multi-task ,multitask learning ,normalized cross-correlation ,object recognition ,optimization ,orthogonal moments ,orthogonal polynomials ,pathology ,pose estimation ,prediction system ,presentation attack detection ,presentation attack face images ,remote sensing ,residual network ,satellite image ,semantic segmentation ,semi-supervised learning ,single-sample face recognition ,skin ,social robotics ,sparse coding ,super-resolution ,support vector machine ,surface defect detection ,surface inspection ,target recognition ,transfer learning ,typhoon ,ultrasound image ,unobserved database ,vehicle recognition ,weighted binary cross-entropy loss - Abstract
Summary: This book includes 23 published papers on Special issues of "Image and Video Processing and Recognition Based on Artificial Intelligence" in the journal Sensors. The purpose of this Special Issue was to invite high-quality and state-of-the-art academic papers on challenging issues in the field of AI-based image and video processing and recognition.
24. Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network
- Author
-
Xiaoming Lv, Fajie Duan, Jia-jia Jiang, Xiao Fu, and Lin Gan
- Subjects
surface defect detection ,convolutional neural network ,object detection ,Chemical technology ,TP1-1185 - Abstract
Metallic surface defect detection is an essential and necessary process to control the qualities of industrial products. However, due to the limited data scale and defect categories, existing defect datasets are generally unavailable for the deployment of the detection model. To address this problem, we contribute a new dataset called GC10-DET for large-scale metallic surface defect detection. The GC10-DET dataset has great challenges on defect categories, image number, and data scale. Besides, traditional detection approaches are poor in both efficiency and accuracy for the complex real-world environment. Thus, we also propose a novel end-to-end defect detection network (EDDN) based on the Single Shot MultiBox Detector. The EDDN model can deal with defects with different scales. Furthermore, a hard negative mining method is designed to alleviate the problem of data imbalance, while some data augmentation methods are adopted to enrich the training data for the expensive data collection problem. Finally, the extensive experiments on two datasets demonstrate that the proposed method is robust and can meet accuracy requirements for metallic defect detection.
- Published
- 2020
- Full Text
- View/download PDF
25. Fine coordinate attention for surface defect detection.
- Author
-
Xiao, Meng, Yang, Bo, Wang, Shilong, Zhang, Zhengping, and He, Yan
- Subjects
- *
SURFACE defects , *CONVOLUTIONAL neural networks , *IMAGE recognition (Computer vision) , *SPOT welding , *COORDINATES - Abstract
Surface defect detection remains a challenging task due to issues such as inconspicuous targets, significant variations among identical defects, and minimal differences between distinct defects. To address these challenges, a Fine Coordinate Attention (FCA) block is proposed in this paper, which encodes both average and salient information in two coordinate directions, so that the spatial dependence can be captured and the long-range interaction can be achieved. And such localization-friendly information is crucial for industrial surface defect images with subtle targets. Specifically, the FCA block can recalibrate feature maps of a surface defect image through three steps: coordinate information aggregation, cross-dimension interaction, and attention generation. It can be embedded into any convolutional neural network (CNN) structure to improve performance. Additionally, two resistance spot welding (RSW) surface defect datasets are published in this paper: an image classification dataset RSW-C and an object detection dataset RSW-D. Experimental results for image classification and object detection demonstrate that the FCA block outperforms existing attention mechanisms. The code is available at , while the two RSW datasets can be found at www.kaggle.com/datasets/alfredzimmer/rswdatasets. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
26. Defect transformer: An efficient hybrid transformer architecture for surface defect detection.
- Author
-
Wang, Junpu, Xu, Guili, Yan, Fuju, Wang, Jinjin, and Wang, Zhengsheng
- Subjects
- *
SURFACE defects , *CONVOLUTIONAL neural networks , *VIDEO coding , *COMPUTATIONAL neuroscience , *INDUSTRIAL goods , *MULTISCALE modeling - Abstract
Surface defect detection is an extremely crucial step to ensure the quality of industrial products. Nowadays, convolutional neural networks (CNNs) based on encoder–decoder architecture have achieved tremendous success in various defect detection tasks. However, the intrinsic locality of convolution prevents them from modeling long-range interactions explicitly, making it difficult to distinguish pseudo-defects in cluttered backgrounds. Recent transformers are especially skilled at learning global image dependencies, but with limited local structural information for the refined defect location. To overcome the above limitations, we incorporate CNN and transformer into an efficient hybrid transformer architecture for defect detection, termed Defect Transformer (DefT), to capture local and non-local relationships collaboratively. Specifically, in the encoder module, a convolutional stem block is firstly adopted to retain more spatial details. Then, the patch aggregation blocks are used to generate multi-scale representation with four hierarchies, each of them is followed by a series of DefT blocks, which respectively include a locally position-aware block for local position encoding, a lightweight multi-pooling self-attention to model multi-scale global contextual relationships with good computational efficiency, and a convolutional feed-forward network for feature transformation and further local information learning. Finally, a simple but effective decoder module is constructed to gradually recover spatial details from the skip connections in the encoder. Extensive experiments on three datasets demonstrate the superiority and efficiency of our method compared with other deeper and complex CNN- and transformer-based networks. • We study the benefits of vision transformer for pixel-wise defect detection tasks. • We propose a defect detection architecture by porting the properties of CNNs into transformer. • We provide a simpler but better defect detection baseline and can motivate further research. • We conduct extensive experiments to show the superiority and generalization of our method. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
27. Lychee Surface Defect Detection Based on Deep Convolutional Neural Networks with GAN-Based Data Augmentation
- Author
-
Zhifeng Xiao and Chenglong Wang
- Subjects
Surface (mathematics) ,lychee ,business.industry ,Computer science ,generative adversarial network ,Inference ,Boundary (topology) ,Pattern recognition ,Agriculture ,object detection ,Object (computer science) ,Automation ,Convolutional neural network ,Object detection ,deep convolutional neural network ,surface defect detection ,Artificial intelligence ,business ,Agronomy and Crop Science ,Transformer (machine learning model) ,SSD ,Faster RCNN - Abstract
The performance of fruit surface defect detection is easily affected by factors such as noisy background and foliage occlusion. In this study, we choose lychee as a fruit type to investigate its surface quality. Lychees are hard to preserve and have to be stored at low temperatures to keep fresh. Additionally, the surface of lychees is subject to scratches and cracks during harvesting/processing. To explore the feasibility of the automation of defective surface detection for lychees, we build a dataset with 3743 samples divided into three categories, namely, mature, defects, and rot. The original dataset suffers an imbalanced distribution issue. To address it, we adopt a transformer-based generative adversarial network (GAN) as a means of data augmentation that can effectively enhance the original training set with more and diverse samples to rebalance the three categories. In addition, we investigate three deep convolutional neural network (DCNN) models, including SSD-MobileNet V2, Faster RCNN-ResNet50, and Faster RCNN-Inception-ResNet V2, trained under different settings for an extensive comparison study. The results show that all three models demonstrate consistent performance gains in mean average precision (mAP), with the application of GAN-based augmentation. The rebalanced dataset also reduces the inter-category discrepancy, allowing a DCNN model to be trained equally across categories. In addition, the qualitative results show that models trained under the augmented setting can better identify the critical regions and the object boundary, leading to gains in mAP. Lastly, we conclude that the most cost-effective model, SSD-MobileNet V2, presents a comparable mAP (91.81%) and a superior inference speed (102 FPS), suitable for real-time detection in industrial-level applications.
- Published
- 2021
- Full Text
- View/download PDF
28. An Efficient Network for Surface Defect Detection
- Author
-
Xiaofeng Huang, Bin Zhan, Hongxia Ye, and Lin Zesheng
- Subjects
Surface (mathematics) ,010407 polymers ,0209 industrial biotechnology ,Computer science ,02 engineering and technology ,Semantics ,lcsh:Technology ,01 natural sciences ,Convolutional neural network ,lcsh:Chemistry ,convolution neural network ,020901 industrial engineering & automation ,surface defect detection ,General Materials Science ,lcsh:QH301-705.5 ,Instrumentation ,Fluid Flow and Transfer Processes ,lcsh:T ,business.industry ,Process Chemistry and Technology ,General Engineering ,Pattern recognition ,Function (mathematics) ,lcsh:QC1-999 ,0104 chemical sciences ,Computer Science Applications ,lcsh:Biology (General) ,lcsh:QD1-999 ,lcsh:TA1-2040 ,Cascade ,Detection performance ,Artificial intelligence ,lcsh:Engineering (General). Civil engineering (General) ,business ,lcsh:Physics ,data augmentation ,multi-scale cascade connection - Abstract
Convolutional neural networks (CNN) have achieved promising performance in surface defect detection recently. Although many CNN-based methods have been proposed, most of them are limited by the few samples available for training, and the imbalance of positive and negative samples. Hence, their detection performance needs to be further improved. To this end, we propose a multi-scale cascade CNN called MobileNet-v2-dense to detect defects more efficiently. Specifically, the multi-scale cascade structure used in our network can help capture the weak defect semantics that may be lost in the deep network. Then, we propose a novel asymmetric loss function to further improve detection performance. Lastly, a two-stage augmentation method effectively enlarges the training dataset. Experimental results show that, compared to the state-of-the-art, the area under the receiver-operating characteristic curve (AUC-ROC) score of our method increased by 0.16.
- Published
- 2020
- Full Text
- View/download PDF
29. Semantic Segmentation Network for Surface Defect Detection of Automobile Wheel Hub Fusing High-Resolution Feature and Multi-Scale Feature
- Author
-
Xiaoli Zhou, Xu Zhou, Feng Xinxin, Yunzhen Li, Haotian Wen, Chaowei Tang, Yanqing Shao, and Huang Baojin
- Subjects
Technology ,QH301-705.5 ,Computer science ,QC1-999 ,Optical flow ,Convolutional neural network ,optical flow ,Upsampling ,high-resolution network ,surface defect detection ,General Materials Science ,Segmentation ,Pyramid (image processing) ,Biology (General) ,QD1-999 ,Instrumentation ,Fluid Flow and Transfer Processes ,Backbone network ,business.industry ,Physics ,Process Chemistry and Technology ,General Engineering ,Pattern recognition ,Engineering (General). Civil engineering (General) ,automobile wheel hub ,semantic segmentation ,Computer Science Applications ,Chemistry ,Feature (computer vision) ,Artificial intelligence ,TA1-2040 ,business ,F1 score - Abstract
Surface defect detection of an automobile wheel hub is important to the automobile industry because these defects directly affect the safety and appearance of automobiles. At present, surface defect detection networks based on convolutional neural network use many pooling layers when extracting features, reducing the spatial resolution of features and preventing the accurate detection of the boundary of defects. On the basis of DeepLab v3+, we propose a semantic segmentation network for the surface defect detection of an automobile wheel hub. To solve the gridding effect of atrous convolution, the high-resolution network (HRNet) is used as the backbone network to extract high-resolution features, and the multi-scale features extracted by the Atrous Spatial Pyramid Pooling (ASPP) of DeepLab v3+ are superimposed. On the basis of the optical flow, we decouple the body and edge features of the defects to accurately detect the boundary of defects. Furthermore, in the upsampling process, a decoder can accurately obtain detection results by fusing the body, edge, and multi-scale features. We use supervised training to optimize these features. Experimental results on four defect datasets (i.e., wheels, magnetic tiles, fabrics, and welds) show that the proposed network has better F1 score, average precision, and intersection over union than SegNet, Unet, and DeepLab v3+, proving that the proposed network is effective for different defect detection scenarios.
- Published
- 2021
- Full Text
- View/download PDF
30. Metal Surface Defect Detection Using Modified YOLO
- Author
-
Kai Zhang, Li Wang, and Yiming Xu
- Subjects
Numerical Analysis ,Scale (ratio) ,Artificial neural network ,Basis (linear algebra) ,Industrial engineering. Management engineering ,Computer science ,business.industry ,k-means clustering ,Pattern recognition ,QA75.5-76.95 ,T55.4-60.8 ,Convolutional neural network ,Theoretical Computer Science ,Computational Mathematics ,Computational Theory and Mathematics ,surface defect detection ,Feature (computer vision) ,Electronic computers. Computer science ,Cluster (physics) ,YOLO ,Artificial intelligence ,Sensitivity (control systems) ,K-Means++ ,business - Abstract
Aiming at the problems of inefficient detection caused by traditional manual inspection and unclear features in metal surface defect detection, an improved metal surface defect detection technology based on the You Only Look Once (YOLO) model is presented. The shallow features of the 11th layer in the Darknet-53 are combined with the deep features of the neural network to generate a new scale feature layer using the basis of the network structure of YOLOv3. Its goal is to extract more features of small defects. Furthermore, then, K-Means++ is used to reduce the sensitivity to the initial cluster center when analyzing the size information of the anchor box. The optimal anchor box is selected to make the positioning more accurate. The performance of the modified metal surface defect detection technology is compared with other detection methods on the Tianchi dataset. The results show that the average detection accuracy of the modified YOLO model is 75.1%, which ia higher than that of YOLOv3. Furthermore, it also has a great detection speed advantage, compared with faster region-based convolutional neural network (Faster R-CNN) and other detection algorithms. The improved YOLO model can make the highly accurate location information of the small defect target and has strong real-time performance.
- Published
- 2021
- Full Text
- View/download PDF
31. PSIC-Net: Pixel-Wise Segmentation and Image-Wise Classification Network for Surface Defects.
- Author
-
Lei, Linjian, Sun, Shengli, Zhang, Yue, Liu, Huikai, and Xu, Wenjun
- Subjects
DEEP learning ,SURFACE defects ,ARTIFICIAL neural networks ,CONVOLUTIONAL neural networks ,COMPUTER vision ,PIXELS ,KEY performance indicators (Management) - Abstract
Recent years have witnessed the widespread research of the surface defect detection technology based on machine vision, which has spawned various effective detection methods. In particular, the rise of deep learning has allowed the surface defect detection technology to develop further. However, these methods based on deep learning still have some drawbacks. For example, the size of the sample data is not large enough to support deep learning; the location and recognition of surface defects are not accurate enough; the real-time performance of segmentation and classification is not satisfactory. In the context, this paper proposes an end-to-end convolutional neural network model: the pixel-wise segmentation and image-wise classification network (PSIC-Net). With the innovative design of a three-stage network structure, improved loss function and a two-step training mode, PSIC-Net can accurately and quickly segment and classify surface defects with a small dataset of training data. This model was evaluated with three public datasets, and compared with the most advanced defect detection methods. All the performance metrics prove the effectiveness and advancement of PSIC-Net. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
32. Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network.
- Author
-
Lv, Xiaoming, Duan, Fajie, Jiang, Jia-jia, Fu, Xiao, and Gan, Lin
- Subjects
SURFACE defects ,METALLIC surfaces ,PROCESS control systems ,MINING methodology ,ARTIFICIAL neural networks ,INDUSTRIAL goods - Abstract
Metallic surface defect detection is an essential and necessary process to control the qualities of industrial products. However, due to the limited data scale and defect categories, existing defect datasets are generally unavailable for the deployment of the detection model. To address this problem, we contribute a new dataset called GC10-DET for large-scale metallic surface defect detection. The GC10-DET dataset has great challenges on defect categories, image number, and data scale. Besides, traditional detection approaches are poor in both efficiency and accuracy for the complex real-world environment. Thus, we also propose a novel end-to-end defect detection network (EDDN) based on the Single Shot MultiBox Detector. The EDDN model can deal with defects with different scales. Furthermore, a hard negative mining method is designed to alleviate the problem of data imbalance, while some data augmentation methods are adopted to enrich the training data for the expensive data collection problem. Finally, the extensive experiments on two datasets demonstrate that the proposed method is robust and can meet accuracy requirements for metallic defect detection. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.