Search

Purpose: The purpose of this study is to develop and evaluate a deep learning model to assist radiologists in classifying lower extremity arteries based on the degree of arterial stenosis caused by plaque in lower extremity computed tomography angiography (CTA) of patients with peripheral artery disease., Methods: In this retrospective study, 265 patients who underwent lower-extremity CTA between January 1, 2016 and October 31, 2019 were selected. A total of 17050 axial images of iliac, femoropopliteal and infrapopliteal artery from these patients were used for the training and validation of the parallel efficient network (p-EffNet), a kind of supervised convolutional neural network, to classify the lower-extremity artery segments according to the degree of stenosis with digital subtraction angiography as reference standard. The classification results of the p-EffNet were then compared with those obtained from radiologists. Receiver operating characteristic curve (ROC) was used to evaluate the performance of the p-EffNet and accuracy, specificity, sensitivity and area under the curve (AUC) were used as measure metrics to compare the performance of the p-EffNet and that of radiologists., Results: The p-EffNet exhibited a good performance of 91.5 % accuracy, 0.987 AUC and 90.2 % sensitivity and 97.7 % specificity in classifying above-knee artery and 90.9 % accuracy, 0.981 AUC, 91.3 % sensitivity and 95.2 % specificity in classifying below-knee artery. When compared with human readers, for both above-knee and below-knee artery, the p-EffNet had comparable accuracy (p = 0.266 and p = 0.808, respectively) and specificity (p = 0.118 and p = 0.971, respectively) but lower sensitivity (p < 0.001 and p = 0.022, respectively)., Conclusions: The p-EffNet demonstrates promising diagnostic performance and has the potential to reduce the workload of radiologists and help to find the plaques that might otherwise have been missed or misjudged., (Copyright © 2021 Elsevier B.V. All rights reserved.)

At the present stage, the identification of dangerous behaviors in public places mostly relies on manual work, which is subjective and has low identification efficiency. This paper proposes an automatic identification method for dangerous behaviors in public places, which analyzes group behavior and speech emotion through deep learning network and then performs multimodal information fusion. Based on the fusion results, people can judge the emotional atmosphere of the crowd, make early warning, and alarm for possible dangerous behaviors. Experiments show that the algorithm adopted in this paper can accurately identify dangerous behaviors and has great application value. [ABSTRACT FROM AUTHOR]

Crack detection plays a critical role in ensuring road safety and maintenance. Traditional, manual, and semi-automatic detection methods have proven inefficient. Nowadays, the emergence of deep learning techniques has opened up new possibilities for automatic crack detection. However, there are few methods with both localization and segmentation abilities, and most perform poorly. The consistent nature of pavement over a small mileage range gives us the opportunity to make improvements. A novel data-augmentation strategy called CrackMover, specifically tailored for crack detection methods, is proposed. Experiments demonstrate the effectiveness of CrackMover for various methods. Moreover, this paper presents a new instance segmentation method for crack detection. It adopts a redesigned backbone network and incorporates a cascade structure for the region-based convolutional network (R-CNN) part. The experimental evaluation showcases significant performance improvements achieved by these approaches in crack detection. The proposed method achieves an average precision of 33.3%, surpassing Mask R-CNN with a Residual Network 50 backbone by 8.6%, proving its effectiveness in detecting crack distress. [ABSTRACT FROM AUTHOR]

Ensuring road safety, structural stability and durability is of paramount importance, and detecting road cracks plays a critical role in achieving these goals. We propose a GM-ResNet-based method to enhance the precision and efficacy of crack detection. Leveraging ResNet-34 as the foundational network for crack image feature extraction, we consider the challenge of insufficient global and local information assimilation within the model. To overcome this, we incorporate the global attention mechanism into the architecture, facilitating comprehensive feature extraction across the channel and the spatial width and height dimensions. This dynamic interaction across these dimensions optimizes feature representation and generalization, resulting in a more precise crack detection outcome. Recognizing the limitations of ResNet-34 in managing intricate data relationships, we replace its fully connected layer with a multilayer fully connected neural network. We fashion a deep network structure by integrating multiple linear, batch normalization and activation function layers. This construction amplifies feature expression, stabilizes training convergence and elevates the performance of the model in complex detection tasks. Moreover, tackling class imbalance is imperative in road crack detection. Introducing the focal loss function as the training loss addresses this challenge head-on, effectively mitigating the adverse impact of class imbalance on model performance. The experimental outcomes on a publicly available crack dataset emphasize the advantages of the GM-ResNet in crack detection accuracy compared to other methods. It is worth noting that the proposed method has better evaluation indicators in the detection results compared with alternative methodologies, highlighting its effectiveness. This validates the potency of our method in achieving optimal crack detection outcomes. [ABSTRACT FROM AUTHOR]

The monitoring and prevention of cracks in tunnel structures is an essential problem and the traditional methods are arduous to suffice the rapid increasing of tunnel mileage. Many researches, nowadays, mainly focus on the automatic identification and intelligent detection of cracks. However, crack identification and localization of tunnel structures are merely preliminary for effective prevention. Therefore, how to intelligently analyze and predict the further evolution of cracks will be the top priority of tunnel disaster prevention. In this article, a novel method is proposed which combinates deep learning (DL) techniques and finite element method to detect and analyze the cracks which is significant for the intelligent prevention. The innovation of this article lies that the position of cracks is identified automatically with the DL based on Mask R-CNN method and the evolution of cracks is predicted efficiently with FEM model. [ABSTRACT FROM AUTHOR]

With the rapid development of the high-speed railway industry, the safety of railway operations is becoming increasingly important. As a symmetrical structure, traditional manual patrol and camera surveillance solutions on both sides of the railway require enormous manpower and material resources and are highly susceptible to weather and electromagnetic interference. In contrast, a distributed fiber optic vibration sensing system can be continuously monitored and is not affected by electromagnetic interference to false alarms. However, it is still a challenge to identify the type of intrusion event along the fiber optic cable. In this paper, a railway intrusion event classification and location scheme based on a distributed vibration sensing system was proposed. In order to improve the accuracy and reliability of the recognition, a 1 DSE-ResNeXt+SVM method was demonstrated. Squeeze-and-excitation blocks with attention mechanisms increased the classification ability by sifting through feature information without being influenced by non-critical information, while a support vector machine classifier can further improve the classification accuracy. The method achieved an accuracy of 96.0% for the identification of railway intrusion events with the field experiments. It illustrates that the proposed scheme can significantly improve the safety of railway operations and reduce the loss of personnel and property safety. [ABSTRACT FROM AUTHOR]

With the continuous development of engineering construction in China, more and more large-section highway tunnels have emerged. Different geological engineering environments determine the diversity of construction plans. The determination of construction plans and the prediction of tunnel deformations have always been the key points of engineering construction. In this paper, we use numerical simulations to determine specific construction parameters in the context of actual highway tunnel projects, and then use deep learning methods to predict deformation during tunnel construction, thus providing guidance for construction. We have found that: (i) Different excavation sequences and excavation depths have different effects on the surrounding rock deformation around the tunnel. The optimal excavation sequence through numerical simulation in this study is symmetrical excavation, and the excavation depth is 2 m. (ii) Numerical simulation based on Long Short-Term Memory (LSTM) algorithm is used to predict the tunnel deformation. It is found that the prediction results of the LSTM algorithm are more consistent with the actual monitoring data. (iii) Multi-step prediction is more important for engineering guidance, and three-step prediction can be considered during the process of engineering construction. Therefore, the machine learning algorithm provides a new method for engineering prediction. [ABSTRACT FROM AUTHOR]

The accurate intelligent identification and detection of road cracks is a key issue in road maintenance, and it has become popular to perform this task through the field of computer vision. In this paper, we proposed a deep learning-based crack detection method that initially uses the idea of image sparse representation and compressed sensing to preprocess the datasets. Only the pixels that represent the crack features remain, while most pixels of non-crack features are relatively sparse, which can significantly improve the accuracy and efficiency of crack identification. The proposed method achieved good results based on the limited datasets of crack images. Various algorithms were tested, namely, linear smooth, median filtering, Gaussian smooth, and grayscale threshold, where the optimal parameters of the various algorithms were analyzed and trained with faster regions with convolutional neural network features (faster R-CNN). The results of the experiments showed that the proposed method has good robustness, with higher detection efficiency in the presence of, for example, road markings, shallow cracks, multiple cracks, and blurring. The result shows that the improvement of mean average precision (mAP) can reach 5% compared with the original method. [ABSTRACT FROM AUTHOR]

Given the outbreak of COVID-19 pandemic and the shortage of medical resource, extensive deep learning models have been proposed for automatic COVID-19 diagnosis, based on 3D computed tomography (CT) scans. However, the existing models independently process the 3D lesion segmentation and disease classification, ignoring the inherent correlation between these two tasks. In this paper, we propose a joint deep learning model of 3D lesion segmentation and classification for diagnosing COVID-19, called DeepSC-COVID, as the first attempt in this direction. Specifically, we establish a large-scale CT database containing 1,805 3D CT scans with fine-grained lesion annotations, and reveal 4 findings about lesion difference between COVID-19 and community acquired pneumonia (CAP). Inspired by our findings, DeepSC-COVID is designed with 3 subnets: a cross-task feature subnet for feature extraction, a 3D lesion subnet for lesion segmentation, and a classification subnet for disease diagnosis. Besides, the task-aware loss is proposed for learning the task interaction across the 3D lesion and classification subnets. Different from all existing models for COVID-19 diagnosis, our model is interpretable with fine-grained 3D lesion distribution. Finally, extensive experimental results show that the joint learning framework in our model significantly improves the performance of 3D lesion segmentation and disease classification in both efficiency and efficacy. [ABSTRACT FROM AUTHOR]

Purpose: The segmentation accuracy of medical images was improved by increasing the number of training samples using a local image warping technique. The performance of the proposed method was evaluated in the segmentation of breast masses, prostate and brain tumors, and lung nodules. Methods: We propose a simple data augmentation method which is called stochastic evolution (SE). Specifically, the idea of SE stems from our thinking about the deterioration of the diseased tissue and the healing process. In order to simulate this natural process, we implement it according to the local distortion algorithm in image warping. In other words, the irregular deterioration and healing processes of the diseased tissue is simulated according to the direction of the local distortion, thereby producing a natural sample that is indistinguishable by humans. Results: The proposed method is evaluated on four segmentation tasks of breast masses, prostate, brain tumors, and lung nodules. Comparing the experimental results of four segmentation methods based on the UNet segmentation architecture without adding any expanded data during training, the accuracy and the Hausdorff distance obtained in our approach remain almost the same as other methods. However, the dice similarity coefficient (DSC) and sensitivity (SEN) have both improved to some extent. Among them, DSC is increased by 5.2%, 2.8%, 1.0%, and 3.2%, respectively; SEN is increased by 6.9%, 4.3%, 1.2%, and 4.5%, respectively. Conclusions: Experimental results show that the proposed SE data augmentation method could improve the segmentation accuracy of breast masses, prostate, brain tumors, and lung nodules. The method also shows the robustness with different image datasets and imaging modalities. [ABSTRACT FROM AUTHOR]

• For small and juxtapleural nodules, our method can achieve attractive performance. • Extract multi-view and multi-scale features of nodules by a cascaded structure. • A dual-pathway architecture based on the residual block was proposed. • We propose an improved weighted sampling strategy that can adequately sample small nodules. It is difficult to obtain an accurate segmentation due to the variety of lung nodules in computed tomography (CT) images. In this study, we propose a data-driven model, called the Cascaded Dual-Pathway Residual Network (CDP-ResNet) to improve the segmentation of lung nodules in the CT images. Our approach incorporates the multi-view and multi-scale features of different nodules from CT images. The proposed residual block based dual-path network extracts local features and rich contextual information of lung nodules. In addition, we designed an improved weighted sampling strategy to select training samples based on the edge. The proposed method was extensively evaluated on an LIDC dataset, which contains 986 nodules. Experimental results show that the CDP-ResNet achieves superior segmentation performance with an average DICE score (standard deviation) of 81.58% (11.05) on the LIDC dataset. Moreover, we compared our results with those of four radiologists on the same dataset. The comparison shows that the CDP-ResNet is slightly better than human experts in terms of segmentation accuracy. Meanwhile, the proposed segmentation method outperforms existing methods. [ABSTRACT FROM AUTHOR]

The intelligent crack detection method is an important guarantee for the realization of intelligent operation and maintenance, and it is of great significance to traffic safety. In recent years, the recognition of road pavement cracks based on computer vision has attracted increasing attention. With the technological breakthroughs of general deep learning algorithms in recent years, detection algorithms based on deep learning and convolutional neural networks have achieved better results in the field of crack recognition. In this paper, deep learning is investigated to intelligently detect road cracks, and Faster R-CNN and Mask R-CNN are compared and analyzed. The results show that the joint training strategy is very effective, and we are able to ensure that both Faster R-CNN and Mask R-CNN complete the crack detection task when trained with only 130+ images and can outperform YOLOv3. However, the joint training strategy causes a degradation in the effectiveness of the bounding box detected by Mask R-CNN. [ABSTRACT FROM AUTHOR]

Remote sensing has now been widely used in various fields, and the research on the automatic land-cover segmentation methods of remote sensing imagery is significant to the development of remote sensing technology. Deep learning methods, which are developing rapidly in the field of semantic segmentation, have been widely applied to remote sensing imagery segmentation. In this work, a novel deep learning network—Dual Encoder with Attention Network (DEANet) is proposed. In this network, a dual-branch encoder structure, whose first branch is used to generate a rough guidance feature map as area attention to help re-encode feature maps in the next branch, is proposed to improve the encoding ability of the network, and an improved pyramid partial decoder (PPD) based on the parallel partial decoder is put forward to make fuller use of the features form the encoder along with the receptive filed block (RFB). In addition, an edge attention module using the transfer learning method is introduced to explicitly advance the segmentation performance in edge areas. Except for structure, a loss function composed with the weighted Cross Entropy (CE) loss and weighted Union subtract Intersection (UsI) loss is designed for training, where UsI loss represents a new region-based aware loss which replaces the IoU loss to adapt to multi-classification tasks. Furthermore, a detailed training strategy for the network is introduced as well. Extensive experiments on three public datasets verify the effectiveness of each proposed module in our framework and demonstrate that our method achieves more excellent performance over some state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The health monitoring of tunnel structures is vital to the safe operation of railway transportation systems. With the increasing mileage of tunnels, regular inspection and health monitoring are urgently demanded for the tunnel structures, especially for information regarding deformation and damage. However, traditional methods of tunnel inspection are time-consuming, expensive and highly dependent on human subjectivity. In this paper, an automatic tunnel monitoring method is investigated based on image data which is collected through the moving vision measurement unit consisting of camera array. Furthermore, geometric modelling and crack inspection algorithms are proposed where a robust three-dimensional tunnel model is reconstructed utilizing a B-spline method and crack identification is conducted by means of a Mask R-CNN network. The innovation of this investigation is that we combine the robust modelling which could be applied for the deformation analysis and the crack detection where a deep learning method is employed to recognize the tunnel cracks intelligently based on image sensors. In this study, experiments were conducted on a subway tunnel structure several kilometers long, and a robust three-dimensional model is generated and the cracks are identified automatically with the image data. The superiority of this proposal is that the comprehensive information of geometry deformation and crack damage can ensure the reliability and improve the accuracy of health monitoring. [ABSTRACT FROM AUTHOR]

An accurate segmentation of lung nodules in computed tomography (CT) images is critical to lung cancer analysis and diagnosis. However, due to the variety of lung nodules and the similarity of visual characteristics between nodules and their surroundings, a robust segmentation of nodules becomes a challenging problem. In this study, we propose the Dual-branch Residual Network (DB-ResNet) which is a data-driven model. Our approach integrates two new schemes to improve the generalization capability of the model: (1) the proposed model can simultaneously capture multi-view and multi-scale features of different nodules in CT images; (2) we combine the features of the intensity and the convolutional neural networks (CNN). We propose a pooling method, called the central intensity-pooling layer (CIP), to extract the intensity features of the center voxel of the block, and then use the CNN to obtain the convolutional features of the center voxel of the block. In addition, we designed a weighted sampling strategy based on the boundary of nodules for the selection of those voxels using the weighting score, to increase the accuracy of the model. The proposed method has been extensively evaluated on the LIDC-IDRI dataset containing 986 nodules. Experimental results show that the DB-ResNet achieves superior segmentation performance with the dice similarity coefficient (DSC) of 82.74% on the dataset. Moreover, we compared our results with those of four radiologists on the same dataset. The comparison showed that our DSC was 0.49% higher than that of human experts. This proves that our proposed method is as good as the experienced radiologist. • The proposed DB-ResNet model can achieve attractive segmentation performance. • A novel central intensity-pooling layer was proposed. • We incorporate the traditional intensity features into the CNN architecture. • The weighted sampling strategy was improved to handle the unbalanced training labels. [ABSTRACT FROM AUTHOR]

The accurate effluent prediction plays a crucial role in providing early warning for abnormal effluent and achieving the adjustment of feedforward control parameters during wastewater treatment. This study applied a dual-staged attention mechanism based on long short-term memory network (DA-LSTM) to improve the accuracy of effluent quality prediction. The results showed that input attention (IA) and temporal attention (TA) significantly enhanced the prediction performance of LSTM. Specially, IA could adaptively adjust feature weights to enhance the robustness against input noise, with R2 increased by 13.18%. To promote its long-term memory ability, TA was used to increase the memory span from 96 h to 168 h. Compared to a single LSTM model, the DA-LSTM model showed an improvement in prediction accuracy by 5.10%, 2.11%, 14.47% for COD, TP, and TN. Additionally, DA-LSTM demonstrated excellent generalization performance in new scenarios, with the R2 values for COD, TP, and TN increasing by 22.67%, 20.06%, and 17.14% respectively, while the MAPE values decreased by 56.46%, 63.08%, and 42.79%. In conclusion, the DA-LSTM model demonstrated excellent prediction performance and generalization ability due to its advantages of feature-adaptive weighting and long-term memory focusing. This has forward-looking significance for achieving efficient early warning of abnormal operating conditions and timely management of control parameters. [Display omitted] • Improving prediction accuracy of effluent quality in multivariate time series. • Dynamically adjusting feature weights and selecting critical features. • Adaptively focusing on historical information and enhancing long-term memory. • Outstanding generalization performance in novel scenarios. [ABSTRACT FROM AUTHOR]