Search

• A novel method is developed for real-time monitoring of crack dynamic expansion. • An efficient benchmarking method is established to determine crack expansion. • The YOLOv7 algorithm is improved to enhance the accuracy of crack detection. • A new attention mechanism is introduced in the DeepLabv3+ algorithm to improve crack segmentation. Crack monitoring has been a hot research topic in structural health monitoring. However, the current research on deep learning-based crack image focuses more on cracks at a certain moment and ignores the full-time crack expansion details, which are crucial for more reasonable evaluation and safety quantification of concrete structures. This paper proposes a new method based on the combination of improved You Only Look Once v7 (YOLOv7) algorithm, crack expansion benchmark method, improved DeepLabv3+ algorithm, and image processing technology to monitor the whole process of crack development, including real-time crack recognition and real-time monitoring of crack dynamic expansion. The precision of the improved detection algorithm can be improved by a maximum of 5.34%, and the mean intersection over union (mIoU) of the improved segmentation algorithm can be improved by 0.15%, resulting in better segmentation results. The experimental results show that this method can efficiently and accurately achieve real-time tracking of crack dynamic expansion, especially for monitoring of tiny cracks. [ABSTRACT FROM AUTHOR]

Although substantial progress in safety management performance has been made in the construction industry, continuing fatalities and injuries at workplaces hinder sustainable development of this labor-intensive industry. Many machine learning approaches using different types of data such as text, image, video, and audio were adopted for safety risk analysis at construction sites. Our paper aimed to implement a hybrid review of construction safety research based upon machine learning. This hybrid review focused on various attributes from three perspectives: Nature of dataset, machine learning approach, and research topic. After the review of individual attributes, intra-relationships between attributes in each perspective and inter-relationships between attributes across the three perspectives were determined. According to risk recognition, risk prediction, and risk control, feasible research paths were developed from both intra-relationships and inter-relationships between multiple attributes for reference in future studies. Finally, gaps and opportunities were discussed in detail for research agendas on this subject. This hybrid review contributes to outlining the framework of construction safety management based upon machine learning. It is able to provide new entrants with a systematic idea of promising research trends for the future. Research findings are helpful for academia and industry to fill in the gaps between study and practice in the area of construction safety, in order to assist in sustainable development of the construction industry by use of machine learning. [ABSTRACT FROM AUTHOR]

Machine learning (ML) and deep learning (DL) are both branches of AI. As a form of AI, ML automatically adapts to changing datasets with minimal human interference. Deep learning is a subset of ML that uses artificial neural networks to imitate the learning process of the human brain. The 'black box' nature of ML and DL makes their inner workings difficult to understand and interpret. Deploying explainable artificial intelligence (XAI) can help explain why and how the output of ML and DL models are generated. As a result, understanding a model's functioning, behavior, and outputs can be garnered, reducing bias and error and improving confidence in decision-making. Despite providing an improved understanding of model outputs, XAI has received limited attention in construction. This paper presents a narrative review of XAI and a taxonomy of precepts and models to raise awareness about its potential opportunities for use in construction. It is envisaged that the opportunities suggested can stimulate new lines of inquiry to help alleviate the prevailing skepticism and hesitancy toward AI adoption and integration in construction. [ABSTRACT FROM AUTHOR]

Graphical abstract Abstract Increasing sustainability requirements make evaluating different design options for identifying energy-efficient design ever more important. These requirements demand simulation models that are not only accurate but also fast. Machine Learning (ML) enables effective mimicry of Building Performance Simulation (BPS) while generating results much faster than BPS. Component-Based Machine Learning (CBML) enhances the capabilities of the monolithic ML model. Extending monolithic ML approach, the paper presents deep-learning architectures, component development methods and evaluates their suitability for space exploration in building design. Results indicate that deep learning increases the performance of models over simple artificial neural network models. Methods such as transfer learning and Multi-Task Learning make the component development process more efficient. Testing the deep-learning model on 201 new design cases indicates that its cooling energy prediction (R2: 0.983) is similar to BPS, while errors for heating energy predictions (R2: 0.848) are higher than BPS. Higher heating energy prediction error can be resolved by collecting heating data using better design space sampling methods that cover the heating demand distribution effectively. Given that the accuracy of the deep-learning model for heating predictions can be increased, the major advantage of deep-learning models over BPS is their high computation speed. BPS required 1145 s to simulate 201 design cases. Using the deep-learning model, similar results can be obtained in 0.9 s. High computation speed makes deep-learning models suitable for design space exploration. [ABSTRACT FROM AUTHOR]

The colored paintings on the surfaces of ancient Chinese buildings have suffered from the wind and the sun and produced many defects such as paint loss, blurring, and color distortion. Previous methods have not been able to virtually repair them well. Therefore, this paper proposed a virtual restoration method for the weathered beams in the Forbidden City using multiple deep learning algorithms. Instead of using only one technology to restore paintings, this paper divided the painting into 3 parts, i.e., the background, the golden edges, and the dragon patterns, and restored them in different technology. For the background, this paper transformed the problem of unrecognizable color restoration into a semantic segmentation problem using U-Net MobileNet. For the golden edges, this paper used traditional image processing technology to obtain them from the color maps generated by the semantic segmentation algorithm. For the dragon patterns, after sketching the skeletons according to the dragon patterns, the image translation algorithm Pix2pix was applied to generate a realistic dragon pattern. Finally, the three repair results are superimposed to complete the repair. The virtually restored paintings can provide reference and guidance for traditional manual restoration and help the restorers to imagine what they looked like before oxidation, thus alleviating some repetitive work and reducing the complexity of restoration. Besides, each step of the method could form a layer, so that the restorers could overlay or modify them as they wish. [ABSTRACT FROM AUTHOR]

Autonomous driving and the machine learning (ML) models developed to achieve it have grown rapidly in importance and complexity respectively, and with them has also grown their carbon footprint due to long training times. Given the importance of climate change, it should be necessary to include the CO 2 impact of ML models explicitly to encourage competition on more than just model quality. This work presents the implementation of two different Convolutional Neural Network (CNN) training approaches, used for autonomous driving by behavioral cloning in a simulated environment and compares their impact on the CO 2 footprint. Using a cloud execution environment and driving data, previously obtained by applying an end-to-end deep learning technique, the first implemented training approach is a classical approach that uses an image generator that carries out the pre-processing and data augmentation during training. The contribution proposed in this paper is a second approach that improves the training by decreasing the training time, carrying out the data augmentation and pre-processing tasks before training the model, storing the result in RAM and then starting the training. The new approach to training presented in this article finishes the training approximately 38 times faster and reduces the carbon footprint impact by approximately 96%. In absolute values, this is a reduction from an average value of approximately 0.1643 CO 2 e q (kg) to 0.007 CO 2 e q (kg). To estimate the impact of CO 2 , the hardware used for the project, the training time and the cloud service provider were all taken into account. [ABSTRACT FROM AUTHOR]

Complete and high-quality deformation monitoring data are critical for shield tunnel construction safety and quality. In engineering practices, data missing frequently occurs during instrumentation, adversely impacting further analysis and decision making. Existing imputation methods either ignore the crucial interactions between different parameters during shield tunneling or focus on the global characteristics of deformation data while neglect their local difference. This paper proposes a novel hybrid model, MCCB, combining multi-view matrix completion algorithms, convolutional neural network (CNN), and bidirectional long short-term memory (BiLSTM) algorithms to impute missing deformation values in shield tunnel monitoring data. The performance of the proposed method is verified using bridge deformation data from a practical project in Beijing. Different missing patterns of the bridge deformation data are filled. The experiment results show that the proposed model can effectively learn the various characteristics of the deformation data and outperforms the four selected models and its two sub-models, and can be used to improve the accuracy of the deformation prediction through data imputation. The novelty of this study includes two aspects. First is that the complicated interaction between different parameters and local difference of the data are considered simultaneously. They have not been addressed before by existing studies. Second is that the innovative combination of matrix completion and deep learning algorithm for application in missing deformation values imputation. To our best knowledge, no research on engineering construction has implemented this technique before. [ABSTRACT FROM AUTHOR]

Dam displacements can effectively reflect its operational status, and thus establishing a reliable displacement prediction model is important for dam health monitoring. The majority of the existing data-driven models, however, focus on static regression relationships, which cannot capture the long-term temporal dependencies and adaptively select the most relevant influencing factors to perform predictions. Moreover, the emerging modeling tools such as machine learning (ML) and deep learning (DL) are mostly black-box models, which makes their physical interpretation challenging and greatly limits their practical engineering applications. To address these issues, this paper proposes an interpretable mixed attention mechanism long short-term memory (MAM-LSTM) model based on an encoder-decoder architecture, which is formulated in two stages. In the encoder stage, a factor attention mechanism is developed to adaptively select the highly influential factors at each time step by referring to the previous hidden state. In the decoder stage, a temporal attention mechanism is introduced to properly extract the key time segments by identifying the relevant hidden states across all the time steps. For interpretation purpose, our emphasis is placed on the quantification and visualization of factor and temporal attention weights. Finally, the effectiveness of the proposed model is verified using monitoring data collected from a real-world dam, where its accuracy is compared to a classical statistical model, conventional ML models, and homogeneous DL models. The comparison demonstrates that the MAM-LSTM model outperforms the other models in most cases. Furthermore, the interpretation of global attention weights confirms the physical rationality of our attention-based model. This work addresses the research gap in interpretable artificial intelligence for dam displacement prediction and delivers a model with both high-accuracy and interpretability. [ABSTRACT FROM AUTHOR]

• A method for safe interaction in industrial human-robot collaboration is proposed. • A specific reward function with intrinsic reward and extrinsic reward is designed. • Safety and task are considered simultaneously. • It contributes to safe human-robot collaboration and reward shaping. Aiming at human-robot collaboration in manufacturing, the operator's safety is the primary issue during the manufacturing operations. This paper presents a deep reinforcement learning approach to realize the real-time collision-free motion planning of an industrial robot for human-robot collaboration. Firstly, the safe human-robot collaboration manufacturing problem is formulated into a Markov decision process, and the mathematical expression of the reward function design problem is given. The goal is that the robot can autonomously learn a policy to reduce the accumulated risk and assure the task completion time during human-robot collaboration. To transform our optimization object into a reward function to guide the robot to learn the expected behaviour, a reward function optimizing approach based on the deterministic policy gradient is proposed to learn a parameterized intrinsic reward function. The reward function for the agent to learn the policy is the sum of the intrinsic reward function and the extrinsic reward function. Then, a deep reinforcement learning algorithm intrinsic reward-deep deterministic policy gradient (IRDDPG), which is the combination of the DDPG algorithm and the reward function optimizing approach, is proposed to learn the expected collision avoidance policy. Finally, the proposed algorithm is tested in a simulation environment, and the results show that the industrial robot can learn the expected policy to achieve the safety assurance for industrial human-robot collaboration without missing the original target. Moreover, the reward function optimizing approach can help make up for the designed reward function and improve policy performance. [ABSTRACT FROM AUTHOR]