Search

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future.

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

The 3D reconstruction of ancient buildings through inclined photogrammetry finds a wide range of applications in surveying, visualization and heritage conservation. Unlike indoor objects, reconstructing ancient buildings presents unique challenges, including the slow speed of 3D reconstruction using traditional methods, the complex textures of ancient structures and geometric issues caused by repeated textures. Additionally, there is a hash conflict problem when rendering outdoor scenes using neural radiation fields. To address these challenges, this paper proposes a 3D reconstruction method based on depth-supervised neural radiation fields. To enhance the representation of the geometric neural network, the addition of a truncated signed distance function (TSDF) supplements the existing signed distance function (SDF). Furthermore, the neural network's training is supervised using depth information, leading to improved geometric accuracy in the reconstruction model through depth data obtained from sparse point clouds. This study also introduces a progressive training strategy to mitigate hash conflicts, allowing the hash table to express important details more effectively while reducing feature overlap. The experimental results demonstrate that our method, under the same number of iterations, produces images with clearer structural details, resulting in an average 15% increase in the Peak Signal-to-Noise Ratio (PSNR) value and a 10% increase in the Structural Similarity Index Measure (SSIM) value. Moreover, our reconstruction model produces higher-quality surface models, enabling the fast and highly geometrically accurate 3D reconstruction of ancient buildings. [ABSTRACT FROM AUTHOR]

High-quality agricultural multi-view stereo reconstruction technology is the key to precision and informatization in agriculture. Multi-view stereo reconstruction methods are an important part of 3D vision technology. In the multi-view stereo 3D reconstruction method based on deep learning, the effect of feature extraction directly affects the accuracy of reconstruction. Aiming at the actual problems in orchard fruit tree reconstruction, this paper designs an improved multi-view stereo structure based on the combination of remote sensing and artificial intelligence to realize the accurate reconstruction of jujube tree trunks. Firstly, an automatic key frame extraction method is proposed for the DSST target tracking algorithm to quickly recognize and extract high-quality data. Secondly, a composite U-Net feature extraction network is designed to enhance the reconstruction accuracy, while the DRE-Net feature extraction enhancement network improved by the parallel self-attention mechanism enhances the reconstruction completeness. Comparison tests show different levels of improvement on the Technical University of Denmark (DTU) dataset compared to other deep learning-based methods. Ablation test on the self-constructed dataset, the MVSNet + Co U-Net + DRE-Net_SA method proposed in this paper improves 20.4% in Accuracy, 12.8% in Completion, and 16.8% in Overall compared to the base model, which verifies the real effectiveness of the scheme. [ABSTRACT FROM AUTHOR]

Contactless and non-destructive measuring tools can facilitate the moisture monitoring of bagged or bulk grain during transportation and storage. However, accurate target recognition and size prediction always impede the effectiveness of contactless monitoring in actual use. This paper developed a novel 3D reconstruction method upon multi-angle point clouds using a binocular depth camera and a proper Yolo-based neural model to resolve the problem. With this method, this paper developed an embedded and low-cost monitoring system for the in-warehouse grain bags, which predicted targets' 3D size and boosted contactless grain moisture measuring. Identifying and extracting the object of interest from the complex background was challenging in size prediction of the grain silo-bag on a conveyor. This study first evaluated a series of Yolo-based neural network models and explored the most appropriate neural network structure for accurately extracting the grain bag. In point-cloud processing, this study constructed a rotation matrix to fuse multi-angle point clouds to generate a complete one. This study deployed all the above methods on a Raspberry Pi-embedded board to perform the grain bag's 3D reconstruction and size prediction. For experimental validation, this study built the 3D reconstruction platform and tested grain bags' reconstruction performance. First, this study determined the appropriate positions (−60°, 0°, 60°) with the least positions and high reconstruction quality. Then, this study validated the efficacy of the embedded system by evaluating its speed and accuracy and comparing it to the original Torch model. Results demonstrated that the NCNN-accelerated model significantly enhanced the average processing speed, nearly 30 times faster than the Torch model. The proposed system predicted the objects' length, width, and height, achieving accuracies of 97.76%, 97.02%, and 96.81%, respectively. The maximum residual value was less than 9 mm. And all the root mean square errors were less than 7 mm. In the future, the system will mount three depth cameras for achieving real-time size prediction and introduce a contactless measuring tool to finalize grain moisture detection. [ABSTRACT FROM AUTHOR]

3D reconstruction of objects is with interest nowadays, mainly in production industry. The main challenge of them is accuracy and processing time, especially for small and detailed objects. The field of photogrammetry realizes the 3D reconstruction of objects through 2D photos. Different software, free or non-free exists, providing different quality and performance. Accurate 3D reconstruction is important in cloning objects, especially in the industry of spare parts or in the production of prostheses in medicine, etc. Determining accurately the sizes of the object, especially those with complex geometric shapes is very important in the 3D printing process. The purpose of this paper is the analysis of the performance of 3D reconstruction in terms of accuracy for objects of different sizes regarding the number of its photos and the time evaluation of this process. The 3D reconstruction will be performed by free software Meshroom, measurement will be done in MeshLab and non-free software Agisoft. Experimental results show that quality and performance of 3D reconstruction depends on the number of photos of the object, concluding in finding the optimal balance between these parameters. By comparing obtained results from MeshRoom and Meshlag versus Agisoft, it is claimed that Agisoft performs better than MeshRoom. It offers more optimization techniques, reduces processing time, more visual quality in the reconstructed 3D object as well as more accuracy in measurement. [ABSTRACT FROM AUTHOR]

A key feature for urban digital twins (DTs) is an automatically generated detailed 3D representation of the built and unbuilt environment from aerial imagery, footprints, LiDAR, or a fusion of these. Such 3D models have applications in architecture, civil engineering, urban planning, construction, real estate, Geographical Information Systems (GIS), and many other areas. While the visualization of large-scale data in conjunction with the generated 3D models is often a recurring and resource-intensive task, an automated workflow is complex, requiring many steps to achieve a high-quality visualization. Methods for building reconstruction approaches have come a long way, from previously manual approaches to semi-automatic or automatic approaches. This paper aims to complement existing methods of 3D building generation. First, we present a literature review covering different options for procedural context generation and visualization methods, focusing on workflows and data pipelines. Next, we present a semi-automated workflow that extends the building reconstruction pipeline to include procedural context generation using Python and Unreal Engine. Finally, we propose a workflow for integrating various types of large-scale urban analysis data for visualization. We conclude with a series of challenges faced in achieving such pipelines and the limitations of the current approach. However, the steps for a complete, end-to-end solution involve further developing robust systems for building detection, rooftop recognition, and geometry generation and importing and visualizing data in the same 3D environment, highlighting a need for further research and development in this field. [ABSTRACT FROM AUTHOR]

Estimating depth from RGB images is a long-standing ill-posed problem, which has been explored for decades by the computer vision, graphics, and machine learning communities. Among the existing techniques, stereo matching remains one of the most widely used in the literature due to its strong connection to the human binocular system. Traditionally, stereo-based depth estimation has been addressed through matching hand-crafted features across multiple images. Despite the extensive amount of research, these traditional techniques still suffer in the presence of highly textured areas, large uniform regions, and occlusions. Motivated by their growing success in solving various 2D and 3D vision problems, deep learning for stereo-based depth estimation has attracted a growing interest from the community, with more than 150 papers published in this area between 2014 and 2019. This new generation of methods has demonstrated a significant leap in performance, enabling applications such as autonomous driving and augmented reality. In this paper, we provide a comprehensive survey of this new and continuously growing field of research, summarize the most commonly used pipelines, and discuss their benefits and limitations. In retrospect of what has been achieved so far, we also conjecture what the future may hold for deep learning-based stereo for depth estimation research. [ABSTRACT FROM AUTHOR]

Three-dimensional (3D) reconstruction technology is the key technology to establish and express the objective world by using computer, and it is widely used in real 3D, automatic driving, aerospace, navigation and industrial robot applications. According to different principles, it is mainly divided into methods based on traditional multi-view geometry and methods based on deep learning. This paper introduces the above methods from the perspective of three-dimensional space representation. The feature extraction and stereo matching theory of traditional 3D reconstruction methods are the theoretical basis of 3D reconstruction methods based on deep learning, so the paper focuses on them. With the development of traditional 3D reconstruction methods and the development of deep learning related theories, the explicit deep learning 3D reconstruction method represented by MVSNet and the implicit 3D reconstruction method represented by NeRF have been gradually developed. At the same time, the dataset and evaluation indicators for 3D reconstruction were introduced. Finally, a summary of image based 3D reconstruction was provided. [ABSTRACT FROM AUTHOR]

In recent years, Simultaneous Localization and Mapping (SLAM) systems have shown significant performance, accuracy, and efficiency gains, especially when Neural Radiance Fields (NeRFs) are implemented. NeRF-based SLAM in mapping aims to implicitly understand irregular environmental information using large-scale parameters of deep learning networks in a data-driven manner so that specific environmental information can be predicted from a given perspective. NeRF-based SLAM in tracking jointly optimizes camera pose and implicit scene network parameters through inverse rendering or combines VO and NeRF mapping to achieve real-time positioning and mapping. This paper firstly analyzes the current situation of NeRF and SLAM systems and then introduces the state-of-the-art in NeRF-based SLAM. In addition, datasets and system evaluation methods used by NeRF-based SLAM are introduced. In the end, current issues and future work are analyzed. Based on an investigation of 30 related research articles, this paper provides in-depth insight into the innovation of SLAM and NeRF methods and provides a useful reference for future research. [ABSTRACT FROM AUTHOR]

This Special Issue gathers papers reporting research on various aspects of the use of low-cost photogrammetric and lidar sensors for indoor building reconstruction. It includes contributions presenting improvements in the alignment of mobile mapping systems with and without a prior 3D BIM model, the interpretation of both imagery and lidar data of indoor scenery and finally the reconstruction and enrichment of existing 3D point clouds and meshes with BIM information. Concretely, the publications showcase methods and experiments for the Reconstruction of Indoor Navigation Elements for Point Cloud of Buildings with Occlusions and Openings by Wall Segment Restoration from Indoor Context Labeling, Two-Step Alignment of Mixed Reality Devices to Existing Building Data, Pose Normalization of Indoor Mapping Datasets Partially Compliant with the Manhattan World Assumption, A Robust Rigid Registration Framework of 3D Indoor Scene Point Clouds Based on RGB-D Information, 3D Point Cloud Semantic Augmentation for Instance Segmentation of 360° Panoramas by Deep Learning Techniques and the Symmetry-Based Coarse Registration of Smartphone's Colorful Point Clouds with CAD Drawings (RegARD) for Low-Cost Digital Twin Buildings. [ABSTRACT FROM AUTHOR]

Tomographic synthetic aperture radar (TomoSAR) obtains elevation resolution by adding multiple baselines successively in the direction perpendicular to the line of sight, thereby realizing three-dimensional (3D) reconstruction of complex scenes and significantly promoting the development of the 3D application field. However, a large data redundancy and long mapping time in traditional 3D imaging lead to a large data transmission burden, low efficiency, and high costs. To solve the above problems, this paper proposes a distributed SAR high-resolution and wide-swath (HRWS) 3D imaging technology scheme. The proposed scheme overcomes the size limitation of traditional single-satellite antennas through the multi-channel arrangement of multiple satellites in the elevation direction to achieve HRWS imaging; meanwhile, the distributed SAR system is integrated with tomographic processing technology to realize 3D imaging of difficult areas by using the elevation directional resolution of TomoSAR systems. HRWS 3D SAR increases the baseline length and channel number by transmission in turn, which leads to excessive pulse repetition frequency and causes echoes of different pulse signals to overlap in the same receiving cycle, resulting in range ambiguity and thus seriously affecting the quality of the 3D reconstruction. To solve this problem, this paper proposes a range ambiguity resolution algorithm based on multi-beam forming and verifies it on the measured data from airborne array SAR. Compared with the traditional TomoSAR, the distributed HRWS 3D SAR scheme proposed in this paper can obtain a greater mapping bandwidth with the same resolution in a single flight, thereby enhancing the time correlation, reducing data redundancy, and greatly improving mapping efficiency. [ABSTRACT FROM AUTHOR]

The reflection phenomenon exhibited by highly reflective surfaces considerably affects the quality of captured images, thereby rendering the task of structured light (SL) 3D reconstruction. In this paper, a polarized SL method is proposed to address the reconstruction issues on high-reflectance surfaces. The SL system we build in this paper involves a four-channel polarizing camera and a digital light processing (DLP) projector equipped with a polarizer in the lens. The built system enables the simultaneous acquisition of four groups of fringe images, each with different brightness differences. Then, a binary time-multiplexing SL method is adopted to obtain four distinct point clouds. Additionally, a fusion algorithm is proposed to merge the four point clouds into a single, precise, and complete point cloud. Several experiments have been conducted to demonstrate that the proposed method is capable of achieving excellent reconstruction outcomes on highly reflective surfaces. [ABSTRACT FROM AUTHOR]

Scanning electron microscopy (SEM) has an important application in the petroleum field, which is often used to analyze the microstructure of reservoir rocks, etc. Most of these analyses are based on two-dimensional images. In fact, SEM can carry out micro-nano scale three-dimensional measurement, and three-dimensional models can provide more accurate information than two-dimensional images. Among the commonly used SEM 3D reconstruction methods, parallax depth mapping is the most commonly used method. Multiple SEM images can be obtained by continuously tilting the sample table at a certain Angle, and multiple point clouds can be generated according to the parallax depth mapping method, and a more complete point clouds recovery can be achieved by combining the point clouds registration. However, the root mean square error of the point clouds generated by this method is relatively large and unstable after participating in point clouds registration. Therefore, this paper proposes a new method for generating point clouds. Firstly, the sample stage is rotated by a certain angle to obtain two SEM images. This operation makes the rotation matrix a known quantity. Then, based on the imaging model, an equation system is constructed to estimate the unknown translation parameters, and finally, triangulation is used to obtain the point clouds. The method proposed in this paper was tested on a publicly available 3D SEM image set, and the results showed that compared to the disparity depth mapping method, the point clouds generated by our method showed a significant reduction in root mean square error and relative rotation error in point clouds registration. [ABSTRACT FROM AUTHOR]

3D (Three-Dimensional) scene inpainting aims to remove objects from scenes and generate visually plausible regions to fill the hollows. Leveraging the foundation of NeRF (Neural Radiance Field), considerable advancements have been achieved in the realm of 3D scene inpainting. However, prevalent issues persist: primarily, the presence of inconsistent 3D details across different viewpoints and occlusion losses of real background details in inpainted regions. This paper presents a NeRF-based inpainting approach using uncertainty estimation that formulates mask and uncertainty branches for consistency enhancement. In the initial training, the mask branch learns a 3D-consistent representation from inaccurate input masks, and after background rendering, the background regions can be fully exposed to the views. The uncertainty branch learns the visibility of spatial points by modeling them as Gaussian distributions, generating variances to identify regions to be inpainted. During the inpainting training phase, the uncertainty branch measures 3D consistency in the inpainted views and calculates the confidence from the variance as dynamic weights, which are used to balance the color and adversarial losses to achieve 3D-consistent inpainting with both the structure and texture. The results were evaluated on datasets such as Spin-NeRF and NeRF-Object-Removal. The proposed approach outperformed the baselines in inpainting metrics of LPIPS and FID, and preserved more spatial details from real backgrounds in multi-scene settings, thus achieving 3D-consistent restoration. [ABSTRACT FROM AUTHOR]

With the increasing scale of deep-sea oil exploration and drilling platforms, the assessment, maintenance, and optimization of marine structures have become crucial. Traditional detection and manual measurement methods are inadequate for meeting these demands, but three-dimensional laser scanning technology offers a promising solution. However, the complexity of the marine environment, including waves and wind, often leads to problematic point cloud data characterized by noise points and redundancy. To address this challenge, this paper proposes a method that combines K-Nearest-Neighborhood filtering with a hyperbolic function-based weighted hybrid filtering. The experimental results demonstrate the exceptional performance of the algorithm in processing point cloud data from offshore oil and gas platforms. The method improves noise point filtering efficiency by approximately 11% and decreases the total error by 0.6 percentage points compared to existing technologies. Not only does this method accurately process anomalies in high-density areas—it also removes noise while preserving important details. Furthermore, the research method presented in this paper is particularly suited for processing large point cloud data in complex marine environments. It enhances data accuracy and optimizes the three-dimensional reconstruction of offshore oil and gas platforms, providing reliable dimensional information for land-based prefabrication of these platforms. [ABSTRACT FROM AUTHOR]

This paper conducts a comparative evaluation between Neural Radiance Fields (NeRF) and photogrammetry for 3D reconstruction in the cultural heritage domain. Focusing on three case studies, of which the Terpsichore statue serves as a pilot case, the research assesses the quality, consistency, and efficiency of both methods. The results indicate that, under conditions of reduced input data or lower resolution, NeRF outperforms photogrammetry in preserving completeness and material description for the same set of input images (with known camera poses). The study recommends NeRF for scenarios requiring extensive area mapping with limited images, particularly in emergency situations. Despite NeRF's developmental stage compared to photogrammetry, the findings demonstrate higher potential for describing material characteristics and rendering homogeneous textures with enhanced visual fidelity and accuracy; however, NeRF seems more prone to noise effects. The paper advocates for the future integration of NeRF with photogrammetry to address respective limitations, offering more comprehensive representation for cultural heritage preservation tasks. Future developments include extending applications to planar surfaces and exploring NeRF in virtual and augmented reality, as well as studying NeRF evolution in line with emerging trends in semantic segmentation and in-the-wild scene reconstruction. [ABSTRACT FROM AUTHOR]

To address the fuzzy reconstruction effect on distant objects in unbounded scenes and the difficulty in feature matching caused by the thin structure of power lines in images, this paper proposes a novel image-based method for the reconstruction of power transmission lines (PTLs). The dataset used in this paper comprises PTL progressive motion sequence datasets, constructed by a visual acquisition system carried by a developed Flying–walking Power Line Inspection Robot (FPLIR). This system captures close-distance and continuous images of power lines. The study introduces PL-NeRF, that is, an enhanced method based on the Neural Radiance Fields (NeRF) method for reconstructing PTLs. The highlights of PL-NeRF include (1) compressing the unbounded scene of PTLs by exploiting the spatial compression of normal L ∞ ; (2) encoding the direction and position of the sample points through Integrated Position Encoding (IPE) and Hash Encoding (HE), respectively. Compared to existing methods, the proposed method demonstrates good performance in 3D reconstruction, with fidelity indicators of PSNR = 29, SSIM = 0.871, and LPIPS = 0.087. Experimental results highlight that the combination of PL-NeRF with progressive motion sequence images ensures the integrity and continuity of PTLs, improving the efficiency and accuracy of image-based reconstructions. In the future, this method could be widely applied for efficient and accurate 3D reconstruction and inspection of PTLs, providing a strong foundation for automated monitoring of transmission corridors and digital power engineering. [ABSTRACT FROM AUTHOR]

This paper presents a novel framework to recover detailed avatar from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, texture, and viewpoints. Prior methods typically attempt to recover the human body shape using a parametric-based template that lacks the surface details. As such resulting body shape appears to be without clothing. In this paper, we propose a novel learning-based framework that combines the robustness of the parametric model with the flexibility of free-form 3D deformation. We use the deep neural networks to refine the 3D shape in a Hierarchical Mesh Deformation (HMD) framework, utilizing the constraints from body joints, silhouettes, and per-pixel shading information. Our method can restore detailed human body shapes with complete textures beyond skinned models. Experiments demonstrate that our method has outperformed previous state-of-the-art approaches, achieving better accuracy in terms of both 2D IoU number and 3D metric distance. [ABSTRACT FROM AUTHOR]

The high sensitivity and picosecond time resolution of single-photon avalanche diodes (SPADs) can improve the operational range and imaging accuracy of underwater detection systems. When an underwater SPAD imaging system is used to detect targets, backward-scattering caused by particles in water often results in the poor quality of the reconstructed underwater image. Although methods such as simple pixel accumulation have been proven to be effective for time–photon histogram reconstruction, they perform unsatisfactorily in a highly scattering environment. Therefore, new reconstruction methods are necessary for underwater SPAD detection to obtain high-resolution images. In this paper, we propose an algorithm that reconstructs high-resolution depth profiles of underwater targets from a time–photon histogram by employing the K-nearest neighbor (KNN) to classify multiple targets and the background. The results contribute to the performance of pixel accumulation and depth estimation algorithms such as pixel cross-correlation and ManiPoP. We use public experimental data sets and underwater simulation data to verify the effectiveness of the proposed algorithm. The results of our algorithm show that the root mean square errors (RMSEs) of land targets and simulated underwater targets are reduced by 57.12% and 23.45%, respectively, achieving high-resolution single-photon depth profile reconstruction. [ABSTRACT FROM AUTHOR]

Copyright of Virtual Archaeology Review is the property of Virtual Archaeology Review and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

In the era of Industry 4.0, digital twin technology is revolutionizing traditional manufacturing paradigms. However, the adoption of this technology in modern manufacturing systems is fraught with challenges due to the scarcity of labeled data. Specifically, existing supervised machine learning algorithms, with their reliance on voluminous training data, find their applicability constrained in real-world production settings. This paper introduces an unsupervised 3D reconstruction approach tailored for industrial applications, aimed at bridging the data void in creating digital twin models. Our proposed model, by ingesting high-resolution 2D images, autonomously reconstructs precise 3D digital twin models without the need for manual annotations or prior knowledge. Through comparisons with multiple baseline models, we demonstrate the superiority of our method in terms of accuracy, speed, and generalization capabilities. This research not only offers an efficient approach to industrial 3D reconstruction but also paves the way for the widespread adoption of digital twin technology in manufacturing. [ABSTRACT FROM AUTHOR]

An artificial compound eye consists of multiple apertures that allow for a large field of view (FOV) while maintaining a small size. Each aperture captures a sub-image, and multiple sub-images are needed to reconstruct the full FOV. The reconstruction process is depth-related due to the parallax between adjacent apertures. This paper presents an all-in-focus 3D reconstruction method for a specific type of artificial compound eye called the electronic cluster eye (eCley). The proposed method uses edge matching to address the edge blur and large textureless areas existing in the sub-images. First, edges are extracted from each sub-image, and then a matching operator is applied to match the edges based on their shape context and intensity. This produces a sparse matching result that is then propagated to the whole image. Next, a depth consistency check and refinement method is performed to refine the depth of all sub-images. Finally, the sub-images and depth maps are merged to produce the final all-in-focus image and depth map. The experimental results and comparative analysis demonstrate the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Visual simultaneous localization and mapping (VSLAM) is a foundational technology that enables robots to achieve fully autonomous locomotion, exploration, inspection, and more within complex environments. Its applicability also extends significantly to agricultural settings. While numerous impressive VSLAM systems have emerged, a majority of them rely on static world assumptions. This reliance constrains their use in real dynamic scenarios and leads to increased instability when applied to agricultural contexts. To address the problem of detecting and eliminating slow dynamic objects in outdoor forest and tea garden agricultural scenarios, this paper presents a dynamic VSLAM innovation called MOLO-SLAM (mask ORB label optimization SLAM). MOLO-SLAM merges the ORBSLAM2 framework with the Mask-RCNN instance segmentation network, utilizing masks and bounding boxes to enhance the accuracy and cleanliness of 3D point clouds. Additionally, we used the BundleFusion reconstruction algorithm for 3D mesh model reconstruction. By comparing our algorithm with various dynamic VSLAM algorithms on the TUM and KITTI datasets, the results demonstrate significant improvements, with enhancements of up to 97.72%, 98.51%, and 28.07% relative to the original ORBSLAM2 on the three datasets. This showcases the outstanding advantages of our algorithm. [ABSTRACT FROM AUTHOR]

It is possible to construct cost-efficient three-dimensional (3D) or four-dimensional (4D) scanning systems using multiple affordable off-the-shelf RGB-D sensors to produce high-quality reconstructions of 3D objects. However, the quality of these systems' reconstructions is sensitive to a number of factors in reconstruction pipelines, such as multi-view calibration, depth estimation, 3D reconstruction, and color mapping accuracy, because the successive pipelines to reconstruct 3D meshes from multiple active stereo sensors are strongly correlated with each other. This paper categorizes the pipelines into sub-procedures and analyze various factors that can significantly affect reconstruction quality. Thus, this paper provides analytical and practical guidelines for high-quality 3D reconstructions with off-the-shelf sensors. For each sub-procedure, this paper shows comparisons and evaluations of several methods using data captured by 18 RGB-D sensors and provide analyses and discussions towards robust 3D reconstruction. Through various experiments, it has been demonstrated that significantly more accurate 3D scans can be obtained with the considerations along the pipelines. We believe our analyses, benchmarks, and guidelines will help anyone build their own studio and their further research for 3D reconstruction. [ABSTRACT FROM AUTHOR]

The image is a particularly valuable data carrier in medical forensic and forensic analyses. One of the analyses, as mentioned above, is to assess whether a graphically captured object is the same object examined in reality. This is a complicated process due to perspective foreshortening, making it difficult to determine the scale and proportion of objects in the frame, as well as the subsequent correct reading of their actual measurements. This paper presented a method for the 3D reconstruction of silhouettes of people recorded in a photo or video, with the aim of identifying these people through subsequent comparative studies. The authors presented an algorithm for dealing with graphic evidence, using the example of the analysis of spatial correlation of the silhouette of the perpetrator of the actual event (recorded via CCTV footage) with the silhouette of the suspect (scanned in 3D in custody). In this paper, the authors posed the thesis that the isometric (devoid of perspective foreshortening) display mode that 3D platforms offer, and the animation of the figure to the desired identical poses, provides the possibility of not only obtaining linear measurements of the person but also of orthophotographic visualization of body proportions, allowing their comparison with another silhouette, which is difficult to achieve in perspective view of the studied image. [ABSTRACT FROM AUTHOR]

In this paper, we introduce LagunAR, a mobile outdoor Augmented Reality (AR) application for providing heritage information and 3D visualization on a city scale. The LagunAR application was developed to provide historical information about the city of La Laguna in the XVI century, when it was the main city in the Canary Islands. The application provides a reconstructed 3D model of the city at that time that is shown on a mobile phone over-imposed on the actual city using geolocation. The geolocated position is used also for providing information of several points of interest in the city. The paper describes the design and implementation of the application and details the optimization techniques that have been used to manage the full information of the city using a mobile phone as a sensor and visualization tool. We explain the application usability study carried out using a heuristic test; in addition it is probed by users in a qualitative user test developed as preliminary research. Results show that it is possible to develop a real-time application that shows the user a city-scale 3D model and also manages the information of the points of interest. [ABSTRACT FROM AUTHOR]

Primary fractures significantly impacted the stability of surrounding rock in underground projects. Therefore, it is vital to find a solution for the problem of performing a non-destructive detection of rocks and extracting the internal three-dimensional (3D) data field of rocks for visualization analysis. To address this problem, this paper proposed a method of 3D reconstruction for complex cracks in deteriorated sandstone and developed a program based on MATLAB. This work carried out image recognition on the CT scan images of deteriorated sandstone, then implemented a surface reconstruction technique based on object cross-section information, a contour reconstruction technique based on object contour information, a point cloud reconstruction technique for extracting point cloud data of internal cracks in deteriorated sandstone, and a Graphical User Interface (GUI) control system that combines these three reconstruction techniques. The results showed that the 3D reconstruction techniques and the GUI control system proposed in this paper were capable of precisely marking the location of the cracks on a 3D coordinate system and accurately describing their shape with a vector. With only 10 CT scan images, the point cloud reconstruction technique constructed the digital core, and the digital core can quantitatively characterize the influence of primary fractures on the stability of surrounding rock. Additionally, the calculated results of the proposed method were very close to that of Avizo. This method realized the visualization and quantitative characterization of the internal structure of rocks and offered a model for analyzing the stress-fracture-seepage field change during excavation. [ABSTRACT FROM AUTHOR]

Eucalyptus plantation forests in southern China provide not only the economic value of producing timber, but also the ecological value service of absorbing carbon dioxide and releasing oxygen. Based on the theory of spatial colonial modeling, this paper proposes a new method for 3D reconstruction of tree terrestrial LiDAR point clouds for determining the aboveground carbon stock of eucalyptus monocotyledons, which consists of the main steps of tree branch and trunk separation, skeleton extraction and optimization, 3D reconstruction, and carbon stock calculation. The main trunk and branches of the tree point clouds are separated using a layer-by-layer judgment and clustering method, which avoids errors in judgment caused by sagging branches. By optimizing and adjusting the skeleton to remove small redundant branches, the near-parallel branches belonging to the same tree branch are fused. The missing parts of the skeleton point clouds were complemented using the cardinal curve interpolation algorithm, and finally a real 3D structural model was generated based on the complemented and smoothed tree skeleton expansion. The bidirectional Hausdoff distance, average Hausdoff distance, and F distance were used as evaluation indexes, which were reduced by 0.7453 m, 0.0028 m, and 0.0011 m, respectively, and the improved spatial colonization algorithm enhanced the accuracy of the reconstructed tree 3D structural model. To verify the accuracy of our method to determine the carbon stock and its related parameters, we cut down 41 eucalyptus trees and destructively sampled the measurement data as reference values. The R2 of the linear fit between the reconstructed single-tree aboveground carbon stock estimates and the reference values was 0.96 with a CV(RMSE) of 16.23%, the R2 of the linear fit between the trunk volume estimates and the reference values was 0.94 with a CV(RMSE) of 19.00%, and the R2 of the linear fit between the branch volume estimates and the reference values was 0.95 with a CV(RMSE) of 38.84%. In this paper, a new method for reconstructing eucalyptus carbon stocks based on TLS point clouds is proposed, which can provide decision support for forest management and administration, forest carbon sink trading, and emission reduction policy formulation. [ABSTRACT FROM AUTHOR]

3D reconstruction of general scenes remains an open challenge with current techniques often reliant on assumptions on the scene's surface reflectance, which restrict the range of objects that can be modelled. Helmholtz Stereopsis offers an appealing framework to make the modelling process agnostic to surface reflectance. However, previous formulations have been almost exclusively limited to 2.5D modelling. To address this gap, this paper introduces a family of reconstruction approaches that exploit Helmholtz reciprocity to produce complete 3D models of objects with arbitrary unknown reflectance. This includes an approach based on the fusion of (orthographic or perspective) view-dependent reconstructions, a volumetric approach optimising surface location within a voxel grid, and a mesh-based formulation optimising vertices positions of a given mesh topology. The contributed approaches are evaluated on synthetic and real datasets, including novel full 3D datasets publicly released with this paper, with experimental comparison against a wide range of competing methods. Results demonstrate the benefits of the different approaches and their abilities to achieve high quality full 3D reconstructions of complex objects. [ABSTRACT FROM AUTHOR]

Copyright of Coal Science & Technology (0253-2336) is the property of Coal Science & Technology and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

The aim of this paper is to analyze the deformation-failure degree and microstructure variations in coal under the cryogenic-freezing effect of liquid CO2. In this paper, X-ray CT scanning technology is adopted to measure the microscopic-morphological parameters of coal. Drawing support from the image processing and three-dimensional (3D) visualization functions of Avizo software, 3D spatial structure variation rules, as well as the deformation and permeability parameters, are quantitatively calculated. Under the effect of LCO2 cryogenic freezing, the macroscopic mechanical properties and deformation-failure degree of coal are thoroughly analyzed. The results show that fracture-scale parameters of treated coal are significantly increased, resulting in spatial structure parameters including the coal plug total volume (Vt), fracture network volume (V0), and proportion of fracture network (μ0) to increase by 17.11%, 56.57%, and 55.59%, respectively. A comparison analysis indicates that the coverage area of a single value function from the percolation theoretical model for treated coal plugs becomes larger, and its percolation curves are more intensive; the quantitative coal permeability coefficients are increased to more than 40% on average, which further proves that the permeability of coal by using LCO2 cryogenic freezing is significantly improved. Under the same uniaxial stress loading rate, the peak stress threshold value required by treated coal in the compaction and elastoplastic deformation stage is decreased. The corresponding output acoustic emission energy is apparently increased, owing to the increased brittleness of coal, and deformation failure of coal occurs more easily. Simultaneously, the fracture network and matrix surface of treated coal are more complex, and the corresponding fractal characteristic is obvious. It could be thus concluded that the coal plugs have deformation-failure changes under cryogenic freezing by using LCO2, increasing the proportion of coal microstructure and enhancing coal permeability. Therefore, the capability of gas migration through the coal microstructure becomes easier, which is favorable for coalbed methane recovery. [ABSTRACT FROM AUTHOR]

Currently, the three-dimensional detection of plant root structure is one of the core issues in studies on plant root phenotype. Manual measurement methods are not only cumbersome but also have poor reliability and damage the root. Among many solutions, X-ray computed tomography (X-ray CT) can help us observe the plant root structure in a three-dimensional and non-destructive form under the condition of underground soil in situ. Therefore, this paper proposes a high-throughput method and process for plant three-dimensional root phenotype and reconstruction based on X-ray CT technology. Firstly, this paper proposes a high-throughput transmission for the root phenotyping and utilizing the imaging technique to extract the root characteristics; then, the study adopts a moving cube algorithm to reconstruct the 3D (three-dimensional) root. Finally, this research simulates the proposed algorithm, and the simulation results show that the presented method in this paper works well. [ABSTRACT FROM AUTHOR]

The natural color of biological specimens plays a crucial role in body protection, signaling, physiological adaptations, etc. Full-color optical sectioning structured illumination microscopy (OS-SIM) color is a promising approach that can reconstruct biological specimens in three-dimension meanwhile maintaining their natural color. Full-color OS-SIM takes the advantages of rapid imaging speed, compatibility with fluorescence and non-fluorescence samples, compact configuration, and low cost. However, the commonly used HSV-RMS reconstruction algorithm for full-color OS-SIM faces two issues to be improved. One is the RMS (root-mean-square) OS reconstruction algorithm is prone to background noise, and the other is the reconstruction is bound in RGB and HSV color spaces, consuming more reconstructing time. In this paper, we propose a full-color Fourier-OS-SIM method that allows for the OS reconstruction using the high-frequency spectrum of the sample and thus is immune to the low-frequency background noise. The full-color Fourier-OS-SIM directly runs in the RGB color space, providing an easy way to restore the color information. Simulation and experiments with various samples (pollen grains and tiny animals) demonstrate that the full-color Fourier-OS-SIM method is superior to the HSV-RMS method regarding background noise suppression. Moreover, benefiting from the background noise suppression merit, the quantitative morphological height map analysis with the full-color Fourier-OS-SIM method is more accurate. The proposed full-color Fourier-OS-SIM method is expected to find broad applications in biological and industrial fields where the 3D morphology and the color information of objects both need to be recovered. [ABSTRACT FROM AUTHOR]

SLAM (Simultaneous Localization and Mapping), primarily relying on camera or LiDAR (Light Detection and Ranging) sensors, plays a crucial role in robotics for localization and environmental reconstruction. This paper assesses the performance of two leading methods, namely ORB-SLAM3 and SC-LeGO-LOAM, focusing on localization and mapping in both indoor and outdoor environments. The evaluation employs artificial and cost-effective datasets incorporating data from a 3D LiDAR and an RGB-D (color and depth) camera. A practical approach is introduced for calculating ground-truth trajectories and during benchmarking, reconstruction maps based on ground truth are established. To assess the performance, ATE and RPE are utilized to evaluate the accuracy of localization; standard deviation is employed to compare the stability during the localization process for different methods. While both algorithms exhibit satisfactory positioning accuracy, their performance is suboptimal in scenarios with inadequate textures. Furthermore, 3D reconstruction maps established by the two approaches are also provided for direct observation of their differences and the limitations encountered during map construction. Moreover, the research includes a comprehensive comparison of computational performance metrics, encompassing Central Processing Unit (CPU) utilization, memory usage, and an in-depth analysis. This evaluation revealed that Visual SLAM requires more CPU resources than LiDAR SLAM, primarily due to additional data storage requirements, emphasizing the impact of environmental factors on resource requirements. In conclusion, LiDAR SLAM is more suitable for the outdoors due to its comprehensive nature, while Visual SLAM excels indoors, compensating for sparse aspects in LiDAR SLAM. To facilitate further research, a technical guide was also provided for the researchers in related fields. [ABSTRACT FROM AUTHOR]

In coal-fired power plants, coal piles serve as the fundamental management units. Acquiring point clouds of coal piles facilitates the convenient measurement of daily coal consumption and combustion efficiency. When using servo motors to drive Light Detection and Ranging (LiDAR) scanning of large-scale coal piles, the motors are subject to rotational errors due to gravitational effects. As a result, the acquired point clouds often contain significant noise. To address this issue, we proposes a Rapid Point Cloud Stitching–Constrained Particle Filter (RPCS-CPF) method. By introducing random noise to simulate servo motor rotational errors, both local and global point clouds are sequentially subjected to RPCS-CPF operations, resulting in smooth and continuous coal pile point clouds. Moreover, this paper presents a coal pile boundary detection method based on gradient region growing clustering. Experimental results demonstrate that our proposed RPCS-CPF method can generate smooth and continuous coal pile point clouds, even in the presence of servo motor rotational errors. [ABSTRACT FROM AUTHOR]

In the realm of computer vision, the integration of advanced techniques into the pre-processing of RGB-D camera inputs poses a significant challenge, given the inherent complexities arising from diverse environmental conditions and varying object appearances. Therefore, this paper introduces FusionVision, an exhaustive pipeline adapted for the robust 3D segmentation of objects in RGB-D imagery. Traditional computer vision systems face limitations in simultaneously capturing precise object boundaries and achieving high-precision object detection on depth maps, as they are mainly proposed for RGB cameras. To address this challenge, FusionVision adopts an integrated approach by merging state-of-the-art object detection techniques, with advanced instance segmentation methods. The integration of these components enables a holistic (unified analysis of information obtained from both color RGB and depth D channels) interpretation of RGB-D data, facilitating the extraction of comprehensive and accurate object information in order to improve post-processes such as object 6D pose estimation, Simultanious Localization and Mapping (SLAM) operations, accurate 3D dataset extraction, etc. The proposed FusionVision pipeline employs YOLO for identifying objects within the RGB image domain. Subsequently, FastSAM, an innovative semantic segmentation model, is applied to delineate object boundaries, yielding refined segmentation masks. The synergy between these components and their integration into 3D scene understanding ensures a cohesive fusion of object detection and segmentation, enhancing overall precision in 3D object segmentation. [ABSTRACT FROM AUTHOR]