Search

The self-attention mechanism has been empirically shown its effectiveness in a wide range of computer vision applications. However, it is usually criticized for the expensive computation cost. Although some revised methods are proposed in the recent past, they are not maturely applicable to remote sensing scene (RSS) images. To address this problem, in this article, we propose a simple yet effective context acquisition module, named thrifty attention, which can capture the long-range dependence efficiently and effectively. Moreover, a recurrent version for thrifty attention, termed recurrent thrifty attention (RTA), is further proposed to take the long-range multihop communications in space–time for RSS images. RTA is a general global contextual information acquisition module that can be used in any hierarchy of deep convolutional neural networks. To demonstrate its superiority, we deploy it to the classical ResNet and establish our proposed RTA Network (RTANet). Extensive experiments are carried out on two levels of the RSS recognition tasks, i.e., the image-level RSS classification and the instance-level RSS object detection. Compared with the standard self-attention mechanism, RTA can reduce at most 0.43 M model parameters while increasing a slight of model floating-point operations per second (FLOPs). Furthermore, results on RSS classification and object detection further verify the accuracy superiority of RTANet. [ABSTRACT FROM AUTHOR]

Estimating individual tree diameters at breast height (DBH) from delineated crowns and tree heights on the basis of airborne light detection and ranging (LiDAR) data provides a good opportunity for large-scale forest inventory. Generally, ground-based measurements are more accurate, but LiDAR data and derived DBH values can be obtained over larger areas for a relatively smaller cost if a right procedure is developed. A nonlinear least squares (NLS) regression is not an appropriate approach to predict the aboveground biomass (AGB) of individual trees from the estimated DBH because both the response variable and the regressor are subject to measurement errors. In this study, a system of compatible individual tree DBH and AGB error-in-variable models was developed using error-in-variable regression techniques based on both airborne LiDAR and field-measured datasets of individual Picea crassifolia Kom. trees, collected in northwestern China. Two parameter estimation algorithms, i.e., the two-stage error-in-variable model (TSEM) and the nonlinear seemingly unrelated regression (NSUR), were proposed for estimating the parameters in the developed system of compatible individual tree DBH and AGB error-in-variable models. Moreover, two model structures were applied to estimate AGB for comparison purposes: NLS with AGB estimation depending on DBH (NLS&DD) and NLS with AGB estimation not depending on DBH (NLS&NDD). The results showed that both TSEM and NSUR led to almost the same parameter estimates for the developed system. Moreover, the developed system effectively accounted for the inherent correlation between DBH and AGB as well as for the effects of measurement errors in the DBH on the predictions of AGB, whereas NLS&DD and NLS&NDD did not. A leave-one-out cross-validation indicated that the prediction accuracy of the developed system of compatible individual tree DBH and AGB error-in-variable models with NSUR was the highest among those estimated by the four methods evaluated, but, statistically, the accuracy improvement was not significantly different from zero. The main reason might be that, except for the measurement errors, other source errors were ignored in the modeling. This study implies that, overall, the proposed method provides the potential to expand the estimations of both DBH and AGB from individual trees to stands by combining the error-in-variable modeling and LiDAR data and improve their estimation accuracies, but its application needs to be further validated by conducting a systematical uncertainty analysis of various source errors in a future study. [ABSTRACT FROM AUTHOR]

Distance Metric Learning for Large Margin Nearest Neighbor (LMNN), as a classic distance metric learning (DML) method, has attracted much attention among researchers. However, it, like most of the existing DML methods, cannot be guaranteed to achieve independent and shared feature subspaces from multiple sources or different feature subsets, such that much statistical feature information is ignored in model learning. In this paper, we propose a novel DML model, called Multi-view DML Based on Independent and Shared Feature Subspace (MVML-ISFS), which learns multiple distance metrics to unify the information from multiple views. The proposed method finds a distance metric for each view in an independent feature space to preserve its specific property as well as a sparse representation related to the distance metrics from distinct views in a shared feature space to remain their common properties. The objective problem of MVML-ISFS is formulated based on LMNN, thus encouraging a large margin for each view that makes the distance between each of the same class pairs of samples be smaller than that between each of the different class pairs of samples. The proposed model in MVML-ISFS involves multivariate variables, which are optimized by a gradient descent strategy. The experimental results show the effectiveness of our MVML-ISFS on remote sensing, face, forest fire, and UCI datasets. [ABSTRACT FROM AUTHOR]

Background: Fast and accurate forest aboveground biomass (AGB) estimation and mapping is the basic work of forest management and ecosystem dynamic investigation, which is of great significance to evaluate forest quality, resource assessment, and carbon cycle and management. The Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2), as one of the latest launched spaceborne light detection and ranging (LiDAR) sensors, can penetrate the forest canopy and has the potential to obtain accurate forest vertical structure parameters on a large scale. However, the along-track segments of canopy height provided by ICESat-2 cannot be used to obtain comprehensive AGB spatial distribution. To make up for the deficiency of spaceborne LiDAR, the Sentinel-2 images provided by google earth engine (GEE) were used as the medium to integrate with ICESat-2 for continuous AGB mapping in our study. Ensemble learning can summarize the advantages of estimation models and achieve better estimation results. A stacking algorithm consisting of four non-parametric base models which are the backpropagation (BP) neural network, k-nearest neighbor (kNN), support vector machine (SVM), and random forest (RF) was proposed for AGB modeling and estimating in Saihanba forest farm, northern China. Results: The results show that stacking achieved the best AGB estimation accuracy among the models, with an R2 of 0.71 and a root mean square error (RMSE) of 45.67 Mg/ha. The stacking resulted in the lowest estimation error with the decreases of RMSE by 22.6%, 27.7%, 23.4%, and 19.0% compared with those from the BP, kNN, SVM, and RF, respectively. Conclusion: Compared with using Sentinel-2 alone, the estimation errors of all models have been significantly reduced after adding the LiDAR variables of ICESat-2 in AGB estimation. The research demonstrated that ICESat-2 has the potential to improve the accuracy of AGB estimation and provides a reference for dynamic forest resources management and monitoring. [ABSTRACT FROM AUTHOR]

Since remote sensing images of post-fire vegetation are characterized by high resolution, multiple interferences, and high similarities between the background and the target area, it is difficult for existing methods to detect and segment the burned area in these images with sufficient speed and accuracy. In this article, we apply salient object detection (SOD) to burned area segmentation (BAS), the first time this has been done, and propose an efficient burned area segmentation network (BASNet) to improve the performance of unmanned aerial vehicle (UAV) high-resolution image segmentation. BASNet comprises positioning module and refinement module. The positioning module efficiently extracts high-level semantic features and general contextual information via global average pooling layer and convolutional block (CB) to determine the coarse location of the salient region. The refinement module adopts the CB attention module to effectively discriminate the spatial location of objects. In addition, to effectively combine edge information with spatial location information in the lower layer of the network and the high-level semantic information in the deeper layer, we design the residual fusion module to perform feature fusion by level to obtain the prediction results of the network. Extensive experiments on two UAV datasets collected from Chongli in China and Andong in South Korea, demonstrate that our proposed BASNet significantly outperforms the state-of-the-art SOD methods quantitatively and qualitatively. BASNet also achieves a promising prediction speed for processing high-resolution UAV images, thus providing wide-ranging applicability in post-disaster monitoring and management. [ABSTRACT FROM AUTHOR]

Due to better boundary adherence and low computational cost, the superpixel segmentation algorithm SLIC (simple linear iterative clustering) has been widely applied in vision-based applications. However, limit to unavoidable over-segmentation problem, one has to consider region-merging to reconstruct entire objects from the segmented superpixels (or called regions). The existing region-merging methods are generated from data clustering, and avoidably suffer from error-merging, slow convergence speed, or easily dropping in LOCAL optimal problems, especially for high-resolution RS (remote sensing) images. In this paper, instead of data clustering, we propose a fast GLOBAL method based on Set Maximum Coverage, termed as MaxCov-merging. Theoretically, the existence of the maximum coverage is proved by using Bayes optimal decision principle. To speed up MaxCov-merging, some heuristic strategies are also provided. Finally, extensive verification and comparison are carried on the public and our collected high-resolution images. Compared with the state-of-the-art methods, the comparison shows the superiority of our MaxCov in terms of the performance of globality, ease of use and fast region-merging speed. [ABSTRACT FROM AUTHOR]

Conventional ground survey data are very accurate, but expensive. Airborne lidar data can reduce the costs and effort required to conduct large-scale forest surveys. It is critical to improve biomass estimation and evaluate carbon stock when we use lidar data. Bayesian methods integrate prior information about unknown parameters, reduce the parameter estimation uncertainty, and improve model performance. This study focused on predicting the independent tree aboveground biomass (AGB) with a hierarchical Bayesian model using airborne LIDAR data and comparing the hierarchical Bayesian model with classical methods (nonlinear mixed effect model, NLME). Firstly, we chose the best diameter at breast height (DBH) model from several widely used models through a hierarchical Bayesian method. Secondly, we used the DBH predictions together with the tree height (LH) and canopy projection area (CPA) derived by airborne lidar as independent variables to develop the AGB model through a hierarchical Bayesian method with parameter priors from the NLME method. We then compared the hierarchical Bayesian method with the NLME method. The results showed that the two methods performed similarly when pooling the data, while for small sample sizes, the Bayesian method was much better than the classical method. The results of this study imply that the Bayesian method has the potential to improve the estimations of both DBH and AGB using LIDAR data, which reduces costs compared with conventional measurements. [ABSTRACT FROM AUTHOR]