Search

With the launch of Landsat-9 on 27 September 2021, Landsat continues its fifty-year continuity mission of providing users with calibrated Earth observations. It has become a requirement that an underflight experiment be performed during commissioning to support sensor cross-calibration. In this most recent experiment, Landsat-9 flew under Landsat-8 for nearly three days with over 50% ground overlap, from 13 to 15 November 2021. To address the scarcity of reference data that are available to support calibration and validation early-on in the mission, a ground campaign was planned and executed by the Rochester Institute of Technology (RIT) on 14 November 2021 to provide full spectrum measurements for early mission comparisons. The primary experiment was conducted in the Outer Banks, North Carolina at Jockey's Ridge Sand Dunes. Full-spectrum ground-based measurements were acquired with calibrated reference equipment, while a novel Unmanned Aircraft System (UAS)-based platforms acquired hyperspectral visible and near-infrared (VNIR)/Short-wave infrared (SWIR) imagery data and coincident broadband cooled thermal infrared (TIR) imagery. Results of satellite/UAS/ground comparisons were an indicator, during the commissioning phase, that Landsat-9 is behaving consistently with Landsat-8, ground reference, and UAS measurements. In the thermal infrared, all measurements agree to be within 1 K over water and to within 2 K over sand, which represents the most challenging material for estimating surface temperature. For the surface reflectance product(s), Landsat-8 and -9 are in good agreement and only deviate slightly from ground reference in the SWIR bands; a deviation of 2% in the VNIR and 5–8% in the SWIR regime. Subsequent longer-term studies indicate that Landsat 9 continues to perform as expected. The behavior of Thermal Infrared Sensor-2 (TIRS-2) against reference is also shown for the first year of the mission to illustrate its consistent performance. [ABSTRACT FROM AUTHOR]

With the launch of Landsat-9 on 27 September 2021, Landsat continues its fifty-year continuity mission of providing users with calibrated Earth observations. It has become a requirement that an underflight experiment be performed during commissioning to support sensor cross-calibration. In this most recent experiment, Landsat-9 flew under Landsat-8 for nearly three days with over 50% ground overlap, from 13 to 15 November 2021. To address the scarcity of reference data that are available to support calibration and validation early-on in the mission, a ground campaign was planned and executed by the Rochester Institute of Technology (RIT) on 14 November 2021 to provide full spectrum measurements for early mission comparisons. The primary experiment was conducted in the Outer Banks, North Carolina at Jockey’s Ridge Sand Dunes. Full-spectrum ground-based measurements were acquired with calibrated reference equipment, while a novel Unmanned Aircraft System (UAS)-based platforms acquired hyperspectral visible and near-infrared (VNIR)/Short-wave infrared (SWIR) imagery data and coincident broadband cooled thermal infrared (TIR) imagery. Results of satellite/UAS/ground comparisons were an indicator, during the commissioning phase, that Landsat-9 is behaving consistently with Landsat-8, ground reference, and UAS measurements. In the thermal infrared, all measurements agree to be within 1 K over water and to within 2 K over sand, which represents the most challenging material for estimating surface temperature. For the surface reflectance product(s), Landsat-8 and -9 are in good agreement and only deviate slightly from ground reference in the SWIR bands; a deviation of 2% in the VNIR and 5–8% in the SWIR regime. Subsequent longer-term studies indicate that Landsat 9 continues to perform as expected. The behavior of Thermal Infrared Sensor-2 (TIRS-2) against reference is also shown for the first year of the mission to illustrate its consistent performance.

Pests and diseases affect the yield and quality of grapes directly and engender noteworthy economic losses. Diagnosing “lesions” on vines as soon as possible and dynamically monitoring symptoms caused by pests and diseases at a larger scale are essential to pest control. This study has appraised the capabilities of high-resolution unmanned aerial vehicle (UAV) data as an alternative to manual field sampling to obtain sampling canopy sets and to supplement satellite-based monitoring using machine learning models including partial least squared regression (PLSR), support vector regression (SVR), random forest regression (RFR), and extreme learning regression (ELR) with a new activation function. UAV data were acquired from two flights in Turpan to determine disease severity (DS) and disease incidence (DI) and compared with field visual assessments. The UAV-derived canopy structure including canopy height (CH) and vegetation fraction cover (VFC), as well as satellite-based spectral features calculated from Sentinel-2A/B data were analyzed to evaluate the potential of UAV data to replace manual sampling data and predict DI. It was found that SVR slightly outperformed the other methods with a root mean square error (RMSE) of 1.89%. Moreover, the combination of canopy structure (CS) and vegetation index (VIs) improved prediction accuracy compared with single-type features (RMSEcs of 2.86% and RMSEVIs of 1.93%). This study tested the ability of UAV sampling to replace manual sampling on a large scale and introduced opportunities and challenges of fusing different features to monitor vineyards using machine learning. Within this framework, disease incidence can be estimated efficiently and accurately for larger area monitoring operation.

Unmanned Aircraft Systems (UASs) have been recognized as an important resource in search-and-rescue (SAR) missions and, as such, have been used by the Croatian Mountain Search and Rescue (CMRS) service for over seven years. The UAS scans and photographs the terrain. The high-resolution images are afterwards analyzed by SAR members to detect missing persons or to find some usable trace. It is a drawn out, tiresome process prone to human error. To facilitate and speed up mission image processing and increase detection accuracy, we have developed several image-processing algorithms. The latest are convolutional neural network (CNN)-based. CNNs were trained on a specially developed image database, named HERIDAL. Although these algorithms achieve excellent recall, the efficiency of the algorithm in actual SAR missions and its comparison with expert detection must be investigated. A series of mission simulations are planned and recorded for this purpose. They are processed and labelled by a developed algorithm. A web application was developed by which experts analyzed raw and processed mission images. The algorithm achieved better recall compared to an expert, but the experts achieved better accuracy when they analyzed images that were already processed and labelled.

The deep convolutional neural network (DCNN) has recently been applied to the highly challenging and ill-posed problem of single image super-resolution (SISR), which aims to predict high-resolution (HR) images from their corresponding low-resolution (LR) images. In many remote sensing (RS) applications, spatial resolution of the aerial or satellite imagery has a great impact on the accuracy and reliability of information extracted from the images. In this study, the potential of a DCNN-based SISR model, called enhanced super-resolution generative adversarial network (ESRGAN), to predict the spatial information degraded or lost in a hyper-spatial resolution unmanned aircraft system (UAS) RGB image set is investigated. ESRGAN model is trained over a limited number of original HR (50 out of 450 total images) and virtually-generated LR UAS images by downsampling the original HR images using a bicubic kernel with a factor × 4 . Quantitative and qualitative assessments of super-resolved images using standard image quality measures (IQMs) confirm that the DCNN-based SISR approach can be successfully applied on LR UAS imagery for spatial resolution enhancement. The performance of DCNN-based SISR approach for the UAS image set closely approximates performances reported on standard SISR image sets with mean peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) index values of around 28 dB and 0.85 dB, respectively. Furthermore, by exploiting the rigorous Structure-from-Motion (SfM) photogrammetry procedure, an accurate task-based IQM for evaluating the quality of the super-resolved images is carried out. Results verify that the interior and exterior imaging geometry, which are extremely important for extracting highly accurate spatial information from UAS imagery in photogrammetric applications, can be accurately retrieved from a super-resolved image set. The number of corresponding keypoints and dense points generated from the SfM photogrammetry process are about 6 and 17 times more than those extracted from the corresponding LR image set, respectively.

The use of unmanned aerial systems (UAS) over the past years has exploded due to their agility and ability to image an area with high-end products. UAS are a low-cost method for close remote sensing, giving scientists high-resolution data with limited deployment time, accessing even the most inaccessible areas. This study aims to produce marine habitat mapping by comparing the results produced from true-color RGB (tc-RGB) and multispectral high-resolution orthomosaics derived from UAS geodata using object-based image analysis (OBIA). The aerial data was acquired using two different types of sensors—one true-color RGB and one multispectral—both attached to a UAS, capturing images simultaneously. Additionally, divers’ underwater images and echo sounder measurements were collected as in situ data. The produced orthomosaics were processed using three scenarios by applying different classifiers for the marine habitat classification. In the first and second scenario, the k-nearest neighbor (k-NN) and fuzzy rules were applied as classifiers, respectively. In the third scenario, fuzzy rules were applied in the echo sounder data to create samples for the classification process, and then the k-NN algorithm was used as the classifier. The in situ data collected were used as reference and training data. Additionally, these data were used for the calculation of the overall accuracy of the OBIA process in all scenarios. The classification results of the three scenarios were compared. Using tc-RGB instead of multispectral data provides better accuracy in detecting and classifying marine habitats when applying the k-NN as the classifier. In this case, the overall accuracy was 79%, and the Kappa index of agreement (KIA) was equal to 0.71, which illustrates the effectiveness of the proposed approach. The results showed that sub-decimeter resolution UAS data revealed the sub-bottom complexity to a large extent in relatively shallow areas as they provide accurate information that permits the habitat mapping in extreme detail. The produced habitat datasets are ideal as reference data for studying complex coastal environments using satellite imagery.

Unmanned Aircraft Systems (UAS) have evolved rapidly over the past decade driven primarily by military uses, and have begun finding application among civilian users for earth sensing reconnaissance and scientific data collection purposes. Among UAS, promising characteristics are long flight duration, improved mission safety, flight repeatability due to improving autopilots, and reduced operational costs when compared to manned aircraft. The potential advantages of an unmanned platform, however, depend on many factors, such as aircraft, sensor types, mission objectives, and the current UAS regulatory requirements for operations of the particular platform. The regulations concerning UAS operation are still in the early development stages and currently present significant barriers to entry for scientific users. In this article we describe a variety of platforms, as well as sensor capabilities, and identify advantages of each as relevant to the demands of users in the scientific research sector. We also briefly discuss the current state of regulations affecting UAS operations, with the purpose of informing the scientific community about this developing technology whose potential for revolutionizing natural science observations is similar to those transformations that GIS and GPS brought to the community two decades ago.

Aquatic vegetation has important ecological and regulatory functions and should be monitored in order to detect ecosystem changes. Field data collection is often costly and time-consuming; remote sensing with unmanned aircraft systems (UASs) provides aerial images with sub-decimetre resolution and offers a potential data source for vegetation mapping. In a manual mapping approach, UAS true-colour images with 5-cm-resolution pixels allowed for the identification of non-submerged aquatic vegetation at the species level. However, manual mapping is labour-intensive, and while automated classification methods are available, they have rarely been evaluated for aquatic vegetation, particularly at the scale of individual vegetation stands. We evaluated classification accuracy and time-efficiency for mapping non-submerged aquatic vegetation at three levels of detail at five test sites (100 m x 100 m) differing in vegetation complexity. We used object-based image analysis and tested two classification methods (threshold classification and Random Forest) using eCognition®. The automated classification results were compared to results from manual mapping. Using threshold classification, overall accuracy at the five test sites ranged from 93% to 99% for the water-versus-vegetation level and from 62% to 90% for the growth-form level. Using Random Forest classification, overall accuracy ranged from 56% to 94% for the growth-form level and from 52% to 75% for the dominant-taxon level. Overall classification accuracy decreased with increasing vegetation complexity. In test sites with more complex vegetation, automated classification was more time-efficient than manual mapping. This study demonstrated that automated classification of non-submerged aquatic vegetation from true-colour UAS images was feasible, indicating good potential for operative mapping of aquatic vegetation. When choosing the preferred mapping method (manual versus automated) the desired level of thematic detail and the required accuracy for the mapping task needs to be considered. [ABSTRACT FROM AUTHOR]

Monitoring of aquatic vegetation is an important component in the assessment of freshwater ecosystems. Remote sensing with unmanned aircraft systems (UASs) can provide sub-decimetre-resolution aerial images and is a useful tool for detailed vegetation mapping. In a previous study, non-submerged aquatic vegetation was successfully mapped using automated classification of spectral and textural features from a true-colour UAS-orthoimage with 5-cm pixels. In the present study, height data from a digital surface model (DSM) created from overlapping UAS-images has been incorporated together with the spectral and textural features from the UAS-orthoimage to test if classification accuracy can be improved further. We studied two levels of thematic detail: (a) Growth forms including the classes of water, nymphaeid, and helophyte; and (b) dominant taxa including seven vegetation classes. We hypothesized that the incorporation of height data together with spectral and textural features would increase classification accuracy as compared to using spectral and textural features alone, at both levels of thematic detail. We tested our hypothesis at five test sites (100 m × 100 m each) with varying vegetation complexity and image quality using automated object-based image analysis in combination with Random Forest classification. Overall accuracy at each of the five test sites ranged from 78% to 87% at the growth-form level and from 66% to 85% at the dominant-taxon level. In comparison to using spectral and textural features alone, the inclusion of height data increased the overall accuracy significantly by 4%–21% for growth-forms and 3%–30% for dominant taxa. The biggest improvement gained by adding height data was observed at the test site with the most complex vegetation. Height data derived from UAS-images has a large potential to efficiently increase the accuracy of automated classification of non-submerged aquatic vegetation, indicating good possibilities for operative mapping.

Aquatic vegetation has important ecological and regulatory functions and should be monitored in order to detect ecosystem changes. Field data collection is often costly and time-consuming; remote sensing with unmanned aircraft systems (UASs) provides aerial images with sub-decimetre resolution and offers a potential data source for vegetation mapping. In a manual mapping approach, UAS true-colour images with 5-cm-resolution pixels allowed for the identification of non-submerged aquatic vegetation at the species level. However, manual mapping is labour-intensive, and while automated classification methods are available, they have rarely been evaluated for aquatic vegetation, particularly at the scale of individual vegetation stands. We evaluated classification accuracy and time-efficiency for mapping non-submerged aquatic vegetation at three levels of detail at five test sites (100 m × 100 m) differing in vegetation complexity. We used object-based image analysis and tested two classification methods (threshold classification and Random Forest) using eCognition®. The automated classification results were compared to results from manual mapping. Using threshold classification, overall accuracy at the five test sites ranged from 93% to 99% for the water-versus-vegetation level and from 62% to 90% for the growth-form level. Using Random Forest classification, overall accuracy ranged from 56% to 94% for the growth-form level and from 52% to 75% for the dominant-taxon level. Overall classification accuracy decreased with increasing vegetation complexity. In test sites with more complex vegetation, automated classification was more time-efficient than manual mapping. This study demonstrated that automated classification of non-submerged aquatic vegetation from true-colour UAS images was feasible, indicating good potential for operative mapping of aquatic vegetation. When choosing the preferred mapping method (manual versus automated) the desired level of thematic detail and the required accuracy for the mapping task needs to be considered.

Pests and diseases affect the yield and quality of grapes directly and engender noteworthy economic losses. Diagnosing "lesions" on vines as soon as possible and dynamically monitoring symptoms caused by pests and diseases at a larger scale are essential to pest control. This study has appraised the capabilities of high-resolution unmanned aerial vehicle (UAV) data as an alternative to manual field sampling to obtain sampling canopy sets and to supplement satellite-based monitoring using machine learning models including partial least squared regression (PLSR), support vector regression (SVR), random forest regression (RFR), and extreme learning regression (ELR) with a new activation function. UAV data were acquired from two flights in Turpan to determine disease severity (DS) and disease incidence (DI) and compared with field visual assessments. The UAV-derived canopy structure including canopy height (CH) and vegetation fraction cover (VFC), as well as satellite-based spectral features calculated from Sentinel-2A/B data were analyzed to evaluate the potential of UAV data to replace manual sampling data and predict DI. It was found that SVR slightly outperformed the other methods with a root mean square error (RMSE) of 1.89%. Moreover, the combination of canopy structure (CS) and vegetation index (VIs) improved prediction accuracy compared with single-type features (RMSEcs of 2.86% and RMSEVIs of 1.93%). This study tested the ability of UAV sampling to replace manual sampling on a large scale and introduced opportunities and challenges of fusing different features to monitor vineyards using machine learning. Within this framework, disease incidence can be estimated efficiently and accurately for larger area monitoring operation. [ABSTRACT FROM AUTHOR]

Unmanned Aircraft Systems (UASs) have been recognized as an important resource in search-and-rescue (SAR) missions and, as such, have been used by the Croatian Mountain Search and Rescue (CMRS) service for over seven years. The UAS scans and photographs the terrain. The high-resolution images are afterwards analyzed by SAR members to detect missing persons or to find some usable trace. It is a drawn out, tiresome process prone to human error. To facilitate and speed up mission image processing and increase detection accuracy, we have developed several image-processing algorithms. The latest are convolutional neural network (CNN)-based. CNNs were trained on a specially developed image database, named HERIDAL. Although these algorithms achieve excellent recall, the efficiency of the algorithm in actual SAR missions and its comparison with expert detection must be investigated. A series of mission simulations are planned and recorded for this purpose. They are processed and labelled by a developed algorithm. A web application was developed by which experts analyzed raw and processed mission images. The algorithm achieved better recall compared to an expert, but the experts achieved better accuracy when they analyzed images that were already processed and labelled. [ABSTRACT FROM AUTHOR]

The deep convolutional neural network (DCNN) has recently been applied to the highly challenging and ill-posed problem of single image super-resolution (SISR), which aims to predict high-resolution (HR) images from their corresponding low-resolution (LR) images. In many remote sensing (RS) applications, spatial resolution of the aerial or satellite imagery has a great impact on the accuracy and reliability of information extracted from the images. In this study, the potential of a DCNN-based SISR model, called enhanced super-resolution generative adversarial network (ESRGAN), to predict the spatial information degraded or lost in a hyper-spatial resolution unmanned aircraft system (UAS) RGB image set is investigated. ESRGAN model is trained over a limited number of original HR (50 out of 450 total images) and virtually-generated LR UAS images by downsampling the original HR images using a bicubic kernel with a factor × 4 . Quantitative and qualitative assessments of super-resolved images using standard image quality measures (IQMs) confirm that the DCNN-based SISR approach can be successfully applied on LR UAS imagery for spatial resolution enhancement. The performance of DCNN-based SISR approach for the UAS image set closely approximates performances reported on standard SISR image sets with mean peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) index values of around 28 dB and 0.85 dB, respectively. Furthermore, by exploiting the rigorous Structure-from-Motion (SfM) photogrammetry procedure, an accurate task-based IQM for evaluating the quality of the super-resolved images is carried out. Results verify that the interior and exterior imaging geometry, which are extremely important for extracting highly accurate spatial information from UAS imagery in photogrammetric applications, can be accurately retrieved from a super-resolved image set. The number of corresponding keypoints and dense points generated from the SfM photogrammetry process are about 6 and 17 times more than those extracted from the corresponding LR image set, respectively. [ABSTRACT FROM AUTHOR]

The use of unmanned aerial systems (UAS) over the past years has exploded due to their agility and ability to image an area with high-end products. UAS are a low-cost method for close remote sensing, giving scientists high-resolution data with limited deployment time, accessing even the most inaccessible areas. This study aims to produce marine habitat mapping by comparing the results produced from true-color RGB (tc-RGB) and multispectral high-resolution orthomosaics derived from UAS geodata using object-based image analysis (OBIA). The aerial data was acquired using two different types of sensors—one true-color RGB and one multispectral—both attached to a UAS, capturing images simultaneously. Additionally, divers' underwater images and echo sounder measurements were collected as in situ data. The produced orthomosaics were processed using three scenarios by applying different classifiers for the marine habitat classification. In the first and second scenario, the k-nearest neighbor (k-NN) and fuzzy rules were applied as classifiers, respectively. In the third scenario, fuzzy rules were applied in the echo sounder data to create samples for the classification process, and then the k-NN algorithm was used as the classifier. The in situ data collected were used as reference and training data. Additionally, these data were used for the calculation of the overall accuracy of the OBIA process in all scenarios. The classification results of the three scenarios were compared. Using tc-RGB instead of multispectral data provides better accuracy in detecting and classifying marine habitats when applying the k-NN as the classifier. In this case, the overall accuracy was 79%, and the Kappa index of agreement (KIA) was equal to 0.71, which illustrates the effectiveness of the proposed approach. The results showed that sub-decimeter resolution UAS data revealed the sub-bottom complexity to a large extent in relatively shallow areas as they provide accurate information that permits the habitat mapping in extreme detail. The produced habitat datasets are ideal as reference data for studying complex coastal environments using satellite imagery. [ABSTRACT FROM AUTHOR]