Search

Object Detection and Tracking have provided a valuable tool for many tasks, mostly time-consuming and prone-to-error jobs, including fruit counting while in the field, among others. Fruit counting can be a challenging assignment for humans due to the large quantity of fruit available, which turns it into a mentally-taxing operation. Hence, it is relevant to use technology to ease the task of farmers by implementing Object Detection and Tracking algorithms to facilitate fruit counting. However, those algorithms suffer undercounting due to occlusion, which means that the fruit is hidden behind a leaf or a branch, complicating the detection task. Consequently, gathering the datasets from multiple viewing angles is essential to boost the likelihood of recording the images and videos from the most visible point of view. Furthermore, the most critical open-source datasets do not include labels for certain fruits, such as grape bunches. This study aims to unravel the scarcity of public datasets, including labels, to train algorithms for grape bunch Detection and Tracking by considering multiple angles acquired with a UAV to overcome fruit occlusion challenges.

The “EscaYard” dataset comprises multimodal data collected from vineyards to support agricultural research, specifically focusing on vine health and productivity. Data collection involved two primary methods: (1) unmanned aerial vehicle (UAV) for capturing multispectral images and 3D point clouds, and (2) smartphones for detailed ground-level photography. The UAV used was DJI Matrice 210 V2 RTK, equipped with a Micasense Altum sensor, flying at 30 m above ground level to ensure detailed coverage. Ground-level data were collected using smartphones (iPhone X and Xiaomi Poco X3 Pro), which provided high-resolution images of individual plants. These images were geotagged, enabling location mapping, and included data on the phytosanitary status and number of grape clusters per plant. Additionally, the dataset contains RTK GNSS data, offering high-precision location information for each vine, enhancing the dataset's value for spatial analysis. Moreover, the dataset is structured to support various research applications, including agronomy, remote sensing, and machine learning. It is particularly suited for studying disease detection, yield estimation, and vineyard management strategies. The high-resolution and multispectral nature of the data allows for a detailed analysis of vineyard conditions. Potential reuse of the dataset spans multiple disciplines, enabling studies on environmental monitoring, geographic information systems (GIS), and precision agriculture. Its comprehensive nature makes it a valuable resource for developing and testing algorithms for disease classification, yield prediction, and plant phenotyping. For instance, the images of bunches and grape leaves can be used to train object detection algorithms for accurate disease detection and consequent precise spraying. Moreover, yield prediction algorithms can be trained by extracting the phenotypic traits of the grape bunches. The “EscaYard” dataset provides a foundation for advancing research in sustainable farming practices, optimising crop health, and improving productivity through precise agricultural technologies.

LiDAR (Light Detection and Ranging) technology's precision in data collection has gained immense traction in the field of remote sensing, particularly in Precision Agriculture using Unmanned Aerial Vehicles (UAVs). To fulfill the pressing need for public UAV LiDAR datasets in the domain of Agricultural Sciences, especially for woody crops such as vineyards, this study presents an extensive dataset of LiDAR data collected from vineyards in northern Spain. The DJI M300 multi-rotor platform, equipped with a DJI Zenmuse L1 LiDAR sensor, conducted UAV flights at 20, 30, and 50 meters above ground level (AGL) across two vineyards during three development stages in 2021 and 2022. This dataset is composed of ten high-density 3D LiDAR point clouds stored in .laz format with embedded RGB information in each point. It provides insights into vineyard morphology and development, thereby aiding in the optimization of vineyard management strategies. Furthermore, it serves as a valuable tool for agricultural robotics, offering comprehensive terrain information for developing efficient flight paths and navigation algorithms. Finally, it serves as a reliable “ground truth” dataset to validate satellite-derived models, facilitating the creation of highly accurate digital elevation models (DEMs) and other derived models.

Counting the number of grape bunches at an early stage of development offers relevant information to the winegrower about the potential yield to be harvested. However, manual counting on the fields is laborious and time-consuming. Remote sensing, and more precisely unmanned aerial vehicles mounted with RGB or multispectral cameras, facilitate this task rapidly and accurately. This dataset contains 40 RGB videos from a 1.06-ha vineyard located in northern Spain. Moreover, the dataset includes mask labels of visible grape bunches. The videos were acquired throughout four UAV flights with an RGB camera tilted at 60 degrees. Each flight recorded one side of a row of the vineyard. The grape berries were between pea-size (BBCH75) and bunch closure (BBCH79) stage, which is two months before harvesting. No operations other than those usual in a commercial vineyard, such as pruning, cane tying, fertilization, and pest treatment, have been carried out, hence, the dataset presents leaf occlusion. The dataset was gathered and labelled to train object detection and tracking algorithms for grape bunch counting. Furthermore, it eases the work of winegrowers to check the sanitary status of the vineyard.

Remote sensing makes it possible to gather data rapidly, precisely, accurately, and non-destructively, allowing it to assess grapevines accurately in near real-time. In addition, multispectral cameras capture information in different bands, which can be combined to generate vegetation indices useful in precision agriculture. This dataset contains 16,504 multispectral images from a 1.06 ha vineyard affected by Botrytis cinerea, in the north of Spain. The photos were taken throughout four UAV flights at 30 m height with varying camera angles on 16 September 2021, the same date as the grape harvest. The first flight took place with the camera tilted at 0° (nadir angle), the second flight at 30°, the third flight at 45°, and the fourth flight was also performed at 0° but was scheduled in the afternoon to capture the shadows of the plants projected on the ground. This dataset was created to support researchers interested in disease detection and, in general, UAV remote sensing in vineyards and other woody crops. Moreover, it allows digital photogrammetry and 3D reconstruction in the context of precision agriculture, enabling the study of the effect of different tilt angles on the 3D reconstruction of the vineyard and the generation of orthomosaics.