Search

The production of highly accurate land cover maps is one of the primary challenges in remote sensing, which depends on the spatial resolution of the input images. Sometimes, high-resolution imagery is not available or is too expensive to cover large areas or to perform multitemporal analysis. In this context, we propose a multi-task network to take advantage of the freely available Sentinel-2 imagery to produce a super-resolution image, with a scaling factor of 5, and the corresponding high-resolution land cover map. Our proposal, named SEG-ESRGAN, consists of two branches: the super-resolution branch, that produces Sentinel-2 multispectral images at 2 m resolution, and an encoder–decoder architecture for the semantic segmentation branch, that generates the enhanced land cover map. From the super-resolution branch, several skip connections are retrieved and concatenated with features from the different stages of the encoder part of the segmentation branch, promoting the flow of meaningful information to boost the accuracy in the segmentation task. Our model is trained with a multi-loss approach using a novel dataset to train and test the super-resolution stage, which is developed from Sentinel-2 and WorldView-2 image pairs. In addition, we generated a dataset with ground-truth labels for the segmentation task. To assess the super-resolution improvement, the PSNR, SSIM, ERGAS, and SAM metrics were considered, while to measure the classification performance, we used the IoU, confusion matrix and the F1-score. Experimental results demonstrate that the SEG-ESRGAN model outperforms different full segmentation and dual network models (U-Net, DeepLabV3+, HRNet and Dual_DeepLab), allowing the generation of high-resolution land cover maps in challenging scenarios using Sentinel-2 10 m bands. [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD) continuum is defined as a cascade of several neuropathological processes that can be measured using biomarkers, such as cerebrospinal fluid (CSF) levels of Aβ, p -tau, and t -tau. In parallel, brain anatomy can be characterized through imaging techniques, such as magnetic resonance imaging (MRI). In this work we relate both sets of measurements and seek associations between biomarkers and the brain structure that can be indicative of AD progression. The goal is to uncover underlying multivariate effects of AD pathology on regional brain morphological information. For this purpose, we used the projection to latent structures (PLS) method. Using PLS, we found a low dimensional latent space that best describes the covariance between both sets of measurements on the same subjects. Possible confounder effects (age and sex) on brain morphology are included in the model and regressed out using an orthogonal PLS model. We looked for statistically significant correlations between brain morphology and CSF biomarkers that explain part of the volumetric variance at each region-of-interest (ROI). Furthermore, we used a clustering technique to discover a small set of CSF-related patterns describing the AD continuum. We applied this technique to the study of subjects in the whole AD continuum, from the pre-clinical asymptomatic stages all the way through to the symptomatic groups. Subsequent analyses involved splitting the course of the disease into diagnostic categories: cognitively unimpaired subjects (CU), mild cognitively impaired subjects (MCI), and subjects with dementia (AD-dementia), where all symptoms were due to AD. [ABSTRACT FROM AUTHOR]

Empirical data is needed in order to extend our knowledge of traffic behavior. Video recordings are used to enrich typical data from loop detectors. In this context, data extraction from videos becomes a challenging task. Setting automatic video processing systems is costly, complex, and the accuracy achieved is usually not enough to improve traffic flow models. In contrast "visual" data extraction by watching the recordings requires extensive human intervention. A semiautomatic video processing methodology to count lane‐changing in freeways is proposed. The method allows counting lane changes faster than with the visual procedure without falling into the complexities and errors of full automation. The method is based on converting the video into a set of space–time still images, from where to visually count. This methodology has been tested at several freeway locations near Barcelona (Spain) with good results. A user‐friendly implementation of the method is available on http://bit.ly/2yUi08M. [ABSTRACT FROM AUTHOR]

The identification of healthy individuals harboring amyloid pathology represents one important challenge for secondary prevention clinical trials in Alzheimer's disease (AD). Consequently, noninvasive and cost-efficient techniques to detect preclinical AD constitute an unmet need of critical importance. In this manuscript, we apply machine learning to structural MRI (T1 and DTI) of 96 cognitively normal subjects to identify amyloid-positive ones. Models were trained on public ADNI data and validated on an independent local cohort. Used for subject classification in a simulated clinical trial setting, the proposed method is able to save 60% of unnecessary CSF/PET tests and to reduce 47% of the cost of recruitment. This recruitment strategy capitalizes on available MR scans to reduce the overall amount of invasive PET/CSF tests in prevention trials, demonstrating a potential value as a tool for preclinical AD screening. This protocol could foster the development of secondary prevention strategies for AD. [ABSTRACT FROM AUTHOR]

Sentinel-2 satellites have become one of the main resources for Earth observation images because they are free of charge, have a great spatial coverage and high temporal revisit. Sentinel-2 senses the same location providing different spatial resolutions as well as generating a multi-spectral image with 13 bands of 10, 20, and 60 m/pixel. In this work, we propose a single-image super-resolution model based on convolutional neural networks that enhances the low-resolution bands (20 m and 60 m) to reach the maximal resolution sensed (10 m) at the same time, whereas other approaches provide two independent models for each group of LR bands. Our proposed model, named Sen2-RDSR, is made up of Residual in Residual blocks that produce two final outputs at maximal resolution, one for 20 m/pixel bands and the other for 60 m/pixel bands. The training is done in two stages, first focusing on 20 m bands and then on the 60 m bands. Experimental results using six quality metrics (RMSE, SRE, SAM, PSNR, SSIM, ERGAS) show that our model has superior performance compared to other state-of-the-art approaches, and it is very effective and suitable as a preliminary step for land and coastal applications, as studies involving pixel-based classification for Land-Use-Land-Cover or the generation of vegetation indices. [ABSTRACT FROM AUTHOR]

There is a growing interest in the development of automated data processing workflows that provide reliable, high spatial resolution land cover maps. However, high-resolution remote sensing images are not always affordable. Taking into account the free availability of Sentinel-2 satellite data, in this work we propose a deep learning model to generate high-resolution segmentation maps from low-resolution inputs in a multi-task approach. Our proposal is a dual-network model with two branches: the Single Image Super-Resolution branch, that reconstructs a high-resolution version of the input image, and the Semantic Segmentation Super-Resolution branch, that predicts a high-resolution segmentation map with a scaling factor of 2. We performed several experiments to find the best architecture, training and testing on a subset of the S2GLC 2017 dataset. We based our model on the DeepLabV3+ architecture, enhancing the model and achieving an improvement of 5% on IoU and almost 10% on the recall score. Furthermore, our qualitative results demonstrate the effectiveness and usefulness of the proposed approach. [ABSTRACT FROM AUTHOR]

Sentinel-2 satellites provide multi-spectral optical remote sensing images with four bands at 10 m of spatial resolution. These images, due to the open data distribution policy, are becoming an important resource for several applications. However, for small scale studies, the spatial detail of these images might not be sufficient. On the other hand, WorldView commercial satellites offer multi-spectral images with a very high spatial resolution, typically less than 2 m, but their use can be impractical for large areas or multi-temporal analysis due to their high cost. To exploit the free availability of Sentinel imagery, it is worth considering deep learning techniques for single-image super-resolution tasks, allowing the spatial enhancement of low-resolution (LR) images by recovering high-frequency details to produce high-resolution (HR) super-resolved images. In this work, we implement and train a model based on the Enhanced Super-Resolution Generative Adversarial Network (ESRGAN) with pairs of WorldView-Sentinel images to generate a super-resolved multispectral Sentinel-2 output with a scaling factor of 5. Our model, named RS-ESRGAN, removes the upsampling layers of the network to make it feasible to train with co-registered remote sensing images. Results obtained outperform state-of-the-art models using standard metrics like PSNR, SSIM, ERGAS, SAM and CC. Moreover, qualitative visual analysis shows spatial improvements as well as the preservation of the spectral information, allowing the super-resolved Sentinel-2 imagery to be used in studies requiring very high spatial resolution. [ABSTRACT FROM AUTHOR]

Background: Neuroimaging-based brain-age delta has been shown to be a mediator linking cardiovascular risk factors to cognitive function. We aimed to assess the mediating role of brain-age delta in the association between modifiable risk factors of dementia and longitudinal cognitive decline in middle-aged and older individuals who are asymptomatic, stratified by Alzheimer's disease pathology. We also explored whether the mediation effect is specific to cognitive domain., Methods: In this cohort study, we included participants from the ALFA+ cohort aged between 45 years and 65 years who were cognitively unimpaired and who had available structural MRI, cerebrospinal fluid β-amyloid (Aβ)42 and Aβ40 measurements obtained within 1 year of each other, modifiable risk factors assessment, and cognitive evaluation over 3 years. Participants were recruited from the Barcelonaβeta Brain Research Center (Barcelona, Spain). Included individuals underwent a first assessment between Oct 25, 2016, and Jan 28, 2020, and a follow-up cognitive assessment 3·28 (SD 0·27) years later. We computed brain-age delta and composites of different cognitive function domains (preclinical Alzheimer's cognitive composite [PACC], attention, executive function, episodic memory, visual processing, and language). We used partial least squares path modelling to explore mediation effects in the associations between modifiable risk factors (including cardiovascular, mental health, mood, metabolic or endocrine history, and alcohol use) and changes in cognitive composites. To assess the role of Alzheimer's disease pathology, we computed separate models for Aβ-negative and Aβ-positive individuals., Findings: Of the 419 participants enrolled in ALFA+, 302 met our inclusion criteria, of which 108 participants were classified as Aβ-positive and 194 as Aβ-negative. In Aβ-positive individuals, brain-age delta partially mediated (percent mediation proportion 15·73% [95% CI 14·22-16·66]) the association between modifiable risk factors and decline in overall cognition (across cognitive domains). Brain-age delta fully mediated (mediation proportion 28·03% [26·25-29·21]) the effect of modifiable risk factors on the PACC, wherein increased values for risk factors correlated with an older brain-age delta, and, consequently, an older brain-age delta was linked to greater PACC decline. This effect appears to be primarily driven by memory decline. Mediation was not significant in Aβ-negative individuals (3·52% [0·072-4·17]) on PACC, although path coefficients were not significantly different from those in the Aβ-positive group., Interpretation: Our findings suggest that brain-age delta captures the association between modifiable risk factors and longitudinal cognitive decline in middle-aged and older people. In asymptomatic middle-aged and older individuals who are Aβ-positive, the pathology might be the strongest driver of cognitive decline, whereas the effect of risk factors is smaller. Our results highlight the potential of brain-age delta as an objective outcome measure for preventive lifestyle interventions targeting cognitive decline., Funding: La Caixa Foundation, the TriBEKa Imaging Platform, and the Universities and Research Secretariat of the Catalan Government., Translation: For the Spanish translation of the abstract see Supplementary Materials section., Competing Interests: Declaration of interests MS-C has served as a consultant and at advisory boards for Roche Diagnostics International and Grifols; has given lectures in symposia sponsored by Roche Diagnostics and Roche Farma; and was granted with a project funded by Roche Diagnostics International. JLM is currently a full-time employee of H Lundbeck and previously has served as a consultant for, served on advisory boards for, or has given lectures in symposia sponsored by Roche Diagnostics, Genentech, Novartis, Lundbeck, Oryzon, Biogen, Lilly, Janssen, Green Valley, Merck & Co, Eisai, Alector, BioCross, GE Healthcare, and ProMIS Neurosciences. JDG receives research funding from Roche Diagnostics and GE Healthcare and has given lectures in symposia sponsored by Biogen and Philips. GS-B has served as a consultant for Roche Farma. OG-R receives research funding from F Hoffmann-La Roche and has given lectures in symposia sponsored by Roche Diagnostics. All other authors declare no competing interests., (Copyright © 2024 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY-NC-ND 4.0 license. Published by Elsevier Ltd.. All rights reserved.)

The present dataset comprises a collection of RGB-D apple tree images that can be used to train and test computer vision-based fruit detection and sizing methods. This dataset encompasses two distinct sets of data obtained from a Fuji and an Elstar apple orchards. The Fuji apple orchard sub-set consists of 3925 RGB-D images containing a total of 15,335 apples annotated with both modal and amodal apple segmentation masks. Modal masks denote the visible portions of the apples, whereas amodal masks encompass both visible and occluded apple regions. Notably, this dataset is the first public resource to incorporate on-tree fruit amodal masks. This pioneering inclusion addresses a critical gap in existing datasets, enabling the development of robust automatic fruit sizing methods and accurate fruit visibility estimation, particularly in the presence of partial occlusions. Besides the fruit segmentation masks, the dataset also includes the fruit size (calliper) ground truth for each annotated apple. The second sub-set comprises 2731 RGB-D images capturing five Elstar apple trees at four distinct growth stages. This sub-set includes mean diameter information for each tree at every growth stage and serves as a valuable resource for evaluating fruit sizing methods trained with the first sub-set. The present data was employed in the research paper titled "Looking behind occlusions: a study on amodal segmentation for robust on-tree apple fruit size estimation" [1]., (© 2024 The Authors. Published by Elsevier Inc.)

Brain-age can be inferred from structural neuroimaging and compared to chronological age (brain-age delta) as a marker of biological brain aging. Accelerated aging has been found in neurodegenerative disorders like Alzheimer's disease (AD), but its validation against markers of neurodegeneration and AD is lacking. Here, imaging-derived measures from the UK Biobank dataset (N=22,661) were used to predict brain-age in 2,314 cognitively unimpaired (CU) individuals at higher risk of AD and mild cognitive impaired (MCI) patients from four independent cohorts with available biomarker data: ALFA+, ADNI, EPAD, and OASIS. Brain-age delta was associated with abnormal amyloid-β, more advanced stages (AT) of AD pathology and APOE -ε4 status. Brain-age delta was positively associated with plasma neurofilament light, a marker of neurodegeneration, and sex differences in the brain effects of this marker were found. These results validate brain-age delta as a non-invasive marker of biological brain aging in non-demented individuals with abnormal levels of biomarkers of AD and axonal injury., Competing Interests: IC, MG, GO, CF, MS, RC, MM, LL, SI, AM, HM, CM, KF, SH, GC, AW, FB, HZ, KB, VV, JG No competing interests declared, JM is currently a full-time employee of H. Lundbeck A/S and previously has served as a consultant or on advisory boards for the following for-profit companies or has given lectures in symposia sponsored by the following for-profit companies: Roche Diagnostics, Genentech, Novartis, Lundbeck, Oryzon, Biogen, Lilly, Janssen, Green Valley, MSD, Eisai, Alector, BioCross, GE Healthcare, and ProMIS Neurosciences, AS Employee of Takeda Pharmaceutical Company Ltd, IS Is a full-time employee and shareholder of Roche Diagnostics International Ltd, GK Is a full-time employee of Roche Diagnostics GmbH, AB Is a full-time employee and shareholder of Roche Diagnostics GmbH, MS Has served as a consultant and at advisory boards for Roche Diagnostics International Ltd and has given lectures in symposia sponsored by Roche Diagnostics, S.L.U, Roche Farma, S.A and Roche Sistemas de Diagnósticos, Sociedade Unipessoal, Lda, (© 2023, Cumplido-Mayoral et al.)

NeAT is a modular, flexible and user-friendly neuroimaging analysis toolbox for modeling linear and nonlinear effects overcoming the limitations of the standard neuroimaging methods which are solely based on linear models. NeAT provides a wide range of statistical and machine learning non-linear methods for model estimation, several metrics based on curve fitting and complexity for model inference and a graphical user interface (GUI) for visualization of results. We illustrate its usefulness on two study cases where non-linear effects have been previously established. Firstly, we study the nonlinear effects of Alzheimer's disease on brain morphology (volume and cortical thickness). Secondly, we analyze the effect of the apolipoprotein APOE-ε4 genotype on brain aging and its interaction with age. NeAT is fully documented and publicly distributed at https://imatge-upc.github.io/neat-tool/ .