1. Deep Group-Wise Registration for Multi-Spectral Images From Fundus Images
- Author
-
Yanhui Ding, Wanzhen Jiao, Yanyun Jiang, Bojun Zhao, Tongtong Che, Yi Niu, Jinyu Cong, and Yuanjie Zheng
- Subjects
General Computer Science ,business.industry ,Computer science ,Internal limiting membrane ,Deep learning ,General Engineering ,deep learning ,Multi spectral ,Fundus (eye) ,mono/multi-modal images ,Field (computer science) ,Principal component analysis ,Saccade ,Image acquisition ,General Materials Science ,Computer vision ,Artificial intelligence ,lcsh:Electrical engineering. Electronics. Nuclear engineering ,Multi-spectral images ,business ,lcsh:TK1-9971 ,group-wise registration - Abstract
Multi-spectral imaging (MSI) is a novel non-invasive tool for visualizing the entire span of the eye, from the internal limiting membrane to the choroid. However, spatial misalignments can be frequently observed in sequential MSI images because the eye saccade movement is usually faster than the MSI image acquisition speed. Therefore, registering MSI images is necessary for computer-based analysis of retinal degeneration via MSI. In this paper, we propose an early deep learning framework for achieving an accurate registration of MSI images in a group-wise fashion. The framework contains three parts: a template construction based on principal component analysis, a deformation field calculation, and a spatial transformation. The framework is uniquely capable of resolving two key challenges, i.e., the “multi-modal” characteristics in MSI images for the acquisition with different spectra and the requirement of joint registration of the sequential images. Our experimental results demonstrate the superior performance of our framework compared to several representative state-of-the-art techniques in both speed and accuracy.
- Published
- 2019