1. Practical sensorless aberration estimation for 3D microscopy with deep learning
- Author
-
Martin J. Booth, Debayan Saha, Uwe Schmidt, Eugene W. Myers, Martin Weigert, Qi Hu, Aurélien Barbotin, Qinrong Zhang, and Na Ji
- Subjects
FOS: Computer and information sciences ,Computer science ,Image quality ,Computer Vision and Pattern Recognition (cs.CV) ,Computer Science - Computer Vision and Pattern Recognition ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,02 engineering and technology ,01 natural sciences ,Article ,010309 optics ,Optics ,0103 physical sciences ,Microscopy ,FOS: Electrical engineering, electronic engineering, information engineering ,Computer vision ,Adaptive optics ,Wavefront ,Ground truth ,business.industry ,Deep learning ,Image and Video Processing (eess.IV) ,Electrical Engineering and Systems Science - Image and Video Processing ,021001 nanoscience & nanotechnology ,Atomic and Molecular Physics, and Optics ,Artificial intelligence ,0210 nano-technology ,business ,Phase retrieval - Abstract
Estimation of optical aberrations from volumetric intensity images is a key step in sensorless adaptive optics for 3D microscopy. Recent approaches based on deep learning promise accurate results at fast processing speeds. However, collecting ground truth microscopy data for training the network is typically very difficult or even impossible thereby limiting this approach in practice. Here, we demonstrate that neural networks trained only on simulated data yield accurate predictions for real experimental images. We validate our approach on simulated and experimental datasets acquired with two different microscopy modalities and also compare the results to non-learned methods. Additionally, we study the predictability of individual aberrations with respect to their data requirements and find that the symmetry of the wavefront plays a crucial role. Finally, we make our implementation freely available as open source software in Python.
- Published
- 2020