Search

This document provides supplementary information to Hardware-in-the-Loop Design of Hybrid Diffractive Optics for Achromatic Extended-Depth-of-Field Imaging.

Phase retrieval in optical imaging refers to the recovery of a complex signal from phaseless data acquired in the form of its diffraction patterns. These patterns are acquired through a system with a coherent light source that employs a diffractive optical element (DOE) to modulate the scene resulting in coded diffraction patterns at the sensor. Recently, the hybrid approach of model-driven network or deep unfolding has emerged as an effective alternative to conventional model-based and learning-based phase retrieval techniques because it allows for bounding the complexity of algorithms while also retaining their efficacy. Additionally, such hybrid approaches have shown promise in improving the design of DOEs that follow theoretical uniqueness conditions. There are opportunities to exploit novel experimental setups and resolve even more complex DOE phase retrieval applications. This paper presents an overview of algorithms and applications of deep unfolding for bootstrapped - regardless of near, middle, and far zones - phase retrieval., Comment: 13 pages, 11 figures, 1 table

The power-balanced hybrid optical imaging system is a special design of a diffractive computational camera, introduced in this paper, with image formation by a refractive lens and Multilevel Phase Mask (MPM). This system provides a long focal depth with low chromatic aberrations thanks to MPM and a high energy light concentration due to the refractive lens. We introduce the concept of optical power balance between the lens and MPM which controls the contribution of each element to modulate the incoming light. Additional unique features of our MPM design are the inclusion of quantization of the MPM's shape on the number of levels and the Fresnel order (thickness) using a smoothing function. To optimize optical power-balance as well as the MPM, we build a fully-differentiable image formation model for joint optimization of optical and imaging parameters for the proposed camera using Neural Network techniques. Additionally, we optimize a single Wiener-like optical transfer function (OTF) invariant to depth to reconstruct a sharp image. We numerically and experimentally compare the designed system with its counterparts, lensless and just-lens optical systems, for the visible wavelength interval (400-700)nm and the depth-of-field range (0.5-$\infty$m for numerical and 0.5-2m for experimental). The attained results demonstrate that the proposed system equipped with the optimal OTF overcomes its counterparts (even when they are used with optimized OTF) in terms of reconstruction quality for off-focus distances. The simulation results also reveal that optimizing the optical power-balance, Fresnel order, and the number of levels parameters are essential for system performance attaining an improvement of up to 5dB of PSNR using the optimized OTF compared with its counterpart lensless setup., 18 pages, 14 figures

We propose a novel approach and algorithm based on two preliminary tests of the optical system elements to enhance the super-resolved complex-valued imaging. The approach is developed for inverse phase imaging in a single-shot lensless optical setup. Imaging is based on wavefront modulation by a single binary phase mask. The preliminary tests compensate errors in the optical system and correct a carrying wavefront, reducing the gap between real-life experiments and computational modeling, which improve imaging significantly both qualitatively and quantitatively. These two tests are performed for observation of the laser beam and phase mask along, and might be considered as a preliminary system calibration. The corrected carrying wavefront is embedded into the proposed iterative Single-shot Super-Resolution Phase Retrieval (SSR-PR) algorithm. Improved initial diffraction pattern upsampling, and a combination of sparse and deep learning based filters achieves the super-resolved reconstructions. Simulations and physical experiments demonstrate the high-quality super-resolution phase imaging. In the simulations, we showed that the SSR-PR algorithm corrects the errors of the proposed optical system and reconstructs phase details 4x smaller than the sensor pixel size. In physical experiment 2um thick lines of USAF phase-target were resolved, which is almost 2x smaller than the sensor pixel size and corresponds to the smallest resolvable group of used test target. For phase bio-imaging, we provide Buccal Epithelial Cells reconstructed in computational super-resolution and the quality was of the same level as a digital holographic system with 40x magnification objective. Furthermore, the single-shot advantage provides the possibility to record dynamic scenes, where the framerate is limited only by the used camera. We provide amplitude-phase video clip of a moving alive single-celled eukaryote.

supplementary material

A novel phase retrieval algorithm for broadband hyperspectral phase imaging from noisy intensity observations is proposed. It utilizes advantages of the Fourier transform spectroscopy in the self-referencing optical setup and provides additional, beyond spectral intensity distribution, reconstruction of the investigated object's phase. The noise amplification Fellgett's disadvantage is relaxed by the application of a sparse wavefront noise filtering embedded in the proposed algorithm. The algorithm reliability is proved by simulation tests and by results of physical experiments for transparent objects. These tests demonstrate precise phase imaging and object depth (profile) reconstruction. publishedVersion

Design and optimization of lensless phase-retrieval optical system with phase modulation of free-space propagation wavefront is proposed for subpixel imaging to achieve super-resolution reconstruction. Contrary to the traditional super-resolution phase-retrieval, the method in this paper requires a single observation only and uses the advanced Super-Resolution Sparse Phase Amplitude Retrieval (SR-SPAR) iterative technique which contains optimized sparsity based filters and multi-scale filters. The successful object imaging relies on modulation of the object wavefront with a random phase-mask, which generates coded diffracted intensity pattern, allowing us to extract subpixel information. The system’s noise-robustness was investigated and verified. The super-resolution phase-imaging is demonstrated by simulations and physical experiments. The simulations included high quality reconstructions with super-resolution factor of 5, and acceptable at factor up to 9. By physical experiments 3 µm details were resolved, which are 2.3 times smaller than the resolution following from the Nyquist-Shannon sampling theorem. publishedVersion

A novel phase retrieval algorithm for broadband hyperspectral phase imaging from noisy intensity observations is proposed. It utilizes advantages of the Fourier Transform spectroscopy in the self-referencing optical setup and provides, additionally beyond spectral intensity distribution, reconstruction of the investigated object's phase. The noise amplification Fellgett's disadvantage is relaxed by the application of sparse wavefront noise filtering embedded in the proposed algorithm. The algorithm reliability is proved by simulation tests and results of physical experiments on transparent objects which demonstrate precise phase imaging and object depth (profile) reconstructions., Comment: 12 pages, 8 figures

In this paper, we have applied a recently developed complex-domain hyperspectral denoiser for the object recognition task, which is performed by the correlation analysis of investigated objects��� spectra with the fingerprint spectra from the same object. Extensive experiments carried out on noisy data from digital hyperspectral holography demonstrate a significant enhancement of the recognition accuracy of signals masked by noise, when the advanced noise suppression is applied., publishedVersion

Broadband hyperspectral digital holography and Fourier transform spectroscopy are important instruments in various science and application fields. In the digital hyperspectral holography and spectroscopy the variable of interest are obtained as inverse discrete cosine transforms of observed diffractive intensity patterns. In these notes, we provide a variety of algorithms for the inverse cosine transform with the proofs of perfect spectrum reconstruction, as well as we discuss and illustrate some nontrivial features of these algorithms., 20 pages, 9 figures

A variational approach to reconstruction of phase and amplitude of a complex-valued object from Poissonian intensity observations is developed. The observation model corresponds to the typical optical setups with a phase modulation of wavefronts. The transform domain sparsity is applied for the amplitude and phase modeling. It is demonstrated that this modeling results in the essential advantage of the developed algorithm for heavily noisy observations corresponding to a short exposure time in optical experiments. We consider also two simplified versions of this algorithm where the sparsity modeling of phase and amplitude is omitted. In the simulation study we compare the developed algorithms versus the Gerchberg-Saxton and truncation Wirtinger flow algorithms. The latter algorithm being the maximum likelihood based is the state-of-the-art for the phase retrieval from Poissonian observations. For noisy and very noisy observations the proposed algorithm demonstrates a valuable advantage., 16 pages, 19 figures

This paper introduces a two-and multi-level phase mask design for improved depth of focus. A novel technique is proposed incorporating cubic and generalized cubic wavefront coding (WFC). The obtained system is optical-electronic requiring computational deblurring post-processing, in order to obtain a sharp image from the observed blurred data. A midwave infrared (MWIR) system is simulated showing that this design will produce high quality images even for large amounts of defocus. It is furthermore shown that this technique can be used to design a flat, single optical element, systems where the phase mask performs both the function of focusing and phase modulation. It is demonstrated that in this lensless design the WFC coding components can be omitted and WFC effects are achieved as a result of the proposed algorithm for phase mask design which uses the quadratic phase of the thin refractive lens as the input signal., Comment: 15 pages, 12 Figures

Phase imaging and wavefront reconstruction from noisy observations of complex exponent is a topic of this paper. It is a highly non-linear problem because the exponent is a 2{\pi}-periodic function of phase. The reconstruction of phase and amplitude is difficult. Even with an additive Gaussian noise in observations distributions of noisy components in phase and amplitude are signal dependent and non-Gaussian. Additional difficulties follow from a prior unknown correlation of phase and amplitude in real life scenarios. In this paper, we propose a new class of non-iterative and iterative complex domain filters based on group-wise sparsity in complex domain. This sparsity is based on the techniques implemented in Block-Matching 3D filtering (BM3D) and 3D/4D High-Order Singular Decomposition (HOSVD) exploited for spectrum design, analysis and filtering. The introduced algorithms are a generalization of the ideas used in the CD-BM3D algorithms presented in our previous publications. The algorithms are implemented as a MATLAB Toolbox. The efficiency of the algorithms is demonstrated by simulation tests., Comment: Submitted to Signal Processing

Generally, wave field reconstructions obtained by phase-retrieval algorithms are noisy, blurred and corrupted by various artifacts such as irregular waves, spots, etc. These disturbances, arising due to many factors such as non-idealities of optical system (misalignment, focusing errors), dust on optical elements, reflections, vibration, are hard to be localized and specified. It is assumed that there is a generalized pupil function at the object plane which describes aberrations in the coherent imaging system manifested at the sensor plane. Here we propose a novel two steps phase-retrieval algorithm to compensate these distortions. We first estimate the cumulative disturbance, called background, using special calibration experiments. Then, we use this background for reconstruction of the object amplitude and phase. The second part of the algorithm is based on the maximum likelihood approach and, in this way, targeted on the optimal amplitude and phase reconstruction from noisy data. Numerical experiments demonstrate that the developed algorithm enables the compensation of various typical distortions of the optical track so sharp object imaging for a binary test-chart can be achieved., Comment: to be published in Applied Optics OCIS: 030.4280, 050.1960, 070.2025, 070.6120, 100.3010, 100.3190, 100.5070

Sparse modeling is one of the efficient techniques for imaging that allows recovering lost information. In this paper, we present a novel iterative phase-retrieval algorithm using a sparse representation of the object amplitude and phase. The algorithm is derived in terms of a constrained maximum likelihood, where the wave field reconstruction is performed using a number of noisy intensity-only observations with a zero-mean additive Gaussian noise. The developed algorithm enables the optimal solution for the object wave field reconstruction. Our goal is an improvement of the reconstruction quality with respect to the conventional algorithms. Sparse regularization results in advanced reconstruction accuracy, and numerical simulations demonstrate significant enhancement of imaging., Comment: Submitted to the 10th IMEKO Symposium LMPMI (Laser Metrology for Precision Measurement and Inspection in Industry) on May 31, 2011

Publication in the conference proceedings of EUSIPCO, Lausanne, Switzerland, 2008

Publication in the conference proceedings of EUSIPCO, Lausanne, Switzerland, 2008