Search

We present a 2D-stitched, 316MP, 120FPS, high dynamic range CMOS image sensor with 92 CML output ports operating at a cumulative date rate of 515 Gbit/s. The total die size is 9.92 cm × 8.31 cm and the chip is fabricated in a 65 nm, 4 metal BSI process with an overall power consumption of 23 W. A 4.3 µm dual-gain pixel has a high and low conversion gain full well of 6600e- and 41,000e-, respectively, with a total high gain temporal noise of 1.8e- achieving a composite dynamic range of 87 dB.

Mobile wireless communication heavily relies on the radio frequency to convey message and data. However, its limited spectrum can hardly meet the demands for the future high data rate applications. Optical wireless communication, in particular visible light communication, opens up vast optical spectrum for communication, and meanwhile can retrofit the light sources as the communication transmitters in the existing working or living environments. In conjunction with the ubiquitous cameras in hand-held consumer electronics such as smartphones and pads, optical camera communication (OCC) further takes advantages of image sensors as the communication receivers and realizes low-cost communication systems. This article first provides an overview of OCC systems. It then addresses some practical constraints, ranging from sensor low frame rate and instability, rolling shutter readout, to visual qualities of displayed images and videos, and link blockage between the transmitter and receiver. Accordingly, it introduces existing and new solutions to deal with those constraints by data modulation, newly developed camera structures, post-processing of sensed signals and non-line of sight OCC as a new form. In particular, indirect paths by either the indoor surface reflection or the outdoor atmospheric scattering are explored for link connectivity under blockage. Finally, some future research directions are suggested. This article is part of the theme issue 'Optical wireless communication'.

Optical camera communications (OCC) research field has grown recently, aided by ubiquitous digital cameras; however, atmospheric conditions can restrict their feasibility in outdoor scenarios. In this work, we studied an experimental OCC system under environmental phenomena emulated in a laboratory chamber. We found that the heat-induced turbulence does not affect our system significantly, while the attenuation caused by fog does decrease the signal quality. For this reason, a novel strategy is proposed, using the camera's built-in amplifier to overcome the optical power loss and to decrease the quantization noise induced by the analog-digital converter of the camera. The signal quality has been evaluated using the Pearson's correlation coefficient with respect to a reference template signal, along with the signal-to-noise ratio that has been empirically evaluated. The amplification mechanism introduced allows our system to receive the OCC signal under heavy fog by gradually increasing the camera gain up to 16 dB, for meteorological visibility values down to 10 m, with a correlation coefficient of 0.9 with respect to clear conditions.

A custom near infrared VCSEL source has been implemented in a confocal non-mydriatic retinal camera, the Digital Light Ophthalmoscope (DLO). The use of near infrared light improves patient comfort, avoids pupil constriction, penetrates the deeper retina, and does not mask visual stimuli. The DLO performs confocal imaging by synchronizing a sequence of lines displayed with a digital micromirror device to the rolling shutter exposure of a 2D CMOS camera. Real-time software adjustments enable multiply scattered light imaging, which rapidly and cost-effectively emphasizes drusen and other scattering disruptions in the deeper retina. A separate 5.1″ LCD display provides customizable visible stimuli for vision experiments with simultaneous near infrared imaging.

A digital light projector is implemented as an integrated illumination source and scanning element in a confocal non-mydriatic retinal camera, the Digital Light Ophthalmoscope (DLO). To simulate scanning, a series of illumination lines are rapidly projected on the retina. The backscattered light is imaged onto a 2-dimensional rolling shutter CMOS sensor. By temporally and spatially overlapping the illumination lines with the rolling shutter, confocal imaging is achieved. This approach enables a low cost, flexible, and robust design with a small footprint. The 3 rd generation DLO technical design is presented, using a DLP LightCrafter 4500 and USB3.0 CMOS sensor. Specific improvements over previous work include the use of yellow illumination, filtered from the broad green LED spectrum, to obtain strong blood absorption and high contrast images while reducing pupil constriction and patient discomfort.

A digital light projector is implemented as an integrated illumination source and scanning element in a confocal non-mydriatic retinal camera, the DLP-Cam. To simulate scanning, a series of illumination lines are rapidly projected on the retina. The backscattered light is imaged onto a 2-dimensional rolling shutter CMOS sensor. By temporally and spatially overlapping the illumination lines with the rolling shutter, confocal imaging is achieved. This approach enables a low cost, flexible, and robust design with a small footprint. Qualitative image comparison with commercial non-mydriatic SLOs and fundus cameras shows comparable fine vessel visibility and contrast.

A Pico digital light projector has been implemented as an integrated illumination source and spatial light modulator for confocal imaging. The target is illuminated with a series of rapidly projected lines or points to simulate scanning. Light returning from the target is imaged onto a 2D rolling shutter CMOS sensor. By controlling the spatio-temporal relationship between the rolling shutter and illumination pattern, light returning from the target is spatially filtered. Confocal retinal, fluorescence, and Fourier-domain optical coherence tomography implementations of this novel imaging technique are presented.