Search

Multispectral imaging is valuable in many vision-related fields as it provides an additional modality to observe the world. Cameras equipped with multispectral filter arrays (MSFAs) are typically impractical for everyday use due to their intractable demosaicking and chromatic reproduction processes, which restrict their applicability beyond academic research. In this work, a novel MSFA design is proposed to enable dual-mode imaging for multispectral cameras. In addition to a conventional multispectral image, the camera is also able to produce a Bayer-formed RGB image from a single shot by grouping and merging adjacent pixels in the proposed MSFA, making it suitable for scenarios where display-ready RGB images are required. Furthermore, a two-stage optimization scheme is implemented to jointly optimize objective functions for both imaging modes. The evaluation results on multiple datasets suggest that the proposed MSFA design is able to simultaneously achieve competitive spectral reconstruction accuracy compared to elaborate multispectral cameras and chromatic accuracy compared to commercial RGB cameras. [ABSTRACT FROM AUTHOR]

The cutting-edge research in high-dynamic-range (HDR) display, such as inverse tone-mapping operators for HDR TV, HDR image quality (IQ) evaluation, and HDR image enhancement, suffer from a lack of reliable training and testing images. To address this problem, we combined the HDR imaging technique with high-accuracy spectral images to construct a first-of-its-kind HDR spectral radiance image. A framework was presented to capture multi-exposure hyperspectral images of HDR outdoor scenes and establish the HDR spectral image. By employing spectrophotometric calibration, the spectral radiance-based HDR images were created. The metadata of the spectral images provide crucial colorimetry information that was absent in the existing datasets. To validate the superiority of the proposed HDR spectral images in typical applications, the spectral sensitivity functions of a camera equipped with a multispectral-filter-array sensor was optimized, and the IQ evaluation results indicate a better adaptability over existing ones. Furthermore, the HDR image augmentation suggests that it is possible to provide a large number of RGB training images for various research objectives based on the proposed images. [ABSTRACT FROM AUTHOR]