1. Evaluation of color descriptors for projector-camera systems
- Author
-
Michèle Gouiffès, Christian Jacquemin, Aleksandr Setkov, Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur (LIMSI), Université Paris Saclay (COmUE)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université - UFR d'Ingénierie (UFR 919), Sorbonne Université (SU)-Sorbonne Université (SU)-Université Paris-Saclay-Université Paris-Sud - Paris 11 (UP11), and Publications, Limsi
- Subjects
Matching (graph theory) ,Color vision ,Color normalization ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Equalization (audio) ,02 engineering and technology ,[INFO] Computer Science [cs] ,Feature descriptors ,Projection-based augmented reality ,Robustness (computer science) ,0202 electrical engineering, electronic engineering, information engineering ,Media Technology ,Color invariance ,[INFO]Computer Science [cs] ,Computer vision ,[INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC] ,Electrical and Electronic Engineering ,Projection (set theory) ,Mathematics ,Feature matching ,business.industry ,Spatial augmented reality ,020207 software engineering ,Geometry compensation ,Projector-camera systems ,Feature (computer vision) ,Computer Science::Computer Vision and Pattern Recognition ,Smart projection ,Signal Processing ,020201 artificial intelligence & image processing ,Augmented reality ,Computer Vision and Pattern Recognition ,Artificial intelligence ,[INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC] ,business - Abstract
We study and evaluate invariance properties of local descriptors.We introduce a new Local Histogram Equalization (LHE) descriptor.We show the robustness of LHE for various color and geometric distortions.LHE is recommended for feature matching in Camera-Projector systems. Spatial Augmented Reality applications generally use projector-camera systems to control the visual projection appearance by comparing the initial projected and the acquired images. To obtain an accurate geometric compensation, a non-intrusive feature-point matching approach can be exploited which must handle complex photometric distortions due to the spectral devices responses, complex illumination and the mixing of the projected image with the projection surface.This paper first discusses the invariance properties of existing color descriptors in that application for non-intrusive geometric compensation. Their performance is evaluated using the framework of Setkov et al. (2013) extended by adding the several new test cases: modeled synthetic projections, real-world projections under various illuminants on one and two planar surfaces. Our experimental results show two main conclusions: (1) classical color vision models are hardly suitable to model the distortions in a projector-camera system, and (2) the LHE-based descriptor (Local Histogram Equalization) is the most reliable to compensate real-projections.
- Published
- 2016