Back to Search
Start Over
Detection of salient objects with focused attention based on spatial and temporal coherence
- Source :
- Chinese Science Bulletin. 56(10):1055-1062
- Publisher :
- Springer Nature
-
Abstract
- The understanding and analysis of video content are fundamentally important for numerous applications, including video summarization, retrieval, navigation, and editing. An important part of this process is to detect salient (which usually means important and interesting) objects in video segments. Unlike existing approaches, we propose a method that combines the saliency measurement with spatial and temporal coherence. The integration of spatial and temporal coherence is inspired by the focused attention in human vision. In the proposed method, the spatial coherence of low-level visual grouping cues (e.g. appearance and motion) helps per-frame object-background separation, while the temporal coherence of the object properties (e.g. shape and appearance) ensures consistent object localization over time, and thus the method is robust to unexpected environment changes and camera vibrations. Having developed an efficient optimization strategy based on coarse-to-fine multi-scale dynamic programming, we evaluate our method using a challenging dataset that is freely available together with this paper. We show the effectiveness and complementariness of the two types of coherence, and demonstrate that they can significantly improve the performance of salient object detection in videos.
- Subjects :
- Multidisciplinary
Computer science
business.industry
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
Salient object detection
Salient objects
Automatic summarization
Dynamic programming
Spatial coherence
Salient
Visual attention
Computer vision
Artificial intelligence
business
General
Coherence (physics)
Subjects
Details
- Language :
- English
- ISSN :
- 10016538
- Volume :
- 56
- Issue :
- 10
- Database :
- OpenAIRE
- Journal :
- Chinese Science Bulletin
- Accession number :
- edsair.doi.dedup.....1a04166b033f90be6f8ae2ea576d780c
- Full Text :
- https://doi.org/10.1007/s11434-010-4387-1