Back to Search
Start Over
Editing by Viewing: Automatic Home Video Summarization by Viewing Behavior Analysis
Editing by Viewing: Automatic Home Video Summarization by Viewing Behavior Analysis
- Source :
- IEEE Transactions on Multimedia. 13:539-550
- Publication Year :
- 2011
- Publisher :
- Institute of Electrical and Electronics Engineers (IEEE), 2011.
-
Abstract
- In this paper, we propose the Interest Meter (IM), a system making the computer conscious of user's reactions to measure user's interest and thus use it to conduct video summarization. The IM takes account of users' spontaneous reactions when they view videos. To estimate user's viewing interest, quantitative interest measures are devised based on the perspectives of attention and emotion. For estimating attention states, variations of user's eye movement, blink, and head motion are considered. For estimating emotion states, facial expression is recognized as positive or neural emotion. By combining characteristics of attention and emotion by a fuzzy fusion scheme, we transform users' viewing behaviors into quantitative interest scores, determine interesting parts of videos, and finally concatenate them as video summaries. Experimental results show that the proposed concept “editing by viewing” works well and may provide a promising direction to consider the human factor in video summarization.
- Subjects :
- Facial expression
Computer science
business.industry
Eye movement
Sensor fusion
Facial recognition system
Automatic summarization
Motion (physics)
Computer Science Applications
Visualization
Human–computer interaction
Signal Processing
Media Technology
Computer vision
Artificial intelligence
Electrical and Electronic Engineering
business
Subjects
Details
- ISSN :
- 19410077 and 15209210
- Volume :
- 13
- Database :
- OpenAIRE
- Journal :
- IEEE Transactions on Multimedia
- Accession number :
- edsair.doi...........1e131f44fb586d69d9eb2d4e21de9f48
- Full Text :
- https://doi.org/10.1109/tmm.2011.2131638