Back to Search Start Over

Editing by Viewing: Automatic Home Video Summarization by Viewing Behavior Analysis

Editing by Viewing: Automatic Home Video Summarization by Viewing Behavior Analysis

Authors :
Chia-Han Chang
Wen-Yan Chang
Wei-Jia Huang
Wei-Ting Peng
Yi-Ping Hung
Wei-Ta Chu
Chien-Nan Chou
Source :
IEEE Transactions on Multimedia. 13:539-550
Publication Year :
2011
Publisher :
Institute of Electrical and Electronics Engineers (IEEE), 2011.

Abstract

In this paper, we propose the Interest Meter (IM), a system making the computer conscious of user's reactions to measure user's interest and thus use it to conduct video summarization. The IM takes account of users' spontaneous reactions when they view videos. To estimate user's viewing interest, quantitative interest measures are devised based on the perspectives of attention and emotion. For estimating attention states, variations of user's eye movement, blink, and head motion are considered. For estimating emotion states, facial expression is recognized as positive or neural emotion. By combining characteristics of attention and emotion by a fuzzy fusion scheme, we transform users' viewing behaviors into quantitative interest scores, determine interesting parts of videos, and finally concatenate them as video summaries. Experimental results show that the proposed concept “editing by viewing” works well and may provide a promising direction to consider the human factor in video summarization.

Details

ISSN :
19410077 and 15209210
Volume :
13
Database :
OpenAIRE
Journal :
IEEE Transactions on Multimedia
Accession number :
edsair.doi...........1e131f44fb586d69d9eb2d4e21de9f48
Full Text :
https://doi.org/10.1109/tmm.2011.2131638