Back to Search
Start Over
SentiStory: A Multi-Layered Sentiment-Aware Generative Model for Visual Storytelling.
- Source :
- IEEE Transactions on Circuits & Systems for Video Technology; Nov2022, Vol. 32 Issue 11, p8051-8064, 14p
- Publication Year :
- 2022
-
Abstract
- The visual storytelling (VIST) task aims at generating reasonable, human-like and coherent stories with the image streams as input. Although many deep learning models have achieved promising results, most of them do not directly leverage the sentiment information of stories. In this paper, we propose a sentiment-aware generative model for VIST called SentiStory. The key of SentiStory is a multi-layered sentiment extraction module (MLSEM). For a given image stream, the higher layer gives coarse-grained but accurate sentiments, while the lower layer of the MLSEM extracts fine-grained but usually unreliable ones. The two layers are combined strategically to generate coherent and rich visual sentiment concepts for the VIST task. Results from both automatic and human evaluations demonstrate that with the help of the MLSEM, SentiStory achieves improvement in generating more coherent and human-like stories. [ABSTRACT FROM AUTHOR]
- Subjects :
- SENTIMENT analysis
STORYTELLING
DEEP learning
DIGITAL storytelling
TASK analysis
Subjects
Details
- Language :
- English
- ISSN :
- 10518215
- Volume :
- 32
- Issue :
- 11
- Database :
- Complementary Index
- Journal :
- IEEE Transactions on Circuits & Systems for Video Technology
- Publication Type :
- Academic Journal
- Accession number :
- 160691260
- Full Text :
- https://doi.org/10.1109/TCSVT.2022.3183648