Back to Search Start Over

Dynamic memory network with spatial-temporal feature fusion for visual tracking.

Authors :
Zhang, Hongchao
Bao, Hua
Lu, Yixiang
Zhang, Dexiang
Xun, Lina
Source :
Journal of Electronic Imaging; Sep/Oct2022, Vol. 31 Issue 5, p53023-53023-26, 1p
Publication Year :
2022

Abstract

Recently, single object tracking has demonstrated great success. However, due to various problems caused by fast motion, occlusion, and deformation, it is still intractable for traditional trackers to adapt to changes in object appearance. In this work, a dynamic memory network is proposed for visual tracking to handle the template matching process globally. More specifically, we first build a memory model, which consists of a memory feature fusion module and a memory bank. By the memory model, the network not only accepts the first frame as initial information but also memorizes the selective frames in the video sequence to provide rich time-domain information. Second, an innovative sampling strategy is adopted in the tracking process. By updating the template and guiding the selection of memory frames, our model can output higher-quality features. In addition, a spatial-channel fused attention module that effectively improves the representational capability and discriminability of the model is introduced. Our proposed method obtains compelling results on six challenging tracking benchmarks, including the OTB100, VOT2019, UAV123, NFS, GOT-10k, and LaSOT datasets. Extensive experiments demonstrate that our approach shows satisfactory robustness and leading application potential in real-time speed. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10179909
Volume :
31
Issue :
5
Database :
Complementary Index
Journal :
Journal of Electronic Imaging
Publication Type :
Academic Journal
Accession number :
159958521
Full Text :
https://doi.org/10.1117/1.JEI.31.5.053023