Back to Search Start Over

A Cross View Learning Approach for Skeleton-Based Action Recognition.

Authors :
Zheng, Hui
Zhang, Xinming
Source :
IEEE Transactions on Circuits & Systems for Video Technology. May2022, Vol. 32 Issue 5, p3061-3072. 12p.
Publication Year :
2022

Abstract

With the prevalence of accessible multi-modal sensors and the maturity of pose estimation algorithms, skeleton-based action recognition has gradually become the mainstream of human action recognition (HAR). The key issue is to mine the correlations and dependencies between different joints and bones. In this paper, we propose a cross view learning approach. First, the static and dynamic representations of skeletons, from two different views (joints and bones), are calculated and aggregated respectively. Then, the integrated representations of these two views are used as parallel inputs to the cross view learning model, which mainly includes two blocks, namely a multi-scale learning block and a multi-view fusion block. The former is used to excavate the intra-view’s discriminative and comprehensive features, and the latter is utilized to capture the complementary representations of the inter-view. Finally, the fused representations are input to the classifier for action recognition. It has been experimentally proven that our proposed approach outperforms several state-of-the-art baseline methods and achieves a very competitive performance. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10518215
Volume :
32
Issue :
5
Database :
Academic Search Index
Journal :
IEEE Transactions on Circuits & Systems for Video Technology
Publication Type :
Academic Journal
Accession number :
156718341
Full Text :
https://doi.org/10.1109/TCSVT.2021.3100128