Search

Your search keyword '"Zhang, Yakun"' showing total 903 results
Start Over Author "Zhang, Yakun"
903 results on '"Zhang, Yakun"'

1. Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization

Author

Wu, Linzhi, Zhang, Xingyu, Zhang, Yakun, Zheng, Changyan, Liu, Tiejun, Xie, Liang, Yan, Ye, and Yin, Erwei

Subjects
Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition, Computer Science - Multimedia
Abstract

Lip reading, the process of interpreting silent speech from visual lip movements, has gained rising attention for its wide range of realistic applications. Deep learning approaches greatly improve current lip reading systems. However, lip reading in cross-speaker scenarios where the speaker identity changes, poses a challenging problem due to inter-speaker variability. A well-trained lip reading system may perform poorly when handling a brand new speaker. To learn a speaker-robust lip reading model, a key insight is to reduce visual variations across speakers, avoiding the model overfitting to specific speakers. In this work, in view of both input visual clues and latent representations based on a hybrid CTC/attention architecture, we propose to exploit the lip landmark-guided fine-grained visual clues instead of frequently-used mouth-cropped images as input features, diminishing speaker-specific appearance characteristics. Furthermore, a max-min mutual information regularization approach is proposed to capture speaker-insensitive latent representations. Experimental evaluations on public lip reading datasets demonstrate the effectiveness of the proposed approach under the intra-speaker and inter-speaker conditions., Comment: To appear in LREC-COLING 2024

Published
2024

2. Explicit $K_2$ of some quotient rings of $\mathbb{Z}[G]$, $G$ an elementary abelian $p$-group

Author

Zhang, Yakun

Subjects
Mathematics - K-Theory and Homology, 16S34, 19C20, 19C99
Abstract

Let $G$ be an elementary abelian $p$-group. We calculate $K_2(\mathbb{Z}[G]/I)$ for certain ideals $I \subseteq \mathbb{Z}[G]$ of the finite $p$-power index through computations of Dennis-Stein symbols. As an application, for $p$ an odd prime, we give a complete description of the relative group $SK_1(\mathbb{Z}[G],p^k\mathbb{Z}[G])$ and obtain more precise lower bounds of the prank of $K_2(\mathbb{Z}[G])$ and $Wh_2(G)$., Comment: 11 pages

Published
2024

7. Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigation

Author

Cui, Yibo, Xie, Liang, Zhang, Yakun, Zhang, Meishan, Yan, Ye, and Yin, Erwei

Subjects
Computer Science - Computer Vision and Pattern Recognition
Abstract

Cross-modal alignment is one key challenge for Vision-and-Language Navigation (VLN). Most existing studies concentrate on mapping the global instruction or single sub-instruction to the corresponding trajectory. However, another critical problem of achieving fine-grained alignment at the entity level is seldom considered. To address this problem, we propose a novel Grounded Entity-Landmark Adaptive (GELA) pre-training paradigm for VLN tasks. To achieve the adaptive pre-training paradigm, we first introduce grounded entity-landmark human annotations into the Room-to-Room (R2R) dataset, named GEL-R2R. Additionally, we adopt three grounded entity-landmark adaptive pre-training objectives: 1) entity phrase prediction, 2) landmark bounding box prediction, and 3) entity-landmark semantic alignment, which explicitly supervise the learning of fine-grained cross-modal alignment between entity phrases and environment landmarks. Finally, we validate our model on two downstream benchmarks: VLN with descriptive instructions (R2R) and dialogue instructions (CVDN). The comprehensive experiments show that our GELA model achieves state-of-the-art results on both tasks, demonstrating its effectiveness and generalizability., Comment: ICCV 2023 Oral

Published
2023

29. Sandy Soils: Do We Know Enough?

Author

Zhang, Yakun, Huang, Jingyi, Hartemink, Alfred E., Hartemink, Alfred E, Series Editor, McBratney, Alex B., Series Editor, Hartemink, Alfred E., editor, and Huang, Jingyi, editor

Published
2023
Full Text
View/download PDF

32. Effect of Thermal and Mechanical Training in Twisted and Coiled Polymer Fiber (TCPF) Artificial Muscle for Improved Actuation Consistency

Author

Li, Bo, Zhang, Yakun, Zhang, Yu, Wang, Yanjie, Formin, Alexey, Chen, Guimin, Zhang, Yong, Chaari, Fakher, Series Editor, Gherardini, Francesco, Series Editor, Ivanov, Vitalii, Series Editor, Cavas-Martínez, Francisco, Editorial Board Member, di Mare, Francesca, Editorial Board Member, Haddar, Mohamed, Editorial Board Member, Kwon, Young W., Editorial Board Member, Trojanowska, Justyna, Editorial Board Member, Xu, Jinyang, Editorial Board Member, and Liu, Xinjun, editor

Published
2023
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results