Search

Your search keyword '"Cai, Chenghao"' showing total 1 results
Start Over Author "Cai, Chenghao" Topic computer science - sound
1 results on '"Cai, Chenghao"'

1. Explaining the Attention Mechanism of End-to-End Speech Recognition Using Decision Trees

Author

Wang, Yuanchao, Du, Wenji, Cai, Chenghao, and Xu, Yanyan

Subjects
Computer Science - Computation and Language, Computer Science - Machine Learning, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing
Abstract

The attention mechanism has largely improved the performance of end-to-end speech recognition systems. However, the underlying behaviours of attention is not yet clearer. In this study, we use decision trees to explain how the attention mechanism impact itself in speech recognition. The results indicate that attention levels are largely impacted by their previous states rather than the encoder and decoder patterns. Additionally, the default attention mechanism seems to put more weights on closer states, but behaves poorly on modelling long-term dependencies of attention states., Comment: 10 pages, 5 figures

Published
2021

Catalog

Books, media, physical & digital resources
See catalog results