1. DyGAT: Dynamic stroke classification of online handwritten documents and sketches.
- Author
-
Yang, Yu-Ting, Zhang, Yan-Ming, Yun, Xiao-Long, Yin, Fei, and Liu, Cheng-Lin
- Subjects
- *
GRAPH algorithms , *OFFICES , *CLASSIFICATION , *WRITING processes , *INFORMATION resources management - Abstract
• We propose a dynamic stroke classification approach, named DyGAT, for online handwritten documents and sketches. Different from previous methods, it can make real-time prediction during writers' writing process. • DyGAT is featured by a novel graph construction algorithm, which enables graph neural networks to better exploit the contextual information under the time constraint. • To evaluate the effectiveness and generality of DyGAT, we apply it to sketch semantic segmentation, document layout analysis, and diagram recognition. Extensive experiments have been conducted to analyze our method and demonstrate its superiority. Online handwriting is widely used in human-machine interface, education, office automation, and so on. Stroke classification for online handwritten documents and sketches aims to divide strokes into several semantic categories and is a necessary step for document recognition and understanding. Previous methods are essentially static in that they have to wait for the user to finish the whole sketch before making prediction. However, in practice, the more user-friendly way is to make real-time prediction as the user is writing. In this paper, we introduce Dynamic Graph ATtention network (DyGAT) to solve the dynamic stroke classification problem. The core of our method is to formalize a document/sketch into a multi-feature graph, in which nodes represent strokes, edges represent the relationships between strokes, and multiple nodes are applied to one stroke to control the information flow. The proposed method is general and is applicable to online handwritten data of many types. We conduct experiments on popular public datasets to perform sketch semantic segmentation, document layout analysis and diagram recognition, and experimental results show competitive performance. Particularly, the proposed method achieves stroke classification accuracies which are only slightly lower than those of static classification. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF