Back to Search Start Over

Chinese word segmentation at Peking University

Authors :
Bai Xiaojing
Yu Shiwen
Duan Huiming
Chang Baobao
Source :
SIGHAN
Publication Year :
2003
Publisher :
Association for Computational Linguistics, 2003.

Abstract

Word segmentation is the first step in Chinese information processing, and the performance of the segmenter, therefore, has a direct and great influence on the processing steps that follow. Different segmenters will give different results when handling issues like word boundary. And we will present in this paper that there is no need for an absolute definition of word boundary for all segmenters, and that different results of segmentation shall be acceptable if they can help to reach a correct syntactic analysis in the end.

Details

Database :
OpenAIRE
Journal :
Proceedings of the second SIGHAN workshop on Chinese language processing
Accession number :
edsair.doi...........d9ce6f2b5c73afc0810a6b72ea7805fd
Full Text :
https://doi.org/10.3115/1119250.1119272