1. Automatic Topic Detection with an Incremental Clustering Algorithm.
- Author
-
Zhang, Xiaoming and Li, Zhoujun
- Abstract
At present, most of the topic detection approaches are not accurate and efficient enough. In this paper, we proposed a new topic detection method (TPIC) based on an incremental clustering algorithm. It employs a self-refinement process of discriminative feature identification and a term reweighting algorithm to accurately cluster the given documents which discuss the same topic. To be efficient, the ˵aging″ nature of topics is used to precluster stories. To automatically detect the true number of topics, Bayesian Information Criterion (BIC) is used to estimate the true number of topics. Experimental results on Linguistic Data Consortium (LDC) datasets TDT4 show that the proposed method can improve both the efficiency and accuracy, compared to other methods. [ABSTRACT FROM AUTHOR]
- Published
- 2010
- Full Text
- View/download PDF