1. Learning Document Similarity Using Natural Language Processing
- Author
-
Paola Merlo, James Henderson, Gerold Schneider, and Eric Wehrli
- Subjects
Computational linguistics. Natural language processing ,P98-98.5 ,Language. Linguistic theory. Comparative grammar ,P101-410 - Abstract
The recent considerable growth in the amount of easily available on-line text has brought to the foreground the need for large-scale natural language processing tools for text data mining. In this paper we address the problem of organizing documents into meaningful groups according to their content and to visualize a text collection, providing an overview of the range of documents and of their relationships, so that they can be browsed more easily. We use Self-Organizing Maps (SOMs) (Kohonen 1984). Great efficiency challenges arise in creating these maps. We study linguistically-motivated ways of reducing the representation of a document to increase efficiency and ways to disambiguate the words in the documents.
- Published
- 2003
- Full Text
- View/download PDF