1. Boosting Discrimination Information Based Document Clustering Using Consensus and Classification
- Author
-
Muhammad Rafique, Ahmad Muqeem Sheri, Moongu Jeon, Khurum Nazir Junejo, and Malik Tahir Hassan
- Subjects
Boosting (machine learning) ,Term Discrimination ,General Computer Science ,Computer science ,02 engineering and technology ,Machine learning ,computer.software_genre ,document clustering ,020204 information systems ,discrimination information ,Consensus clustering ,0202 electrical engineering, electronic engineering, information engineering ,General Materials Science ,Electrical and Electronic Engineering ,Cluster analysis ,business.industry ,General Engineering ,Document clustering ,knowledge reuse ,mining methods and algorithms ,evidence combination ,ComputingMethodologies_PATTERNRECOGNITION ,020201 artificial intelligence & image processing ,lcsh:Electrical engineering. Electronics. Nuclear engineering ,Information measure ,Artificial intelligence ,business ,lcsh:TK1-9971 ,computer - Abstract
Adequate choice of term discrimination information measure (DIM) stipulates guaranteed document clustering. Exercise for the right choice is empirical in nature, and characteristics of data in the documents help experts to speculate a viable solution. Thus, a consistent DIM for the clustering is a mere conjecture and demands intelligent selection of the information measure. In this work, we propose an automated consensus building measure based on a text classifier. Two distinct DIMs construct basic partitions of documents and form base clusters. The consensus building measure method uses the clusters information to find concordant documents and constitute a dataset to train the text classifier. The classifier predicts labels for discordant documents from earlier clustering stage and forms new clusters. The experimentation is performed with eight standard data sets to test efficacy of the proposed technique. The improvement observed by applying the proposed consensus clustering demonstrates its superiority over individual results. Relative Risk (RR) and Measurement of Discrimination Information (MDI) are the two discrimination information measures used for obtaining the base clustering solutions in our experiments.
- Published
- 2019
- Full Text
- View/download PDF