1. A Batch Rival Penalized Expectation-Maximization Algorithm for Gaussian Mixture Clustering with Automatic Model Selection
- Author
-
Yiu-ming Cheung, Dan Zhang, Xinge You, Jiechang Wen, and Hai-Lin Liu
- Subjects
Article Subject ,Computer science ,Gaussian ,Normal Distribution ,lcsh:Computer applications to medicine. Medical informatics ,General Biochemistry, Genetics and Molecular Biology ,Synthetic data ,Normal distribution ,symbols.namesake ,Artificial Intelligence ,Image Interpretation, Computer-Assisted ,Expectation–maximization algorithm ,Convergence (routing) ,Cluster Analysis ,Cluster analysis ,Likelihood Functions ,General Immunology and Microbiology ,business.industry ,Applied Mathematics ,Model selection ,Pattern recognition ,General Medicine ,Weighted likelihood ,Modeling and Simulation ,symbols ,lcsh:R858-859.7 ,Artificial intelligence ,business ,Algorithms ,Research Article - Abstract
Within the learning framework of maximum weighted likelihood (MWL) proposed by Cheung, 2004 and 2005, this paper will develop a batch Rival Penalized Expectation-Maximization (RPEM) algorithm for density mixture clustering provided that all observations are available before the learning process. Compared to the adaptive RPEM algorithm in Cheung, 2004 and 2005, this batch RPEM need not assign the learning rate analogous to the Expectation-Maximization (EM) algorithm (Dempster et al., 1977), but still preserves the capability of automatic model selection. Further, the convergence speed of this batch RPEM is faster than the EM and the adaptive RPEM in general. The experiments show the superior performance of the proposed algorithm on the synthetic data and color image segmentation.
- Published
- 2012
- Full Text
- View/download PDF