Back to Search
Start Over
Cluster Purging: Efficient Outlier Detection based on Rate-Distortion Theory
- Source :
- IEEE Transactions on Knowledge and Data Engineering 35 (2023) 1270-1282
- Publication Year :
- 2023
-
Abstract
- Rate-distortion theory-based outlier detection builds upon the rationale that a good data compression will encode outliers with unique symbols. Based on this rationale, we propose Cluster Purging, which is an extension of clustering-based outlier detection. This extension allows one to assess the representivity of clusterings, and to find data that are best represented by individual unique clusters. We propose two efficient algorithms for performing Cluster Purging, one being parameter-free, while the other algorithm has a parameter that controls representivity estimations, allowing it to be tuned in supervised setups. In an experimental evaluation, we show that Cluster Purging improves upon outliers detected from raw clusterings, and that Cluster Purging competes strongly against state-of-the-art alternatives.
- Subjects :
- Computer Science - Machine Learning
Subjects
Details
- Database :
- arXiv
- Journal :
- IEEE Transactions on Knowledge and Data Engineering 35 (2023) 1270-1282
- Publication Type :
- Report
- Accession number :
- edsarx.2302.11234
- Document Type :
- Working Paper
- Full Text :
- https://doi.org/10.1109/TKDE.2021.3103571