Back to Search Start Over

Efficient Outlier Detection for High-Dimensional Data.

Authors :
Liu, Huawen
Li, Xuelong
Li, Jiuyong
Zhang, Shichao
Source :
IEEE Transactions on Systems, Man & Cybernetics. Systems. Dec2018, Vol. 48 Issue 12, p2451-2461. 11p.
Publication Year :
2018

Abstract

How to tackle high dimensionality of data effectively and efficiently is still a challenging issue in machine learning. Identifying anomalous objects from given data has a broad range of real-world applications. Although many classical outlier detection or ranking algorithms have been witnessed during the past years, the high-dimensional problem, as well as the size of neighborhood, in outlier detection have not yet attracted sufficient attention. The former may trigger the distance concentration problem that the distances of observations in high-dimensional space tend to be indiscernible, whereas the latter requires appropriate values for parameters, making models high complex and more sensitive. To partially circumvent these problems, especially the high dimensionality, we introduce a concept called local projection score (LPS) to represent deviation degree of an observation to its neighbors. The LPS is obtained from the neighborhood information by the technique of low-rank approximation. The observation with high LPS is a promising candidate of outlier in high probability. Based on this notion, we propose an efficient and effective outlier detection algorithm, which is also robust to the parameter ${k}$ of ${k}$ nearest neighbors. Extensive evaluation experiments conducted on twelve public real-world data sets with five popular outlier detection algorithms show that the performance of the proposed method is competitive and promising. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
21682216
Volume :
48
Issue :
12
Database :
Academic Search Index
Journal :
IEEE Transactions on Systems, Man & Cybernetics. Systems
Publication Type :
Academic Journal
Accession number :
133096139
Full Text :
https://doi.org/10.1109/TSMC.2017.2718220