Back to Search Start Over

Exploiting negative correlation for unsupervised anomaly detection in contaminated time series.

Authors :
Lin, Xiaohui
Li, Zuoyong
Fan, Haoyi
Fu, Yanggeng
Chen, Xinwei
Source :
Expert Systems with Applications. Sep2024:Part A, Vol. 249, pN.PAG-N.PAG. 1p.
Publication Year :
2024

Abstract

Anomaly detection in time series data is crucial for many fields such as healthcare, meteorology, and industrial fault detection. However, traditional unsupervised time series anomaly detection methods suffer from biased anomaly measurement under contaminated training data. Most of existing methods employ hard strategies for contamination calibration by assigning pseudo-label to training data. These hard strategies rely on threshold selection and result in suboptimal performance. To address this problem, in this paper, we propose a novel unsupervised anomaly detection framework for contaminated time series (NegCo), which builds an effective soft contamination calibration strategy by exploiting the observed negative correlation between semantic representation and anomaly detection inherent within the autoencoder framework. We innovatively redefine anomaly detection in data contamination scenarios as an optimization problem rooted in this negative correlation. To model this negative correlation, we introduce a dual construct: morphological similarity captures semantic distinctions relevant to normality, while reconstruction consistency quantifies deviations indicative of anomalies. Firstly, the morphological similarity is effectively measured based on the representative normal samples generated from the center of the learned Gaussian distribution. Then, an anomaly measurement calibration loss function is designed based on negative correlation between morphological similarity and reconstruction consistency, to calibrate the biased anomaly measurement caused by contaminated samples. Extensive experiments on various time series datasets show that the proposed NegCo outperforms state-of-the-art baselines, achieving an improvement of 6.2% to 26.8% in A rea U nder the R eceiver O perating C haracteristics (AUROC) scores, particularly in scenarios with heavily contaminated training data. • Unsupervised time series anomaly detection under data contamination. • Calibrating the biased anomaly measurement by exploiting the negative correlation. • Normal samples from a learned Gaussian distribution to model negative correlation. • Single forward propagation enables anomaly detection using the trained autoencoder. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09574174
Volume :
249
Database :
Academic Search Index
Journal :
Expert Systems with Applications
Publication Type :
Academic Journal
Accession number :
176811269
Full Text :
https://doi.org/10.1016/j.eswa.2024.123535