Back to Search Start Over

Rarity updated ensemble with oversampling: An ensemble approach to classification of imbalanced data streams.

Authors :
Nouri, Zahra
Kiani, Vahid
Fadishei, Hamid
Source :
Statistical Analysis & Data Mining. Feb2024, Vol. 17 Issue 1, p1-20. 20p.
Publication Year :
2024

Abstract

Today's ever‐increasing generation of streaming data demands novel data mining approaches tailored to mining dynamic data streams. Data streams are non‐static in nature, continuously generated, and endless. They often suffer from class imbalance and undergo temporal drift. To address the classification of consecutive data instances within imbalanced data streams, this research introduces a new ensemble classification algorithm called Rarity Updated Ensemble with Oversampling (RUEO). The RUEO approach is specifically designed to exhibit robustness against class imbalance by incorporating an imbalance‐specific criterion to assess the efficacy of the base classifiers and employing an oversampling technique to reduce the imbalance in the training data. The RUEO algorithm was evaluated on a set of 20 data streams and compared against 14 baseline algorithms. On average, the proposed RUEO algorithm achieves an average‐accuracy of 0.69 on the real‐world data streams, while the chunk‐based algorithms AWE, AUE, and KUE achieve average‐accuracies of 0.48, 0.65, and 0.66, respectively. The statistical analysis, conducted using the Wilcoxon test, reveals a statistically significant improvement in average‐accuracy for the proposed RUEO algorithm when compared to 12 out of the 14 baseline algorithms. The source code and experimental results of this research work will be publicly available at https://github.com/vkiani/RUEO. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
19321864
Volume :
17
Issue :
1
Database :
Academic Search Index
Journal :
Statistical Analysis & Data Mining
Publication Type :
Academic Journal
Accession number :
175721703
Full Text :
https://doi.org/10.1002/sam.11662