1. Adaptive cost-sensitive learning: Improving the convergence of intelligent diagnosis models under imbalanced data.
- Author
-
Ren, Zhijun, Zhu, Yongsheng, Kang, Wei, Fu, Hong, Niu, Qingbo, Gao, Dawei, Yan, Ke, and Hong, Jun
- Subjects
- *
COST functions , *FAULT diagnosis , *DATA distribution - Abstract
The natural distribution of industrial data is imbalanced, which deteriorates the performance of intelligent fault diagnostic models. Although cost-sensitive learning is an effective method for solving the data imbalance problem, it suffers from the difficulty of setting optimal costs. Therefore, this paper proposes a strategy that considers the number distribution of samples, the convergence trend of classes, and the convergence trend of samples to calculate sample costs adaptively. Using costs to weigh the sample losses and applying them to different models and different loss functions, the diagnostic results under different sample sets show that the weighted losses can significantly improve the model's performance when using imbalanced data. By further analysing the training loss of the modified model, the angles between deep features, and the angles between deep features and classification weight vectors, it can be found that the dominance of majority classes in imbalanced data is suppressed in training, which is attributed to the loss of each class being coordinated by the proposed strategy. The comparison with various imbalanced learning methods demonstrates the advantages of the proposed method under conditions of large imbalance ratios and complex tasks. • A novel cost-adaptive calculation method is proposed. • The cost varies adaptively with the sample distribution, the sample convergence trend, and the category convergence trend. • By applying the sample cost to the loss function, the losses of each class are coordinated. • Results with different models, different loss functions, and different datasets show the flexibility of the proposed method. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF