1. Correlation-Based Weight Adjusted Naive Bayes
- Author
-
Meizhang He, Liangjun Yu, Shengfeng Gan, and Yu Chen
- Subjects
General Computer Science ,Computer science ,02 engineering and technology ,01 natural sciences ,Correlation ,attribute weighting ,Naive Bayes classifier ,Naive Bayes ,0103 physical sciences ,General Materials Science ,Time complexity ,010302 applied physics ,business.industry ,General Engineering ,Pattern recognition ,Filter (signal processing) ,021001 nanoscience & nanotechnology ,Weighting ,Conditional independence ,classification ,weight adjustment ,Artificial intelligence ,lcsh:Electrical engineering. Electronics. Nuclear engineering ,0210 nano-technology ,business ,lcsh:TK1-9971 - Abstract
Naive Bayes (NB) is an extremely simple and remarkably effective approach to classification learning, but its conditional independence assumption rarely holds true in real-world applications. Attribute weighting is known as a flexible model via assigning each attribute a different weight discriminatively to improve NB. Attribute weighting approaches can fall into two broad categories: filters and wrappers. Wrappers receive a bigger boost in terms of classification accuracy compared with filters, but the time complexity of wrappers is much higher than filters. In order to improve the time complexity of a wrapper, a filter can be used to optimize the initial weight of all attributes as a preprocessing step. So a hybrid attribute weighting approach is proposed in this paper, and the improved model is called correlation-based weight adjusted naive Bayes (CWANB). In CWANB, the correlation-based attribute weighting filter is used to initialize the attribute weights, and then each weight is optimized by the attribute weight adjustment wrapper where the objective function is designed based on dynamic adjustment of attribute weights. Extensive experimental results show that CWANB outperforms NB and some other existing state-of-the-art attribute weighting approaches in terms of the classification accuracy. Meanwhile, compared with the existing wrapper, the CWANB approach reduces the time complexity dramatically.
- Published
- 2020