1. Hybrid Parallel Stochastic Configuration Networks for Industrial Data Analytics
- Author
-
Li Depeng, Wang Xuesong, Song Zhu, Wei Dai, and Xinyu Zhou
- Subjects
Hyperparameter ,Computer science ,Process (engineering) ,business.industry ,Node (networking) ,Big data ,Soft sensor ,computer.software_genre ,Computer Science Applications ,Control and Systems Engineering ,Benchmark (computing) ,Data analysis ,Data mining ,Electrical and Electronic Engineering ,business ,computer ,Information Systems ,Block (data storage) - Abstract
As a class of randomized learner model, stochastic configuration networks (SCNs) have been successfully applied in a few data analytics tasks. Given the industrial big data modeling tasks, however, the original SCNs potentially lead to excessive training time. To this end, this paper extends SCNs to a hybrid parallel version, termed HPSCNs. In the hybrid parallel learning algorithm, two SCNs are synchronously constructed. The difference between the two of them is that one employs a point-incremental algorithm, and another one adopts a block-incremental algorithm. Moreover, a data parallel method is established based on a dynamic block strategy to accelerate the establishment of candidate node pool for each SCN. Additionally, this paper proposes an adaptive hyperparameter adjustment method, which allows the hyperparameters in the supervisory mechanism to be automatically adjusted along with the learning process. Comparative experiments are first conducted through four large-scale benchmark datasets, followed by the fully discussion on the algorithm parameters. Finally, a practical industrial application case is made, where a grinding particle size soft sensor is developed based on HPSCN, showing the effectiveness of the proposed algorithm.
- Published
- 2022