1. Deep Bayesian Slow Feature Extraction With Application to Industrial Inferential Modeling
- Author
-
Dayu Tan, Chao Jiang, Biao Huang, Weimin Zhong, Wenjiang Song, Yusheng Lu, and Feng Qian
- Subjects
Mean squared error ,Computer science ,business.industry ,Deep learning ,Monte Carlo method ,Bayesian probability ,Feature extraction ,Probabilistic logic ,Inference ,computer.software_genre ,Computer Science Applications ,Nonlinear system ,Control and Systems Engineering ,Artificial intelligence ,Data mining ,Electrical and Electronic Engineering ,business ,computer ,Information Systems - Abstract
Inferential modeling has been of significance for modern manufacturing in estimating the quality-related process variables. As an effective inferential model, probabilistic slow feature analysis (PSFA) has gained attention in regression tasks to interpret dynamic properties with a slowness preference. However, PSFA is often challenged by the nonlinear sequential data due to its linear state-space structure. In this study, a new nonlinear extension of PSFA is proposed under the deep learning framework to enhance the dynamic feature extraction with limited labels, incorporating variational inference and Monte Carlo inference to derive the objective function. The proposed model considers the relevance of inputs with outputs as the input weights to upgrade prediction performance. The proposed model is verified through an industrial hydrocracking process to predict diesel yield with missing labels ranged from 0% to 50%, and the root mean squared error is reduced by at least 8.78% compared to PSFA.
- Published
- 2023