Cluster-based data filtering for manufacturing big data systems

A manufacturing system collects big and heterogeneous data for tasks such as product quality modeling and data-driven decision-making. However, as the size of data grows, timely and effective data utilization becomes challenging. We propose an unsupervised data filtering method to reduce manufacturing big data sets with multi-variate continuous variables into informative small data sets. Furthermore, to determine the appropriate proportion of data to be filtered, we propose a filtering information criterion (FIC) to balance the tradeoff between the filtered data size and the information preserved. The case study of a babycare manufacturing and a simulation study have shown the effectiveness of the proposed method.