Using recurrent neural networks with attention for detecting problematic slab shapes in steel rolling

The competitiveness in the manufacturing industry raises demands for using recent data analysis algorithms for manufacturing process development. Data-driven analysis enables extraction of novel knowledge from already existing sensors and data, which is necessary for advanced manufacturing process refinement involving aged machinery. Improved data analysis enables factories to stay competitive against newer factories, but without any hefty investment. In large manufacturing operations, the dependencies between data are highly complex and therefore very difficult to analyse manually. This paper applies a deep learning approach, using a recurrent neural network with long short term memory cells together with an attention mechanism to model the dependencies between the measured product shape, as measured before the most critical manufacturing operation, and the final product quality. Our approach predicts the ratio of flawed products already before the critical operation with an AUC-ROC score of 0.85, i.e., we can detect more than 80 % of all flawed products while having less than 25 % false positive predictions (false alarms). In contrast to previous deep learning approaches, our method shows how the recurrent neural network reasons about the input shape, using the attention mechanism to point out which parts of the product shape that have the highest influence on the predictions. Such information is crucial for both process developers, in order to understand and improve the process, and for process operators who can use the information to learn how to better trust the predictions and control the process. (C) 2019 Elsevier Inc. All rights reserved.