Overview: Machine Learning for Segmentation and Classification of Complex Steel Microstructures

Abstract

The foundation of materials science and engineering is the establishment of process–microstructure–property links, which in turn form the basis for materials and process development and optimization. At the heart of this is the characterization and quantification of the material’s microstructure. To date, microstructure quantification has traditionally involved a human deciding what to measure and included labor-intensive manual evaluation. Recent advancements in artificial intelligence (AI) and machine learning (ML) offer exciting new approaches to microstructural quantification, especially classification and semantic segmentation. This promises many benefits, most notably objective, reproducible, and automated analysis, but also quantification of complex microstructures that has not been possible with prior approaches. This review provides an overview of ML applications for microstructure analysis, using complex steel microstructures as examples. Special emphasis is placed on the quantity, quality, and variance of training data, as well as where the ground truth needed for ML comes from, which is usually not sufficiently discussed in the literature. In this context, correlative microscopy plays a key role, as it enables a comprehensive and scale-bridging characterization of complex microstructures, which is necessary to provide an objective and well-founded ground truth and ultimately to implement ML-based approaches.