Image-based failure detection for material extrusion process using a convolutional neural network

Abstract

The material extrusion (ME) process is one of the most widely used 3D printing processes, especially considering its use of inexpensive materials. However, the error known as the “spaghetti-shape error,” related to filament tangling, is a common problem associated with the ME process. Once occurring, this issue, which consumes both time and materials, requires a restart of the entire process. In order to prevent this, the user must constantly monitor the process. In this research, a failure detection method which uses a webcam and deep learning is developed for the ME process. The webcam captures images and then analyzes them by machine learning based on a convolutional neural network (CNN), showing outstanding performance in both image classification and the recognition of objects. Sample images were trained based on a modified Visual Geometry Group Network (VGGNet) model and the trained model was evaluated, resulting in 97% accuracy. The pre-trained model was tested on a 3D printer monitoring system for its ability to recognize the “spaghetti-shape-error” and was able to detect 96% of abnormal deposition processes. The proposed method can analyze the ME process in real time and informs the user or halts the process when abnormal printing is detected.