Real‐time high‐performance laser welding defect detection by combining acgan‐based data enhancement and multi‐model fusion

Abstract

Most of the existing laser welding process monitoring technologies focus on the detection of post‐engineering defects, but in the mass production of electronic equipment, such as laser welding metal plates, the real‐time identification of defect detection has more important practical signif-icance. The data set of laser welding process is often difficult to build and there is not enough ex-perimental data, which hinder the applications of the data‐driven laser welding defect detection method. In this paper, an intelligent welding defect diagnosis method based on auxiliary classifier generative adversarial networks (ACGAN) has been proposed. Firstly, a ten‐class dataset consisting of 6467 samples, was constructed, which originate from the optical and thermal sensory parameters in the welding process. A new structured ACGAN network model is proposed to generate fake data similar to the true defect feature distributions. In addition, in order to make the difference between different defects categories more obvious after data expansion, a data filtering and data purification scheme was proposed based on ensemble learning and an SVM (support vector machine), which is used to filter the bad generated data. In the experiments, the classification accuracy can reach 96.83% and 85.13%, for the CNN (convolutional neural network) algorithm model and ACGAN model, respectively. However, the accuracy can further improve to 97.86% and 98.37% for the fusion models of ACGAN‐CNN and ACGAN‐SVM‐CNN models, respectively. The results show that ACGAN can not only be used as an algorithm model for classification, but also be used to achieve superior real‐time classification and recognition through data enhancement and multi‐model fusion.