An investigation of railway fastener detection using image processing and augmented deep learning

Abstract

The rail fastening system forms an indispensable part of the rail tracks and needs to be periodically inspected to ensure safe, reliable and sustainable rail operations. Automated visual inspection has gained significant importance for fastener inspection in recent years. Position accuracy, robustness, and practical limitations due to the complex environment are some of the major concerns associated with this method. This study investigates the combined use of image processing and deep learning algorithms for detecting missing clamps within a rail fastening system. The images used for this study was acquired during field inspections carried out along the Borlänge-Avesta line in Sweden. The image processing techniques proposed in this study enabled the improvement of the fastener position and removal of redundant information from the fastener images. In addition, image augmentation was carried out to enhance the data set, ensure experimental reliability and replicate practical challenges associated with such visual inspection. Convolutional neural network and ResNet-50 algorithms are used for classification purposes, and both the algorithms achieved over 98% accuracy during training and validation and over 94% accuracy during the test stage. Both the algorithms also maintained a good balance between the precision and recall scores during the test stage. CNN and ResNet-50 algorithms were also tested to analyse their performances when the clamp areas were covered. CNN was able to accurately predict the fastener state up to 70% of clamp area occlusion, and ResNet-50 was able to achieve accurate predictions up to 75% of clamp area occlusion.