Application of Swin-Unet for pointer detection and automatic calculation of readings in pointer-type meters

Abstract

Pointer-type meters are widely used in military, industrial, and aerospace applications. In this paper, we propose a method to automatically calculate the readings of pointer-type meters that exhibits strong robustness to various situations, such as complex backgrounds, tilted meters, blurred images, and meter images with uneven illumination. First, the mask maps of scale and pointers are obtained using the Swin-Unet semantic segmentation network. For the mask map of scale, the Swin Transformer image classification network is used to identify the values of the scale and the coordinates of the centroids of the scale, and for the mask map of the pointer, the least skeleton circle method is proposed to fit the linear equation of the pointer. Second, the influence of the pointer and several adjacent scale on the meter reading is considered, and the weighted angle method (WAM) is proposed to calculate the meter reading. In order to verify the robustness of the algorithm in this paper, the pointer detection method is compared with the traditional pointer detection method, and it is found that the pointer detection method in this paper works better, and the pointer detection algorithm in this paper is applied to different semantic segmentation results, and it is verified that the pointer detection algorithm in this paper can be well adapted to different semantic segmentation results. This paper also compares the proposed algorithm with the existing meter reading calculation methods. The experiments show that using WAM on uncorrected meter images reduces the error by 30% compared with the traditional angle method, and using WAM on corrected meter images reduces the error by about 50%, which finally verifies the effectiveness of the algorithm in this paper.