Feature Tracking Based on Line Segments with the Dynamic and Active-Pixel Vision Sensor (DAVIS)

Abstract

As a novel vision sensor, the dynamic and active-pixel vision sensor (DAVIS) combines a standard camera and an asynchronous event-based sensor in the same pixel array. In this paper, we propose a novel asynchronous feature tracking method based on line segments with the DAVIS. The proposed method takes asynchronous events, synchronous image frames, and IMU data as the input. We first use the Harris detector to extract feature points and the Canny detector to extract line segment templates from image frames. Then we select spatio-Temporal windows from asynchronous events and perform registration to estimate the optical flow. The registration is achieved by associating the extracted line segments with the events inside the window. Expectation maximization-iterative closest point (EM-ICP) is adopted for the registration. Afterward, we use the estimated optical flow and the IMU data to update the position of line segments, and take them as the new templates. We evaluate our method on the public event camera datasets. The results show that our method can achieve comparable performance to other methods in terms of accuracy and tracking time.