Object Recognition and Tracking in Moving Videos for Maritime Autonomous Surface Ships

Abstract

In autonomous driving technologies, a camera is necessary for establishing a path and detecting an object. Object recognition based on images from several cameras is required to detect impediments in autonomous ships. Furthermore, in order to avoid ship collisions, it is important to follow the movements of recognized ships. In this paper, we use the Singapore Maritime Dataset (SMD) and crawling image for model training. Then, we present four YOLO-based object recognition models and evaluate their performance in the maritime environment. Then, we propose a tracking algorithm to track the identified objects. Specially, in evaluation with high-motion video, the proposed tracking algorithm outperforms deep simple online and real-time tracking (DeepSORT) in terms of object tracking accuracy.