Randomly Testing an Autonomous Collision Avoidance System with Real-World Ship Encounter Scenario from AIS Data

Abstract

Maritime Autonomous Surface Ship (MASS) is promoted as the future of intelligent shipping. While autonomy technologies offer a solution for MASS, they have also resulted in new challenges for performance validation. To address this, a scenario-based validation method to test the autonomous collision avoidance system is proposed in this paper, including mining ship encounter scenarios from massive historical AIS data and randomly generated virtual test scenarios according to the parameter probability distributions from the collected real scenarios, as well as the final experiments: a total of 2900 generated scenarios including single ship and multi-ship encounter situations are created and applied to conduct testing experiments on the further assessment of our collision avoidance algorithm. The results indicate that the proposed method has the ability to quickly create appropriate testing scenarios according to AIS records, which are helpful to catch potential defects in a collision avoidance algorithm of MASS and to further analyze its navigating features. As a result, the research forms a systematic set of validation procedures from data gathering to practical experiments conduction, incorporating both the real statistics and the random generation method.