Red-Light Running Violation Detection of Vehicles in Video Using Deep Learning Methods

Abstract

Recently, Traffic Monitoring Systems (TMS) based on camera are widespread used in many large cities thanks to advances in artificial intelligence especially in deep learning and computer vision. Detection of traffic violation of vehicles is a critical problem for law enforcement in such TMS due to complicated trajectories of different vehicle types in road. Existing methods based on computer vision techniques for detecting, tracking vehicles and then applying violation rules on the perceived path of every vehicles. In this paper, we present a novel approach which is based on the flexible LSTM recurrent neural networks in addition to the traditional fixed rules to detect red-light running violation of vehicles. We also present our improvements on the existing DeepSort tracking algorithm for faster and more accurate ID matching. We evaluate our deep LSTM with attention mechanism on a dataset (Dataset and code are available here: https://github.com/namnv78/RunningRedlight ) of 108 traffic videos captured from three road intersections in Vietnam including 628 red-light running violated vehicles. Our method achieved a precision, recall and F1-score of more than 99% which is 3% higher than the traditional rule-based method.