A temporal fusion approach for video classification with convolutional and LSTM neural networks applied to violence detection

Abstract

In modern smart cities, there is a quest for the highest level of integration and automation service. In the surveillance sector, one of the main challenges is to automate the analysis of videos in real-time to identify critical situations. This paper presents intelligent models based on Convolutional Neural Networks (in which the MobileNet, InceptionV3 and VGG16 networks had used), LSTM networks and feedforward networks for the task of classifying videos under the classes “Violence” and “Non-Violence”, using for this the RLVS database. Different data representations held used according to the Temporal Fusion techniques. The best outcome achieved was 0.91 and 0.90 of Accuracy and F1-Score, respectively, a higher result compared to those found in similar researches for works conducted on the same database.