An ensemble framework augmenting surveillance cameras for detecting intruder clusters as potential mobs

Abstract

Many developing nations around the world curtail crimes through video surveillance technology, but the crime rate is still high. This is compounded by short-staffed security operatives and a deficiency of security infrastructure to assist security operatives with knowledge-driven decision support systems in the low-resource constraint environment. In a public environment, it is challenging to detect intruder clusters accurately as potential mobs for early warning. Previous research investigated some classical techniques, but their recommendations were insufficient. This research develops a machine learning 3-tiers ensemble framework, which integrates gray level co-occurrence matrices (GLCM) principles to enhance the capabilities of surveillance cameras and security operatives to effectively discern and respond to potential mob formations. The University of California San Diego (UCSD) pedestrian datasets that are publicly available were used for the experiments. With an improved overall average precision of 0.98, recall of 0.98, and accuracy of 98.52% on the UCSD dataset, the suggested framework outperforms the widely used methods for the detection of intruder clusters. The reduction in computational time on processors showcases the framework's significant advancements as a promising solution for robust real-time threat assessment applications.