Intelligent Anomaly Detection and Localization With Crowd Density Estimation for Improved Public Safety

Abstract

The rapid growth of metropolitan populations and large public gatherings has increased the need for intelligent surveillance systems capable of ensuring public safety. This study proposes a novel framework, Intelligent Anomaly Detection and Localization with Crowd Density Estimation (IADL-CDE), which jointly addresses crowd density classification and anomaly detection in real-time. Leveraging the ShanghaiTech dataset for crowd density estimation and the UCSD Pedestrian Database for anomaly detection, the framework integrates a Robust Maximum Correntropy Kalman Filter (RMCKF) for effective image pre-processing, followed by a Self-Modulating Convolutional Neural Network (SMCNN) that accurately classifies crowd density levels into sparse, medium, and dense categories. Subsequently, a Pixel-Associated Auto Encoder (PAAE) is employed to detect and localize anomalies such as cycling, skateboarding, and unauthorized vehicles in pedestrian environments. Experimental results demonstrate that the proposed IADL-CDE model achieves significant improvements in accuracy, precision, recall, F1-Score and Cohen’s Kappa Coefficient compared to the baseline methods. These findings highlight the model’s effectiveness and robustness in enhancing public safety through intelligent crowd monitoring and anomaly detection.