Emergency response system using a surveillance camera with collaborative multiple robots

Abstract

This paper proposes a new type of emergency response system that can detect an emergency situation using vision based human action recognition with collaborative mobile robots to deal with emergency situations. A vision-based emergency detection scheme that can detect suspicious situations by analyzing image sequences from a surveillance camera is developed. After detecting a human in image sequences, the detected human regions are tracked and human actions are then recognized using a motion history image and a neural network. When an emergency occurs, a mobile robot is sent to the emergency site to diagnose the situation at close distance. After reaching the target location, the robot transfers information on the situation such as sound and images. © 2011 Springer-Verlag.