Crime detection and criminal recognition to intervene in interpersonal violence using deep convolutional neural network with transfer learning

Abstract

Interpersonal violence, such as physical and sexual abuse, eve-teasing, bullying, and taking hostages, is a growing concern in our society. The criminals who directly or indirectly committed the crime often do not go into the trial for the lack of proper evidence as it is very tough to collect photographic proof of the incident. A subject's corneal reflection has the potentiality to reveal the bystander images. Motivated with this clue, a novel approach is proposed in the current paper that uses a convolutional neural network (CNN) along with transfer learning in identifying crime as well as recognizing the criminals from the corneal reflected image of the victim called the Purkinje image. This study found that off-the-shelf CNN can be fine-tuned to extract discriminative features from very low resolution and noisy images. The procedure is validated using the developed datasets comprising six different subjects taken at diverse situations. They confirmed that it has the ability to recognize criminals from corneal reflection images with an accuracy of 95.41%.