Mobile Application Based Home Automation with Security Advancements utilizing IoT and Computer Vision

Abstract

Security has consistently been a numbers game. Time to discovery and time to reaction have been measurements security groups have looked to diminish since the get-go (or if nothing else the start of PCs…). However, what does it take to really decrease that number? Mechanizing security undertakings like the ones described in this paper is no longer a "nice to have." It's a "need to have." Automating house features incorporating security advancements can alleviate many of today’s biggest security issues and offer us group operational efficiencies that can profit us now and over the long haul. Our work aims in automatic handling of security operations-related tasks. It takes care of executing these tasks, such as scanning for vulnerabilities, with minimal required human intervention. We propose a complete smart security system with home automation techniques complementing security advancements. The system is controlled by a mobile application which works in dual mode. In the first mode, the owner can control the home upon his/her discretion and can access the home automation features such as unlocking their house using the same application without being physically present. While the other mode requires the person (trying to enter the house) to be physically present and provide his fingerprint biometrics and face detection to access the house. The photo of the person is sent to the owner for his confirmation and the owner can then decide whether to identify and allow the guest as an acquaintance or to report to the police as a suspect. Both modes allow the use of home automation techniques using the dial pad of the owner’s phone.