Human-machine interaction in intelligent technologies using the augmented reality

Abstract

Intelligent homes are one of the most expanded technologies included in the definition of Internet of Things. These technology allow us to exercise control over our own apartment/house. As a control, we can understand energy consumption, monitoring, healthy eating as well health care. One of the elements of such a system are interface and interaction with it. In order to increase the possibilities and encourage people to invest in such technologies, it is important to increase the possibilities and forms of system visualization. One of the novel idea is to use augmented reality to increase the quality of Internet of Things applications. In this work, we propose a model to increase interaction between the user and the system installed at home. The proposed solution is based on the use of data obtained by the camera and microphone in smartphones to extract selected features and process them for the purpose of increasing interaction. Presented technique can be applied to image and voice samples using similar technique of processing (based on key-points searching algorithm). Such action can allow to increase the range of operation system, to simplify the life of the household members, in particular, the elderly and the disabled people. Model of the operation system has been described and tested to indicate the potential benefits of using augmented reality as an additional human-machine communication interface. Moreover, proposed technique of processing different type of input data like video, image and sound can be used for feature extraction and further classification purposes.