Integrating Computer Vision and Natural Language Processing to Guide Blind Movements

Abstract

Vision is the most essential sense for human be- ings. Vision impairment is one of the most problems faced by the elderly. Blindness is a state of lacking the visual perception due to physiological or neurological factors. This paper presents a detailed systematic and critical review that explores the available literature and outlines the research efforts that have been made in relation to movements of the blind and pro- poses an integrated guidance system involving computer vision and natural language processing. An advanced Smartphone equipped with vision, language and intelligence capabilities is attached to the blind person in order to capture surrounding images and is then connected to a central server programmed with a faster region convolutional neural network algorithm and an image detection algorithm to recognize images and mul- tiple obstacles. The server sends the results back to the Smart- phone which are then converted into speech for the blind per- son’s guidance.