Indoor localization for an augmented reality-aided operation and maintenance system based on sensor data integration

Abstract

We propose a method for determining the location of a mobile client for augmented reality (AR) aided maintenance and operation systems using the data integration of localization results from wireless LAN signals and three-dimensional camera image sequences. The AR technology is used to enhance real information by adding virtual objects, images, and sounds through camera images. To apply the AR system to maintenance and operation tasks in large structures, a data management system for localization is crucial because of the cost for searching for real-location information. We propose a sensor data integration scheme for the localization of a mobile client the indoor structure using the localization results from camera image sequences and the results using the wireless LAN signal strength. The data integration scheme provides an area selection method using the estimation result of the location in the structure using wireless LAN signals and the precise location estimation using camera image sequences. The experimental results confirm the feasibility of the proposed method.