A mixed-reality shop system using spatial recognition to provide responsive store layout

Abstract

Environment is very important for consumers shopping. In-store characteristics such as store layout, decoration, music and store employee are the key of consumers shopping experience. However, the current online shop system lacks environment information and in-store characteristics, which are very important for consumers shopping experience. In this paper, we designed a new mixed-reality (MR) shop system by mixing virtual in-store characteristics and real environment, which might be the possible direction for the future online shop system. Technically, we developed a new spatial understanding algorithm and layout mechanism to support responsive spatial layout. In our system, store designers only need to design once, and our system can make any place to the mixed reality shop. We have invited some participants to test the usability and efficiency of our system. We have obtained a positive feedback through the preliminary user study.