Camera-Based Selection with Cardboard Head-Mounted Displays

Abstract

We present two experiments comparing selection techniques for low-cost mobile VR devices, such as Google Cardboard. Our objective was to assess the feasibility of computer vision tracking on mobile devices as an alternative to common head-ray selection methods. In the first experiment, we compared three selection techniques: air touch, head ray, and finger ray. Overall, hand-based selection (air touch) performed much worse than ray-based selection. In the second experiment, we compared different combinations of selection techniques and selection indication methods. The built-in Cardboard button worked well with the head ray technique. Using a hand gesture (air tap) with ray-based techniques resulted in slower selection times, but comparable accuracy. Our results suggest that camera-based mobile tracking is best used with ray-based techniques, but selection indication mechanisms remain problematic.