Typing in Mid Air: Assessing One- and Two-Handed Text Input Methods of the Microsoft HoloLens 2

Abstract

The Microsoft HoloLens 2 is a mixed reality (MR) headset that overlays virtual elements atop a user’s view of their physical environment. To input text, the device has the ability to track hands and fingers, allowing for direct interaction with a virtual keyboard. This is an improvement over the HoloLens 1 device, which required head tracking and single-finger air-tapping input. The present study evaluated the performance (speed and accuracy), perceived usability, mental workload, and physical exertion of one-handed and two-handed text entry. A sample of 21 participants (12 male, 9 female) aged 18–32 years typed standardized phrases presented in random order. Typing with two hands was faster and more preferred than one-handed input; however, this input method was also less accurate. Exertion in some body parts was also higher in the two-handed condition. Findings suggest that while two-handed text input was better than one-handed, there is room for improvement to approximate typing on a physical or mobile device keyboard.