Envisioning Mixed Realities on the Flight Deck

Abstract

Conformal 3D symbology presented on a head tracked head-mounted display (HMD) has the capability to enhanced pilot situation awareness, performance and workload by providing an unlimited field of view of operational hazards. In recent years, a body of research has emerged highlighting the technical advancements (i.e. HMD encumbrance and optical enhancements) that could enable the unique capabilities and benefits of HMDs to be realized on commercial and business flight decks in the near future. The current paper provides a systematic review of the HMD-related pilot benefits (performance, workload, situational awareness, and usability) that have been reported in the literature. We conclude by highlighting the operational contexts where HMDs might enhance pilot performance, flight safety and efficiencies.