Registration and Analysis of a Pilot’s Attention Using a Mobile Eyetracking System

Abstract

This paper presents the next stage of research into the registration and analysis of a pilot’s attention during the take-off and landing procedures. This is a continuation of the research, which the authors conducted using the static SensoMotoric Instruments (SMI) Red500 eyetracker on a group of pilots applying for a pilot’s license. Because static eyetracking introduces a series of restrictions on the properties of the observed scene, a system using Tobii Glasses Pro mobile eye tracker was proposed. Using the mobile system and a training simulator, a measurement stand was prepared for the flight of the aircraft configured as follows: Seneca II airplane with a three-point hidden chassis, location: EPRZ airport - Rzeszów Jasionka. An aviation task was prepared, which was carried out by participants in the experiment. A Tobii project was developed to define several Area of Interests (AOI) for key instruments in the cockpit of the used aircraft. It was observed that for the implementation of an exemplary task, there is no possibility of smoothly modifying coordinates of areas of interest of AOI in subsequent frames of the recorded video stream. Authors designed in the Matlab environment, the Smart Trainer application for a smooth analysis of attention using the characteristic points tracking mechanism. A fuzzy AOI contour is proposed using a modified form of the Butterworth 2D filter for individual instruments, which allows more effective registration of fixations. During the measurement it is possible to observe fixation histograms for a defined set of instruments.