Usability evaluation of a problem solving environment for automated system integration education using eye-tracking

Abstract

Research suggests that realistic practice using authentic learning environments leads to better transfer of skills. Based upon input from industry engineers with expertise in designing and building automated systems, two problem solving environments (PSEs) were developed. Each PSE provides a virtual environment for building, testing, and validating designs for a process to be automated. The user is presented a toolbox containing equipment and building blocks of automation such as sensors and actuators. The PSEs support students in design problem-solving activities such as (1) reviewing the problem, (2) understanding the process to be automated, (3) line balancing, (4) layout, (5) simulation, and (6) cost analysis. This paper presents preliminary results from a usability evaluation of one of the PSEs. The evaluation utilized a Facelab desktop mounted eye-tracking system. Users' eye movements were tracked using a camera and sensors to determine gaze direction and fixations. The data collected from the evaluation was used to determine if use of visual cues improved the usability of the PSE. Results suggest that use of visual cues for gaze direction improved the usability of the PSE application, based on faster task completion times and improved navigability. © 2012 American Society for Engineering Education.