GazeHelp: Exploring Practical Gaze-Assisted Interactions for Graphic Design Tools

Abstract

This system development project introduces the Adobe Photoshop plugin GazeHelp, exploring the practical application of multimodal gaze-Assisted interaction in assisting current graphic design activities. It implements three core features, including QuickTool: A gaze-Triggered popup that allows the user to select their next tool with gaze; X-Ray: creating a small non-destructive window at the gaze point, cutting through an artboard's layers to expose an element on a selected underlying layer; and Privacy Shield: dimming and blocking the current art board from view when looking away from the display. Each harness the speed, gaze-contingent observational nature and presence-implying strengths of gaze respectively, and are customisable to the user's preferences. The accompanying GazeHelpServer, complete with intuitive GUI, can also be flexibly used by other programs and plugins for further development.