Winder: Linking speech and visual objects to support communication in asynchronous collaboration

Abstract

Team members commonly collaborate on visual documents remotely and asynchronously. Particularly, students are frequently restricted to this setting as they often do not share work schedules or physical workspaces. As communication in this setting has delays and limits the main modality to text, members exert more efort to reference document objects and understand others' intentions. We propose Winder, a Figma plugin that addresses these challenges through linked tapes-multimodal comments of clicks and voice. Bidirectional links between the clicked-on objects and voice recordings facilitate understanding tapes: selecting objects retrieves relevant recordings, and playing recordings highlights related objects. By periodically prompting users to produce tapes, Winder preemptively obtains information to satisfy potential communication needs. Through a fve-day study with eight teams of three, we evaluated the system's impact on teams asynchronously designing graphical user interfaces. Our fndings revealed that producing linked tapes could be as lightweight as face-to-face (F2F) interactions while transmitting intentions more precisely than text. Furthermore, with preempted tapes, teammates coordinated tasks and invited members to build on each others' work.