Human-computer interaction increasingly focuses on long-term evaluation of in-the-wild deployments. With this trend, however, understanding the usage behavior becomes more challenging. Due to the high repeating manual labor involved, existing methods such as in-situ observations and manual video analysis are no promising prospects on this avenue. Automated approaches (e.g., based on body tracking cameras) have been suggested recently to capture the usage behavior in long-term evaluations more efficiently. Still, these approaches may not be the only ones under consideration to move the field forward from here. This workshop gathers and reflects on the current state of the art regarding this trend and outlines perspectives for future research. The contributions cover, among other topics: methods and tools for data collection, noise and errors in sensor data, the correlation of automated observations with ground truth data, and augmenting sensor data with field work (e.g., interviews) for the contextualization of findings.
Koch, M., Fietkau, J., Draheim, S., Schwarzer, J., & von Luck, K. (2023). Methods and Tools for (Semi-)Automated Evaluation in Long-Term In-the-Wild Deployment Studies. In Mensch und Computer 2023 - Workshop Proceedings.