Sculpting in Augmented Reality: Redefining Digital Crafts Through Multimodal Interactions

Abstract

Sculpting is a complex craft that relies on the synergy of multiple factors. The makers’ dexterity, material properties and environmental conditions are fundamental in determining a successful sculpting process. Although advanced software solutions emulate this craft through sophisticated interactions and design options, craftsmen and digital makers criticize these interfaces’ lack of physical engagement. This study explores augmented reality technology to define an additional method for sculpting processes that links the physical craft with methodologies from 3D modelling software. The research output consists of an augmented reality app - SculptAR - that applies concepts from multimodal interactivity studies to implement gesture and voice recognition methods. The aim is to integrate these inputs and define augmented sculpting as an engaging and interactive experience that merges physical and digital skills. Furthermore, this research wants to highlight the emergence of possibilities for developing interactive experiences that include various human senses.