KnitworkVR: Dual-reality Experience through Distributed Sensor-Actuator Networks in the Living Knitwork Pavilion

Abstract

KnitworkVR integrates dual-reality and digital twin platforms to simulate the Living Knitwork Pavilion in a desert landscape, using real-time sensor data. The sensor network captures movements, interactions, and spatial positioning of occupants, linking electric field sensor data with VR positioning. This creates a sensor-driven immersive experience with dynamic lighting, live animations, and adaptive soundscapes, enabling telepresence and collaborative interaction in both digital and physical environments. This paper explores the functional textile design, sensing hardware, audiovisual system, and VR framework, highlighting the applications of immersive spaces with knitted electronic textiles and distributed physical-digital systems.