Augmented-reality-based 3D modeling system using tangible interface

Abstract

Object 3D model creation is a difficult task and it typically requires professional modeling tools or devices. For nonexpert users who want to create simple 3D applications, these approaches are either too expensive or require extensive study and learning of the complex modeling tools. In this work, we develop a modeling system that allows an amateur to interactively create a simple 3D model for his/her applications. The system is developed on the basis of augmented reality (AR) technology with a tangible user interface. AR allows a user to operate virtual models in a real 3D environment; thus, the operation is more natural and intuitive than traditional 2D-graphical-interface-based modeling tools. A user can easily change his/her viewpoint by rotating an AR marker or moving the physical camera. An AR pen is also designed in the system, which serves as a tangible device that allows a user to select, translate, rotate, and modify the created model. With the AR pen, a user can scale the model and combine it with other models to form a large model with diverse shapes. In particular, we also include a free-form deformation (FFD) tool in the system so that the users can modify the shape of a model using the tangible interface and create an imagined object. To extend the application range of the proposed system, we port the system to mobile devices such as tablets or smartphones so that any user with suitable devices can create his/ her 3D models using the proposed system.