Application Potential of Stable Diffusion in Different Stages of Industrial Design

Abstract

The Stable diffusion [1] is a system composed of three parts – text encoder, latent diffusion model and autoencoder decoder. With the open source of Stable diffusion, more and more users begin to use stable diffusion to generate digital art, modify images and explore more applications. However, the application potential of stable diffusion in the different stages of industrial design is not yet clear. We divide the process of industrial design into four stages and focus on exploring its application in the sketching stage and rendering stage. We discussed whether the Stable-diffusion model can well express the concepts related to industrial design (product category, shape, color, material), explored the composability of the different finetune ways, and enabled Stable diffusion model to effectively transform the text prompt and image prompt into high-quality design scheme. It shows that finetuned stable diffusion model can help designers to build intent map and push structure deduction work. Also, with simple image hints and text prompt, finetuned stable diffusion model which trained from a specific product can do attribute, background and illumination modifications to the renderings.