Toward real-time physically-based voice simulation: An Eigenmode-based approach

Abstract

While physically-based continuum models of voice production have potential applications in clinical intervention of voice disorders and personalized natural speech synthesis, their current use is limited due to the high computational cost associated with resolving the complex fluid-structure interaction during voice production process. The goal of this study is to summarize recent efforts in developing a physically-based, computationally-efficient continuum model of voice production toward near real-time applications. The model uses an eigenmode-based formulation of the governing equations, in which vocal fold eigen-modes are used as building blocks to reconstruct more complex vocal fold vibration patterns. Simulations show that a reasonable accuracy in the fundamental frequency, vocal intensity, and selected spectral measures can be reached with the use of the first 100 vocal fold eigenmodes, thus significantly reducing the degrees of freedom of the governing equations (as compared to tens of thousands in finite element models) and computational time. It is expected that for applications in which absolute values are not as essential, even a smaller number of eigenmodes would be acceptable. Examples are provided to demonstrate the capability of the model in modeling large range of voice qualities, natural voice quality change over time, and speech production in general.