Bayesian learning of Gaussian mixture densities for hidden Markov models

Abstract

An investigation into the use of Bayesian learning of the parame-ters of a multivariate Gaassian mixture density has been carried out. In a continuous density hidden Markov model (CDHMM) framework, Bayesian learning serves as a unified approach for parameter smooth-ing, speaker adaptation, speaker clustering, and corrective training. The goal of this study is to enhance model robustness in a CDHMM-based speech recognition system so as to improve performance. Our ap-proach is to use Bayesian learning to incorporate prior knowledge into the CDHMM training process in the form of prior densities of the HMM parameters. The theoretical basis for this procedure is presented and preliminary results applying to HMM parameter smoothing, speaker adaptation, and speaker clustering are given. Performance improvements were observed on tests using the DARPA RM task. For speaker adaptation, under a supervised learning mode with 2 minutes of speaker-specific training data, a 31% reduction in word error rate was obtained compared to speaker-lndependent results. Using Baysesian learning for HMM parameter smoothing and sex-depen-dent modeling, a 21% error reduction was observed on the FEB91 test.