Coupled hidden Markov models for complex action recognition

  • Brand M
  • Oliver N
  • Pentland A
  • 1


    Mendeley users who have this article in their library.
  • N/A


    Citations of this article.


We present algorithms for coupling and training hidden Markov models (HMMs) to model interacting processes, and demonstrate their superiority to conventional HMMs in a vision task classifying two-handed actions. HMMs are perhaps the most successful framework in perceptual computing for modeling and classifying dynamic behaviors, popular because they offer dynamic time warping, a training algorithm and a clear Bayesian semantics. However the Markovian framework makes strong restrictive assumptions about the system generating the signal-that it is a single process having a small number of states and an extremely limited state memory. The single-process model is often inappropriate for vision (and speech) applications, resulting in low ceilings on model performance. Coupled HMMs provide an efficient way to resolve many of these problems, and offer superior training speeds, model likelihoods, and robustness to initial conditions

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • M. Brand

  • N. Oliver

  • A. Pentland

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free