Bio-signal integration for humanoid operation: Gesture and brain signal recognition by HMM/SVM-Embedded BN

Abstract

Joint recognition of bio-signals emanated from human(s) is discussed. The bio-signals in this paper include camera-captured gestures and brain signals of hemoglobin change ΔO 2 H b . The recognition of the integrated data is applied to the operation of a biped humanoid. Hidden Markov Models (HMMs) and Support Vector Machines (SVMs) undertake the first stage recognition of individual signal. These subsystems are regarded as soft command issuers. Then, such low-level commands are integrated by a Bayesian Network (BN). Therefore, the total system is a novel HMM/SVM-embedded BN. Using this new recognition system, human operators can control the biped humanoid through the network by realizing more motion classes than methods of HMM-alone, SVM-alone and BN-alone. © 2009 Springer Berlin Heidelberg.