Improving the recognition of eating gestures using intergesture sequential dependencies

  • Ramos-Garcia R
  • Muth E
  • Gowdy J
 et al. 
  • 25


    Mendeley users who have this article in their library.
  • 11


    Citations of this article.


This paper considers the problem of recognizing eating gestures by tracking wrist motion. Eating gestures are activities commonly undertaken during the consumption of a meal, such as sipping a drink of liquid or using utensils to cut food. Each of these gestures causes a pattern of wrist motion that can be tracked to automatically identify the activity. Previous works have studied this problem at the level of a single gesture. In this paper, we demonstrate that individual gestures have sequential dependence. To study this, three types of classifiers were built: 1) a K-nearest neighbor classifier which uses no sequential context, 2) a hidden Markov model (HMM) which captures the sequential context of sub-gesture motions, and 3) HMMs that model intergesture sequential dependencies. We built first-order to sixthorder HMMs to evaluate the usefulness of increasing amounts of sequential dependence to aid recognition. On a dataset of 25 meals, we found that the baseline accuracies for the KNN and the sub-gesture HMM classifiers were 75.8% and 84.3%, respectively. Using HMMs that model inter-gesture sequential dependencies, we were able to increase accuracy to up to 96.5%. These results demonstrate that sequential dependencies exist between eating gestures and that they can be exploited to improve recognition accuracy.

Author-supplied keywords

  • Activity recognition
  • Gesture recognition
  • Hidden markov models (HMM)
  • Mhealth

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document

Get full text


  • Raul I. Ramos-Garcia

  • Eric R. Muth

  • John N. Gowdy

  • Adam W. Hoover

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free