SmartGe: Identifying Pen-Holding Gesture with Smartwatch

Abstract

Performing the correct pen-holding gesture plays an important role in handwriting efficiency and quality, especially for early education. In this paper, a detailed design and evaluation of the system, called SmartGe, is presented, which can identify the pen-holding gesture with smartwatch when writing Chinese and English. We firstly analyze the hand movement and propose a novel handwriting detection algorithm to segment each stroke or letter. Then we recognize the pen-holding gesture using deep convolution neural network(DCNN). To improve system performance in Chinese writing, we connect a vertical stroke and a horizontal stroke for pen-holding gesture recognition. SmartGe provides a convenient and natural way to improve users' writing habits, which is a lightweight system, and extensive experiments confirm its effectiveness and robustness.