MetaDigit: Towards A Practical Digits Input System with Few User Effort

Abstract

Nowadays, smart devices have become increasingly essential in humans' life. However, traditional input methods may not work effectively due to the tiny screen of the devices. Moreover, most learning-based gesture input schemes only perform well in terms of certain metrics such as accuracy, without considering other aspects like response time and user training overhead which are essential for real-world usage scenarios. Without taking the trade-off between different metrics into account, existing learning-based gesture input systems suffer from severe performance degradation in practice. In this paper, we investigate the trade-off between evaluation metrics of mobile interaction systems and then report our attempt towards a more practical digits input system based on our previous work. We propose an acoustic-based device-free digits input system named MetaDigit which achieves over 85% accuracy of real-Time digits recognition with even zero-shot from new users.