The presented paper proposes a new method for unique automatic evaluation of speech therapy exercises, one part of the future software system for speech therapy support. The method is based on the detection of the lips and tongue movements, which will help to evaluate the quality of the exercise implementation. Four different types of exercises are introduced and the corresponding features, capturing the quality of the movements, are shown. The method was tested using manually annotated data and the proposed features were evaluated and analyzed. At the second part, the tongue detection is proposed based on the convolutional neural network approach and preliminary results were shown.
CITATION STYLE
Bílková, Z., Novozámský, A., Domínec, A., Greško, Š., Zitová, B., & Paroubková, M. (2019). Automatic evaluation of speech therapy exercises based on image data. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 11662 LNCS, pp. 397–404). Springer Verlag. https://doi.org/10.1007/978-3-030-27202-9_36
Mendeley helps you to discover research relevant for your work.