Supervised Machine Learning for Automatic Assessment of Free-Text Answers

Abstract

The learning assessment seeks to collect data that allows for identifying learning gaps for teacher decision-making. Hence, teachers need to plan and select various assessment instruments that enable the verification of learning evolution. Considering that a more significant number of evaluation instruments and modalities increase the teachers’ workload, the adoption of machine learning might support the assessing actions and amplify the potential of students’ observation and follow-up. This article aims to analyze machine learning algorithms for automatic classification of free-text answers, i.e., evaluating descriptive questions written in Portuguese. We utilized a dataset of 9981 free-text answers for 17 questions. After pre-processing the data, we used eight classification algorithms. In conclusion, we highlight that the Logistic Regression, ExtraTrees, Random Forest, and Multi-layer Perceptron algorithms obtained results above 0.9 of F-score for both multi-class and binary classification.