Automated system for monitoring of educational processes: collection, management, and modeling of data

Abstract

Currently, the most of the processes at the educational analytical centers entirely depend on the human factor. Automation of the real-time monitoring system for the educational processes can be possible through the development and improvement of the information technologies, algorithms and computational methods, such as machine learning methods, analysis and visualization of big data processes. This paper covers the issues of the development of automated system for monitoring of educational processes from the point of view of data collection, data management, and data modeling. It includes the stages of data collection with the description of data engineering methods, data management procedures, algorithms of data cleaning and filtering, data modeling and visualization processes as well as the description of intelligent algorithms for scoring analysis of results. The principal feature that characterizes the development of the mentioned automated system is the using of availability of user experience data from existing educational sites and other open data sources that allow us to create a complete vision of the educational processes’ state at various levels.