General concept of the storage and analytics system for human migration data

Abstract

The population mobility, related to long-term and short-term migrations, happens on an increasing pace, affecting various fields of activity in a single country and the world community as a whole. Large amounts of diverse migration-related data are recorded by different entities all over the world, making it important to develop and implement a system for storing and analyzing such data. The proposed article describes the subject area associated with socio-economic displacements of people, the key features of internal and external migrations are noted. Based on that, the general architecture of the universal system of data storage and processing is proposed leveraging the client-server architecture. A fragment of the data model, associated with the accumulation of data from external sources, is provided. General approaches for algorithms and data structure usage are proposed. The system architecture is scalable, both vertically and horizontally. The proposed system organizes the process of searching for data and filling the database from third-party sources. A module for collecting and converting information from third-party Internet sources and sending them to the database is developed. The features of the client application, providing a convenient visual interface for analyzing data in the form of diagrams, graphs, maps, etc. are specified. The system is intended to instrument various users interested in analyzing economic and social transfers, for example, touristic sector organizations wishing to obtain statistics for a certain timeframe, airlines planning flight logistics, as well as for state authorities analyzing the migration flows to develop appropriate regulations.