Big data analytics of the technological equipment based on Data Lake architecture

Abstract

Currently, more and more managers of medium and large industrial companies are thinking about conducting a digital transformation of their enterprise. Each company is forced to strive to find an approach to optimizing production in order to remain competitive in the market. For industrial enterprises, this approach may be a digital transformation using the ideas of Industry 4.0. The digital transformation of an enterprise is a complex and multifaceted process that affects almost all levels of production. At the head of this whole process are data. Data on the work of production must be collected, stored, aggregated, transferred to various levels. Existing methods for storing data are not always suitable for working with BigData, new solutions are needed. The paper shows a comparison of the traditional approach to data aggregation and a promising direction based on the architecture of Data Lake.