Design and application of bank big data platform based on hadoop technology

Abstract

At present, the design of big data platforms for many domestic banks is still insufficient. This article builds a Hadoop-based bank big data platform based on the big data platform construction experience of a large state-owned commercial bank. By introducing cutting-edge mainstream big data open-source tools, the overall architecture of the big data platform of commercial banks is built. At the same time, this article discusses critical technical solutions such as storage engine, resource management, calculation engine, analysis engine, interactive front end, and data management, task management, and user management to build a bank's big data platform. This article hopes to provide a reference for other banks to make big data platforms.