Financial Data Collection Based on Big Data Intelligent Processing

Abstract

With the rapid growth of big data technology, its field plays a crucial role in financial data processing. No matter in the past or in the future, the financial industry has always been an important part of leading the development of the world economy, and the premise of this is to stabilize the financial environment. The current turmoil in the world economy also means that the financial environment is volatile. Therefore, the collection and analysis of financial data is an indispensable step. According to the collection and analysis of financial data intelligently processed by big data, this article studied the necessity of financial data collection and analysis, and used python crawler and k-means algorithm to process financial data. By crawling the stock trading information of a website, part of the data was extracted and visualized. According to the trend chart of the stock price and trading volume, the trend of the stock could be clearly and intuitively understood.