Review of data scraping and data mining research

Abstract

In recent years, with the advent of the era of big data, the importance of data has also become more prominent. This article introduces the characteristics of today's Internet data from the background of big data, and the main method of data scraping-crawlers. In addition, the concepts of data mining, as well as hotspots and trends are briefly introduced. Highlights the importance of data scraping and data mining in today's Internet field.