Big Data Preprocessing for Modern World: Opportunities and Challenges

Abstract

Big data is an often misunderstood business term in the modern world. Multiple devices are connected to the internet and a democratization of available technologies. The data is generated almost exponential rate. This data is generated in large quantities, at a high speed and belongs to myriad categories. Coupled with advances in storage and processing hardware, it can derive insights from these bigger number of data but it works effectively. The data is to be transformed in the form of understandable and useable insights by algorithms and models. The data mining steps require data that is cleaned and structured to a larger extent. This is achieved by using various algorithms, processes and applications known as data pre-processing techniques. This article reviews the various data pre-processing techniques from a big data point of view.