Performance comparison of hive, pig & map reduce over variety of big data

Abstract

Big Data refers to that huge amount of data which cannot be analyzed by using traditional analytics methods. With the increase of web content at a rapid rate, only analyzing data is not enough rather managing it with that great pace and efficiency is needed. A new framework Hadoop was implemented in order to perform parallel distributed computing. Hadoop is supported by various frameworks. In this paper, a performance comparison of Pig, Hive and Map Reduce over Big Data is analyzed.