Big data ecosystem: Review on architectural evolution

Abstract

Big data is the collection of large datasets of different varieties, generated at an alarming speed with noises and abnormality. It is primarily popular for its five Vs namely volume, variety, velocity, value, and veracity. In an extremely disruptive world of open source systems that are playing a dominant role, big data can be referred to as the technology that can address the storage, processing, and visualization of such data which is too diverse and fast-changing. It has led to a complex ecosystem of new frameworks, tools, and libraries that are being released almost every day, which creates confusion as the technologists tussle with a swamp. This survey paper discusses the big data architecture and its subtleties that might help in applying the appropriate technology as a use case.