Big data and cloud computing: roles and relationships, techniques and tools

Abstract

In the past years, the increase in data has been accompanied by rapid growth in various fields. It is difficult to analyze large volumes of data using traditional and relational database technology. Therefore, new databases have emerged, and for this reason, big data has become one of the new topics in IT and business today. Also, the cloud environment is increasingly used to store and process big data. Cloud processing refers to processing anything, including Big Data Analytics, on the "cloud". A "cloud" is a collection of high-powered servers from providers that can often view and query large data sets much faster than a regular computer. These two topics differ from each other in various aspects, including definition, collection references, usage method, form and format, and application. In this research, the dimensions and basic concepts, characteristics, tools and techniques, classification, and communication of data are examined. Big has been dealt with cloud computing, and in addition, storage systems, opportunities and challenges, and big data design principles in the cloud environment have been analyzed.