CONCEPTUAL BIG DATA ARCHITECTURE FOR THE OIL AND GAS INDUSTRY

Abstract

Institute of Information Technology of ANAS, Baku, Azerbaijan 1 a.ramiz@science.az, 2 yadigar@lan.ab.az CONCEPTUAL BIG DATA ARCHITECTURE FOR THE OIL AND GAS INDUSTRY Big data technologies provide important approaches and tools for the creation of data management systems in oil and gas industry. The paper proposes a conceptual architecture for a hybrid Big data platform for storing and analyzing large volumes of data gathered from oil and gas industry systems in real-time by deep analytics and machine learning methods in distributed cluster systems. We also consider the question of selection of necessary tools from Hadoop ecosystem for building of a viable Big data solution.