A Cloud Based Architecture for Working on Big Data with Workflow Management

Abstract

In real environment there is a collection of many noisy and vague data, called Big Data. On the other hand, to work on the data middleware have been developed and is now very widely used. The challenge of working on Big Data is its processing and management. Here, integrated management system is required to provide a solution for integrating data from multiple sensors and maximize the target success. This is in situation that the system has constant time constrains for processing, and real-time decision-making processes. A reliable data fusion model must meet this requirement and steadily let the user monitor data stream. With widespread using of workflow interfaces, this requirement can be addressed. But, the work with Big Data is also challenging. We provide a multi-agent cloud-based architecture for a higher vision to solve this problem. This architecture provides the ability to Big Data Fusion using a workflow management interface. The proposed system is capable of self-repair in the presence of risks and its risk is low.