A distributed complex event processing system based on publish/subscribe

Abstract

The advent of the Internet of Things (IoT) significantly stimulates the development of context-aware applications. Complex event processing (CEP) is a technology for real-time data processing. However, a single node of CEP engine cannot keep up with the demand of high performance facing on the growing volume of sensor data. Many researches have focused on distributed complex event processing. In this paper, we propose a solution of distributed CEP based on pub/sub mechanism; by leveraging the loose coupling characteristics of pub/sub, it is easy to scale the system. The persistence storage and master–slave structure of the message broker also provide high reliability. Furthermore, we develop a configuration module for users to describe a complex event processing flow by a directed acyclic graph (DAG). The performance evaluation experiment demonstrates that our approach works well with large data set.