Using microservices and event driven architecture for big data stream processing

Abstract

Choosing the appropriate architecture for a big data project is not a straightforward task. The architect needs to have knowledge in the problem domain, future application requirements, big data technology landscape and architectural patterns. Today's dynamic business environment enforces constantly evolving big data applications, which often need to process thousands of messages per second. Solutions implementing microservices and Event Driven Architecture (EDA) could provide scalability and extensibility to the required application. The article will outline microservices and EDA challenges, advantages and potential problems concerning big data stream processing.