Elasticsearch and Carrot2-based log analytics and management

Abstract

The log analytics and management mechanism is an implementation of Elasticsearch—a distributed full-text search engine for indexing the logs and Carrot2 clustering engine for clustering the logs which are combined together with our algorithm to manage and analyze the logs given to it as input. In this paper, we reflect on how Elasticsearch along with Carrot2 is used with our algorithm to manage and analyze logs of any format. The log analytics and management is set up on Amazon web server.