Research on a Method of Log Aggregation

Abstract

This paper proposed a log aggregation method in scale container platform. This method collects container log data from cluster nodes through system management tool and container governance tool, provides the indiscriminate collection service for different platforms, aggregates log data in time based on Storm stream processing to implement real-time performance, implement high performance and high availability of container log data aggregation under scale clusters based on Kafka as the aggregation queue of log data.