Distributed Streaming Storage Performance Benchmarking: Kafka and Pravega

Abstract

The performance benchmarking tool for a distributed streaming storage system should be targeted toachieve maximum possible throughput from the streaming storage system by thrusting data massively. This paper details the design and implementation of high-performance benchmark tool for Kafka and Pravega streaming storage systems. The benchmark tool presented in this paper supports multiple writers and readers. The Pravega streaming storage is evaluated against Kafka with respect to performance.