Design and Implementation of Storage Benchmark Kit

Abstract

The Storage Benchmark Kit (SBK) is introduced in this paper. The SBK is a software framework, designed and implemented to conduct the performance benchmarking of any storage system of any type of data/payload. It delivers the throughput and latency values for every specific interval for live performance analytics. The SBK supports a variety of storage systems such as local mounted and distributed file systems, local/single node (system) database and distributed database systems, any distributed storage system such as distributed messaging/streaming platforms, object storage systems, and distributed key-value storage systems. In this paper, the SBK is demonstrated with the performance benchmarking of XFS File system, Hadoop Distributed File System (HDFS), and Kafka streaming storage systems.