Performance Evaluation of NoSQL Systems using YCSB in a Resource Austere Environment

Abstract

NoSQL is a database used to store high volume of data. NoSQL databases are horizontally scalable, distributed, open source and non-relational. High performance is a major concern for practically every data-driven system. NoSQL databases claim to deliver faster performance than the popular Relational database systems in various use cases, most notably those involving huge data. While this is always the case, it should be understood that not all NoSQL databases are created alike where performance is concerned. This being the case, IT professionals works hard to ensure that the database they select is optimized for the success of their application use cases. Such selection can be made in-house, based on tests with academic database benchmarks. We present the Yahoo! Cloud Serving Benchmark (YCSB) framework, with the goal of facilitating performance comparisons of the new generation of NoSQL databases in an environment where resources are limited. Unlike many previous benchmarks that considered a cluster or distributed system that NoSQL is known for, we limit out experiment to a single PC assuming a cluster with a single node or a distributed system with a single PC. We define a core set of benchmarks and report results for four widely used systems: MongoDB, ElasticSearch, Redis, and OrientDB implementation.