TPC's benchmark development model: Making the first industry standard benchmark on big data a success

Abstract

There are many questions to answer and hurdles to overcome before an idea for a benchmark becomes an industry standard. After all technical challenges are solved and a prototype benchmark is created, the question arises on how to turn the prototype into an industry standard benchmark that has broad acceptance in the industry, is credible and sustainable over an extended period of time. The Transaction Processing Performance Council is one of the most recognized industry standard consortia for developing and maintaining industry standard benchmarks. Its philosophy and strict rules have assured acceptance, credibility and sustainability of its benchmarks for the last two decades. In this paper the author shows how the TPC model for developing and maintaining benchmarks can be applied to creating the first industry standard benchmark on Big Data. © 2014 Springer-Verlag Berlin Heidelberg.