Pyxis+: A scalable and adaptive data replication framework

Abstract

Data replication can improve the performance and availability for applications, and when it is employed by big data applications, it has to solve the challenges posed by big data applications, i.e., offering scalability and varying consistency levels. In this paper, we design and implement a data replication framework Pyxis+, whereby replication-aware applications can be developed in a rapid and convenient way. Pyxis+ allows the applications to register different consistency levels and automatically switches the consistency levels according to the change of requirements and performance. Meanwhile, on the basis of the consistency guarantees, Pyxis+ takes advantage of the consistent hashing technology to improve the scalability of data access. Simulation experimental results show that Pyxis+ can obtain relatively stable throughputs and response time by adding or removing replica managers while facing the increase of user requests. © Springer International Publishing 2013.