Towards high performance and high availability clusters of archived stream

Abstract

Some burgeoning web applications, such as web search engines, need to track, store and analyze massive real-time users' access logs with high availability of 24*7. The traditional high availability approaches towards generalpurpose transaction applications are always not efficient enough to store these high-rate insertion-only archived streams. This paper presents an integrated approach to store these archived streams in a database cluster and recover it quickly. This approach is based on our simplified replication protocol and high performance data loading and query strategy. The experiments show that our approach can reach efficient data loading and query and get shorter recovery time than the traditional database cluster recovery methods. © Springer-Verlag Berlin Heidelberg 2007.