With the emergence of large-scale storage systems that separate metadata management from file read/write operations, and with requests targetting metadata account for over 80% of the total number of I/O requests, metadata management has become an interesting research problem on its own. When designing a metadata server cluster, the partitioning of the metadata among the servers is of critical importance for maintaining efficient metadata operations and balanced load distribution across the cluster. We propose a dynamic programming method combined with binary search to solve the partitioning problem. With theoretical analysis and extensive experiments, we show that our algorithm finds the partitioning that minimizes load imbalance among servers and maximize efficiency of metadata operations. © 2010 IEEE.
CITATION STYLE
Wu, J. J., Liu, P., & Chung, Y. C. (2010). Metadata partitioning for large-scale distributed storage systems. In Proceedings - 2010 IEEE 3rd International Conference on Cloud Computing, CLOUD 2010 (pp. 212–219). https://doi.org/10.1109/CLOUD.2010.24
Mendeley helps you to discover research relevant for your work.