Abstract
We present a study of six batch-pipeline scientific workloads that are candidates for execution on computational grids. Whereas other studies focus on the behavior of single applications, this study characterizes workloads composed of pipelines of sequential processes that use file storage for communication and also share measurements of the memory, CPU, and I/O requirements of individual components as well as analyses of I/O sharing within complete batches. We conclude with a discussion of the ramifications of these workloads for end-to-end scalability and overall system design.
Author supplied keywords
Cite
CITATION STYLE
Thain, D., Bent, J., Arpaci-Dusseau, A. C., Arpaci-Dusseau, R. H., & Livny, M. (2003). Pipeline and batch sharing in grid workloads. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing (Vol. 2003-January, pp. 152–161). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/HPDC.2003.1210025
Register to see more suggestions
Mendeley helps you to discover research relevant for your work.