SHYAM: A system for autonomic management of virtual clusters in hybrid clouds

Abstract

While the public cloud model has been vastly explored over the last few years to face the demand for large-scale distributed computing capabilities, many organizations are now focusing on the hybrid cloud model, where the classic scenario is enriched with a private (company owned) cloud – e.g., for the management of sensible data. In this work, we propose SHYAM, a software layer for the autonomic deployment and configuration of virtual clusters on a hybrid cloud. This system can be used to face the temporary (or permanent) lack of computational resources on the private cloud, allowing cloud bursting in the context of big data applications. We firstly provide an empirical evaluation of the overhead introduced by SHYAM provisioning mechanism. Then we show that, although the execution time is significantly influenced by the intercloud bandwidth, an autonomic off-premise provisioning mechanism can significantly improve the application performance.