Multiple DAGs workflow scheduling algorithm based on reinforcement learning in cloud computing

Abstract

To the problem of scheduling multiple DAG workflow applications with multiple priorities submitted at different times in cloud computing environment, a novel workflow scheduling algorithm based on reinforcement learning is proposed in this paper. In the workflow scheduling scheme, the number of VMs in resources pool is defined as state space; the runtime of user task is defined as immediate reward, and then interactive with cloud computing environment to obtain the optimization policy. We use real cloud workflow to test the proposed scheme. Experiment results show the proposed scheme not only can solve the fairness of scheduling multiple DAGs with the same priority level submitted at different times, but also can ensure that the execution of the DAGs with higher priorities cannot be influenced by the DAGs with lower priorities. More importantly, the proposed scheme can reasonably schedule multiple DAGs with multiple priorities and improve utilization rate of resources better.