Stochastic Dynamic Programming-Based Online Algorithm for Energy Management of Integrated Energy Buildings with Electric Vehicles and Flexible Thermal Loads

Abstract

With the rapid development of economy and technology, large-scale integrated energy buildings account for an increasing proportion of urban load. However, the randomness of EV owner behaviors, electricity price and outdoor temperature have brought challenges to the energy management of integrated energy buildings. This paper proposes a stochastic dynamic programming-based online algorithm to address the energy management of integrated energy buildings with electric vehicles and flexible thermal loads under multivariate uncertainties. First, an online energy management framework is established, which is further formulated as a multi-stage stochastic sequential decision-making problem. To address the complexities of the problem, a novel stochastic dynamic programming is employed to develop a distribution-free, computationally efficient, and scalable solution. By using extensive training samples, the algorithm is trained offline to learn how to deal with multivariate uncertainties and get the approximate optimal solution, which no longer depends on intraday forecast information. Numerical tests demonstrate the effectiveness of the proposed algorithm compared with other online algorithms in terms of optimality and computation efficiency.