A Health-Aware Hybrid Reinforcement–Predictive Control Framework for Sustainable Energy Management in Photovoltaic–Electric Vehicle Microgrids

Abstract

The increasing electrification of mobility within smart cities has accelerated the need for intelligent energy management strategies that jointly address cost, emissions, and battery health. This study develops a health-aware hybrid reinforcement–predictive energy manager (H-RPEM) designed for photovoltaic–electric vehicle (PV-EV) microgrids. The proposed controller unifies model-based predictive optimisation with adaptive reinforcement learning to achieve both short-term operational efficiency and long-term asset preservation. A comprehensive dataset of solar generation, EV charging behaviour, and stochastic load profiles was employed to train and validate the hybrid control framework under realistic operating conditions. Quantitative results indicate that the proposed H-RPEM controller achieves an 18.7% reduction in total operating cost and a 22.5% decrease in carbon emissions, whilst maintaining the battery state-of-health above 0.95 throughout a 24 h operational cycle. When benchmarked against standard predictive control, the hybrid strategy converges 30–40 episodes faster and delivers a 25% improvement in reward stability, demonstrating enhanced robustness and learning efficiency. The results confirm that H-RPEM achieves robust and balanced performance across economic, environmental, and technical domains, establishing it as a scalable and health-conscious control solution for next-generation smart city microgrids.