An Online Correction Predictive EMS for A Hybrid Electric Tracked Vehicle based on Dynamic Programming and Reinforcement Learning

Energy management strategy is critical in the development of hybrid electric vehicles. It is used to improve fuel economy and sustain battery state of charge by splitting the power demand to different power sources while satisfying various physical constraints and vehicle performance simultaneously. However, it is challenging to achieve an optimal control performance due to the complexity of the hybrid powertrain, the time-varying constraints, and stochastic of the load power. Focusing on these problems, this paper presents an online correction predictive energy management (OCPEM) strategy for a hybrid electric tracked vehicle based on dynamic programming (DP) and reinforcement learning (RL). First, a multi-time-scale prediction method is proposed to realize the short-period future driving cycle prediction. Then, the DP algorithm is applied to obtain the local control policy based on the short-period future driving cycle. The RL algorithm is combined with the fuzzy logic controller to optimize the control policy by eliminating the influence of imprecise prediction. Finally, the simulations are conducted in Matlab/Simulink to evaluate the control effectiveness and adaptability of the proposed method. The results indicate that the fuel economy of the proposed OCPEM is improved by 4% compared with the original predictive energy management and achieve 90.51% of that of the DP benchmark.