Online Learning Control for Hybrid Electric Vehicle

Improvements in hybrid electric vehicle (HEV) fuel economy and emissions heavily depend on an efficient energy management strategy (EMS).However,the uncertainty of future driving conditions generally cannot be easily tackled in EMS design.Most existing EMSs act upon fixed parameters and cannot adapt to varying driving conditions.Therefore,they usually fail to fully explore the potential of these advanced vehicles.In this paper,a novel EMS design procedure based on neural dynamic programming (NDP) is proposed.The NDP is a generic online learning algorithm,which combines stochastic dynamic programming (SDP) and the temporal difference (TD) method.Instead of computing the utility function and optimal control actions through Bellman equations,the NDP algorithm uses two neural networks to approximate them.The weights of these neural networks are updated online by the TD method.It avoids the high computational cost that SDP suffers from and is suitable for real-time implementation.The main advantages of NDP EMS is that it does not rely on prior information related to future driving conditions,and can self-tune with a wide variance in operating conditions.The NDP EMS has been applied to 'Qianghua-I',a prototype of a parallel HEV,using a revolving drum test bench for verification.Experiment results illustrate the potential of the proposed EMS in terms of fuel economy and in keeping state of charge (SOC) deviations at a low level.The proposed research ensures the optimality of NDP EMS,as well as real-time applicability.