An overview on the adaptive dynamic programming based urban city traffic signal optimal control

This paper surveys the algorithms and application of a hot spot adaptive dynamic programming (ADP). Some key research issues, including convergence, stability, and coordination of adaptive dynamic programming, are extensively analyzed. The problems of urban city traffic signal control and current control schemes are introduced, as well as the present and potential applications of adaptive dynamic programming in the optimization of traffic signal control both in surface way intersections and freeway ramp metering systems.