Optimal control of Markov chains with constraints

A problem of optimal control of Markov chain with finite state space is considered. We consider a non-stationary finite horizon problem with constraints, given as a set of inequalities. Basing on recent results on existence of optimal solution we suggest to use the dual approach to optimization and thereby an approach to effective numerical algorithms. The approach is illustrated by numerical examples.