Estimation and Validation of Markov Models

This chapter describes approaches to estimate a Markov model transition matrices from simulation data that has been mapped to a discrete state space, and approaches to validate whether this estimate is consistent with the simulation data at hand.