Empirical measure

In probability theory, an empirical measure is a random measure arising from a particular realization of a (usually finite) sequence of random variables. The precise definition is found below. Empirical measures are relevant to mathematical statistics. In probability theory, an empirical measure is a random measure arising from a particular realization of a (usually finite) sequence of random variables. The precise definition is found below. Empirical measures are relevant to mathematical statistics. The motivation for studying empirical measures is that it is often impossible to know the true underlying probability measure P {displaystyle P} . We collect observations X 1 , X 2 , … , X n {displaystyle X_{1},X_{2},dots ,X_{n}} and compute relative frequencies. We can estimate P {displaystyle P} , or a related distribution function F {displaystyle F} by means of the empirical measure or empirical distribution function, respectively. These are uniformly good estimates under certain conditions. Theorems in the area of empirical processes provide rates of this convergence. Let X 1 , X 2 , … {displaystyle X_{1},X_{2},dots } be a sequence of independent identically distributed random variables with values in the state space S with probability distribution P. Definition Properties Definition To generalize this notion further, observe that the empirical measure P n {displaystyle P_{n}} maps measurable functions f : S → R {displaystyle f:S o mathbb {R} } to their empirical mean, In particular, the empirical measure of A is simply the empirical mean of the indicator function, Pn(A) = Pn IA. For a fixed measurable function f {displaystyle f} , P n f {displaystyle P_{n}f} is a random variable with mean E f {displaystyle mathbb {E} f} and variance 1 n E ( f − E f ) 2 {displaystyle {frac {1}{n}}mathbb {E} (f-mathbb {E} f)^{2}} .