Sanov`s theorem

In words, the probability of drawing an atypical distribution is proportional to the KL distance from the true distribution to the atypical one; in the case that we consider a set of possible atypical distributions, there is a dominant atypical distribution, given by the information projection. ...
Found on http://en.wikipedia.org/wiki/Sanov`s_theorem
No exact match found