In probability theory and information theory, the mutual information or (formerly) transinformation of two random variables is a measure of the variables` mutual dependence. The most common unit of measurement of mutual information is the bit. If the log base 2 is used, the units of mutual information are the bit. Intuitively, mutual information ....