Probabilities are summaries of knowledge that is left behind when information is transferred to a higher level of abstraction.

Probabilistic Reasoning in Intelligent Systems: Network of Plausible, Inference