The second law of thermodynamics appears solely as a law of probability, entropy as a measure of the probability, and the increase of entropy is equivalent to a statement that more probable events follow less probable ones.

Translated by R. Jones and D.H. Williams, A Survey of Physics: A Collection of Lectures and Essays, The Relation Between Physical Theories (p. 86)