Just as entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible to interpret the information carried by a message as essentially the negative of its entropy, and the negative logarithm of its probability. That is, the more probable the message, the less information it gives. Cliches, for example, are less illuminating than great poems.


The Human Use Of Human Beings: Cybernetics And Society (ed. Da Capo Press, 1988) - ISBN: 9780786752263

Norbert Wiener Quotes

Just as entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible...

Just as entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible...

Just as entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible...

Just as entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible...