communication theory : a measure of the efficiency of a system (such as a code or a language) in transmitting information, being equal to the logarithm of the number of different messages that can be sent by selection from the same set of symbols and thus indicating the degree of initial uncertainty that can be resolved by any one message