An influential discipline involving the transmission of messages over channels where noise is present. Invented by ClaudeShannon at BellLabs in the 1940s (see http://galaxy.ucsd.edu/new/external/shannon.pdf for the original paper) it has been applied in endeavors as diverse as
	* thermodynamics
	* theoretical computer science
	* CommunicationsTheory
	* theoretical biology
	* learning theory & NeuralNetworks
	* CostEstimation

Also 
* WhatIsEntropy
* http://masi.cscs.lsa.umich.edu/~crshalizi/notebooks/information-theory.html


----
CategoryExternalLink CategoryMath