What are some pre-19th or pre-20th century sources on information theory? Do they exist?

  • 1
    $\begingroup$ No. Information theory (in Shannon's sense) is a 20th century invention that could not even be formulated before Kolmogorov's formalization of probability in 1933. Etymonline says that the word started to be applied to broadcast signals from 1937, Shannon published in 1948. $\endgroup$
    – Conifold
    Commented Sep 12, 2019 at 20:39
  • 3
    $\begingroup$ There is something in philosophy called semantic information theory that can, arguably, be traced to earlier times. But not by that name and it has little to do with Shannon's theory. $\endgroup$
    – Conifold
    Commented Sep 12, 2019 at 20:53
  • 1
    $\begingroup$ Prior to Shannon, in a different context but still in the 20th C, Fisher, in his Theory of Statistical Estimation wrote about ""the whole of the information which a sample provides" in the 1920s. This is today called Fisher Information and the Fisher Information Metric. $\endgroup$
    – nwr
    Commented Sep 12, 2019 at 22:02
  • 1
    $\begingroup$ @NickR Nyquist's 1924 "Certain Factors Affecting Telegraph Speed" is also prior to Shannon, but I'm looking for pre-20th cen., at least. $\endgroup$
    – Geremia
    Commented Sep 12, 2019 at 22:50
  • 2
    $\begingroup$ Etaoin shrdlu and the Morse code perhaps? That is, letter frequency as a means for optimizing the composition of messages. $\endgroup$
    – sand1
    Commented Sep 13, 2019 at 13:46


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.