Mathematical Theory of Communication
description: 1948 article by Claude Shannon
81 results
Artificial Intelligence: A Modern Approach
by Stuart Russell and Peter Norvig · 14 Jul 2019 · 2,466pp · 668,761 words
. Shankar, N. (1986). Proof‑Checking Metamathematics. Ph.D. thesis, Computer Science Department, University of Texas at Austin. Shannon, C. E. and Weaver, W. (1949). The Mathematical Theory of Communication. University of Illinois Press. Shannon, C. E. (1950). Programming a computer for playing chess. Philosophical Magazine, 41, 256–275. Shapley, S. (1953b). Stochastic games. PNAS
The Dream Machine: J.C.R. Licklider and the Revolution That Made Computing Personal
by M. Mitchell Waldrop · 14 Apr 2001
, lore, and rules of thumb. Shannon's tacit hope was that the field could be transformed from an art into a science, that a rigorous mathematical theory of communication would provide engineers with the tools to design their systems with assurance. And indeed, the approach he outlined in the re- mainder of his letter
…
oral speech, but also music, the pictorial arts, the theatre, the ballet, and in fact all human behavior." Shannon's fellow mathematicians were enthralled. "A Mathematical Theory of Communication" had created a whole new domain of applied mathematics at a stroke, and suddenly there were a million questions to play with. What was the
…
papers published as a book, with his own article serving as the introduction and with himself billed as full coauthor. Pub- lished in 1949, The Mathematical Theory of Communication by Shannon and Weaver exposed the the- ory to a much wider audience and became such a standard reference in the field that many people
The Codebreakers: The Comprehensive History of Secret Communication From Ancient Times to the Internet
by David Kahn · 1 Feb 1963 · 1,799pp · 532,462 words
the theory formulated after World War II that not only explains cryptanalysis but also extends far beyond. It is called “information theory” or, sometimes, a “mathematical theory of communication.” It deals in general with the mathematical laws that govern systems designed to communicate information. Originating in transmission problems of telephony and telegraphy, it has
…
secrecy systems. I’d worked on communication systems and I was appointed to some of the committees studying cryptanalytic techniques. The work on both the mathematical theory of communications and the cryptology went forward concurrently from about 1941. I worked on both of them together and I had some of the ideas while working
…
1944, he continued polishing them until their publication as separate papers in the abstruse Bell System Technical Journal in 1948 and 1949. Both articles—”A Mathematical Theory of Communication” and “Communication Theory of Secrecy Systems”—present their ideas in densely mathematical form, pocked with phrases like “this inverse must exist uniquely” and expressions like
…
’, press release, M.I.T., February 4, 1957; Shannon, telephone interview, November 27, 1961; David Slepian, interview, October 28, 1962. 744 Shannon’s papers: “A Mathematical Theory of Communication”; Bell System Technical Journal, XXVII (July, 1948), 479-523, (October, 1948), 623-656, reprinted in Bell Telephone System Technical Publications as Monograph B-1598; “Communication
…
use in history is Roberta Wohlstetter’s Pearl Harbor, which fruitfully uses the concepts “signal” and “noise” to help explain the catastrophe. 744 redundancy: “A Mathematical Theory of Communication,” Colin Cherry, On Human Communication (New York: John Wiley & Sons, 1957), 115-120, 180-187; George A. Miller, Language and Communication (New York: McGraw-Hill
…
: adapted from G. T. Guilbaud, What Is Cybernetics?, trans. by Valerie MacKay (New York: Grove Press (Evergreen), 1960), 102. 745 “Two extremes of redundancy”: “A Mathematical Theory of Communication,” §7. 745 Dewey’s count: Relative Frequency of English Speech Sounds (Cambridge, Mass.: Harvard University Press, 1923), 17-19. 746 voiced stops: George K. Zipf
…
), 97-99, 168-169. 760 Borges: “The Library of Babel,” in Labyrinths (New York: New Directions, 1962), 51-58. 760 calculation of redundancy: Shannon, “A Mathematical Theory of Communication” and “Prediction and Entropy of Printed English”; George A. Miller and Elizabeth A. Friedman, “The Reconstruction of Mutilated English Texts,” Information and Control, I (September
…
. H., 692-95, 719, 728 Maru code, 594 Mary, Queen of Scots, 122-24 Maser, 722 Massachusetts Institute of Technology, 982, 983 Mata Hari, 278 “Mathematical Theory of Communication, A,” 744 Mathematics, 207, 240-42, 384, 405, 408-10, 612, 737 Mauborgne, J. O., 321, 401, 563 as Chief Signal Officer, 6, 21, 389
In Our Own Image: Savior or Destroyer? The History and Future of Artificial Intelligence
by George Zarkadakis · 7 Mar 2016 · 405pp · 117,219 words
and stored in the memory. Digital information is a long, long sequence of zeros and ones. Shannon’s breakthrough idea in his seminal paper ‘A Mathematical Theory of Communication’25 was to borrow the probabilistic mathematics of thermodynamics and apply them to the new field of telecommunications. Thermodynamics describes how molecules move as they
…
. Norbert Wiener was the grand visionary of cybernetics. Inspired by mechanical control systems, such as artillery targeting and servomechanisms, as well as Claude Shannon’s mathematical theory of communication and information, he articulated the theory of cybernetics in his landmark book, Cybernetics, of 1948.4 Godfather number two, Claude Shannon, was the genius who
…
(IOOI), and transform them to binary numbers (1001), you get the decimal result 9 (whatever that means …)! 25Shannon, C. E., and Weaver W. (1948), The Mathematical Theory of Communication. Champaign: University of Illinois Press. Shannon co-wrote the book with Warren Weaver, a pioneer in machine translation. 26I am rephrasing here an example given
Life After Google: The Fall of Big Data and the Rise of the Blockchain Economy
by George Gilder · 16 Jul 2018 · 332pp · 93,672 words
February 2013. 5. John Markoff, “How Many Computers to Identify a Cat? 16,000,” New York Times, June 25, 2012. 6. Claude Elwood Shannon, “A Mathematical Theory of Communication,” published in the Bell Systems Technical Journal in October 1948 and available in N. J. A. Sloane, Aaron D. Wyner, edits, Shannon Collected Papers (Piscataway
…
N. Langville and William J. Stewart, eds., Proceedings of the Markov Anniversary Meeting (Altadena, Calif.: Boson Books, 2006), 156–57. 3. Claude Elwood Shannon, “A Mathematical Theory of Communications” in The Bell System Technical Journal, October 1948, section 4, “Graphical Representation of a Markoff Process,” in Collected Papers (Piscataway, N.J.: IEEE Press, 1993
…
”, Proceedings of the IEEE, February 1989. Roberts, Jeff John and Adam Lashinsky, “Hacked: How companies fight back,” Fortune, June 22, 2017. Shannon, Claude Elwood. “A Mathematical Theory of Communications” in The Bell System Technical Journal, October 1948. Tredennick, Nick and Brion Shimamoto, “Embedded Systems and the Microprocessor,” Microprocessor Report (Cahners) April 24, 2000. von
Einstein's Fridge: How the Difference Between Hot and Cold Explains the Universe
by Paul Sen · 16 Mar 2021 · 444pp · 111,837 words
—and come up with one of the greatest scientific insights of the modern age. In 1948, he revealed his thoughts in a paper entitled “A Mathematical Theory of Communication,” published in the Bell Labs technical journal. Less than thirty pages long, Shannon’s paper enabled humans, for the first time, to measure information in
…
to him several times”: From “Shannon: An Interview by Price.” “They never told me”: As quoted in Mind at Play by Soni and Goodman. “A Mathematical Theory of Communication”: From Bell System Technical Journal 27 (1948). “reproducing at one point”: From the above paper. Shannon pointed the similarity out to John von Neumann: This
…
, 224, 225 Maxwell’s description of electromagnetism using, 134 for phyllotaxis, in Turing’s research, 212 Turing’s pattern formation in morphogenesis and, 208–9 “Mathematical Theory of Communication, A” (Shannon), 174–76, 179 mathematics British teaching of, 5 computer calculations in, 171 Gibbs’s education in, 95, 105 Maxwell’s education in, 83
Turing's Cathedral
by George Dyson · 6 Mar 2012
distinction between two alternatives, was defined rigorously by information theorist Claude Shannon in his then-secret Mathematical Theory of Cryptography of 1945, expanded into his Mathematical Theory of Communication of 1948. “Any difference that makes a difference” is how cybernetician Gregory Bateson translated Shannon’s definition into informal terms.2 To a digital computer
…
would not be made public until February 1946. Statistician John Tukey (of Princeton University and Bell Laboratories) provided a direct link to Claude Shannon, whose mathematical theory of communication showed how a computer built from unreliable components could be made to function reliably from one cycle to the next. Jan Rajchman and Arthur Vance
…
.1, 8.2, 9.1, 9.2, 17.1, 18.1, 18.2 Mathematical Foundations of Quantum Mechanics (von Neumann, 1932), 4.1, 15.1 Mathematical Theory of Communication (Shannon, 1948) Mathematical Theory of Cryptography (Shannon, 1945) mathematics advantages of, to IAS education, in Hungary and physics, 4.1, 10.1, 11.1 pure
The Singularity Is Near: When Humans Transcend Biology
by Ray Kurzweil · 14 Jul 2005 · 761pp · 231,902 words
it will require. The mathematician Claude Shannon, often called the father of information theory, defined the basic theory of data compression in his paper "A Mathematical Theory of Communication," The Bell System Technical Journal 27 (July–October 1948): 379–423, 623–56. Data compression is possible because of factors such as redundancy (repetition) and
The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant From Two Centuries of Controversy
by Sharon Bertsch McGrayne · 16 May 2011 · 561pp · 120,899 words
secrecy systems. I’d work on communications systems and I was appointed to some of the committees studying cryptanalytic techniques. The work on both the mathematical theory of communications and the cryptography went forward concurrently from about 1941. I worked on both of them together and I had some of the ideas while working
…
to mathematical statistics. Annals of Statistics (18:3) 1011–16. Sales, Tony. www.codesandciphers.org.uk/aescv.htm. Shannon, Claude E. (July, October 1948) A mathematical theory of communication. Bell System Technical Journal (27) 379–423, 623–56. ———. (1949) Communication theory of secrecy systems. netlab.cs.ucla.edu/wiki/files/Shannon1949.pdf. Acc. March
My Life as a Quant: Reflections on Physics and Finance
by Emanuel Derman · 1 Jan 2004 · 313pp · 101,403 words
of the subsequent advances in communications. Bardeen, Brattain, and Shockley had invented the transistor there in 1947, and Claude Shannon published his landmark paper "A Mathematical Theory of Communication" in the Bell System Technical Journal in 1948. There were fundamental discoveries made, too-Penzias and Wilson won the Nobel Prize for discovering the cosmic
The Alignment Problem: Machine Learning and Human Values
by Brian Christian · 5 Oct 2020 · 625pp · 167,349 words
Emergence
by Steven Johnson · 329pp · 88,954 words
The Deep Learning Revolution (The MIT Press)
by Terrence J. Sejnowski · 27 Sep 2018
How Not to Network a Nation: The Uneasy History of the Soviet Internet (Information Policy)
by Benjamin Peters · 2 Jun 2016 · 518pp · 107,836 words
On Language: Chomsky's Classic Works Language and Responsibility and Reflections on Language in One Volume
by Noam Chomsky and Mitsou Ronat · 26 Jul 2011
Physics in Mind: A Quantum View of the Brain
by Werner Loewenstein · 29 Jan 2013 · 362pp · 97,862 words
The Physics of Wall Street: A Brief History of Predicting the Unpredictable
by James Owen Weatherall · 2 Jan 2013 · 338pp · 106,936 words
From eternity to here: the quest for the ultimate theory of time
by Sean M. Carroll · 15 Jan 2010 · 634pp · 185,116 words
Darwin Among the Machines
by George Dyson · 28 Mar 2012 · 463pp · 118,936 words
Fortune's Formula: The Untold Story of the Scientific Betting System That Beat the Casinos and Wall Street
by William Poundstone · 18 Sep 2006 · 389pp · 109,207 words
Between Human and Machine: Feedback, Control, and Computing Before Cybernetics
by David A. Mindell · 10 Oct 2002 · 759pp · 166,687 words
Crypto: How the Code Rebels Beat the Government Saving Privacy in the Digital Age
by Steven Levy · 15 Jan 2002 · 468pp · 137,055 words
Possible Minds: Twenty-Five Ways of Looking at AI
by John Brockman · 19 Feb 2019 · 339pp · 94,769 words
Chaos: Making a New Science
by James Gleick · 18 Oct 2011 · 396pp · 112,748 words
The Cultural Logic of Computation
by David Golumbia · 31 Mar 2009 · 268pp · 109,447 words
From Counterculture to Cyberculture: Stewart Brand, the Whole Earth Network, and the Rise of Digital Utopianism
by Fred Turner · 31 Aug 2006 · 339pp · 57,031 words
Shape: The Hidden Geometry of Information, Biology, Strategy, Democracy, and Everything Else
by Jordan Ellenberg · 14 May 2021 · 665pp · 159,350 words
Nine Algorithms That Changed the Future: The Ingenious Ideas That Drive Today's Computers
by John MacCormick and Chris Bishop · 27 Dec 2011 · 250pp · 73,574 words
Language and Mind
by Noam Chomsky · 1 Jan 1968
From Bacteria to Bach and Back: The Evolution of Minds
by Daniel C. Dennett · 7 Feb 2017 · 573pp · 157,767 words
The Logician and the Engineer: How George Boole and Claude Shannon Created the Information Age
by Paul J. Nahin · 27 Oct 2012 · 229pp · 67,599 words
Information: A Very Short Introduction
by Luciano Floridi · 25 Feb 2010 · 137pp · 36,231 words
The Demon in the Machine: How Hidden Webs of Information Are Finally Solving the Mystery of Life
by Paul Davies · 31 Jan 2019 · 253pp · 83,473 words
Data Mining: Concepts and Techniques: Concepts and Techniques
by Jiawei Han, Micheline Kamber and Jian Pei · 21 Jun 2011
A Mind at Play: How Claude Shannon Invented the Information Age
by Jimmy Soni and Rob Goodman · 17 Jul 2017 · 415pp · 114,840 words
Data Science for Business: What You Need to Know About Data Mining and Data-Analytic Thinking
by Foster Provost and Tom Fawcett · 30 Jun 2013 · 660pp · 141,595 words
Applied Cryptography: Protocols, Algorithms, and Source Code in C
by Bruce Schneier · 10 Nov 1993
The Big Nine: How the Tech Titans and Their Thinking Machines Could Warp Humanity
by Amy Webb · 5 Mar 2019 · 340pp · 97,723 words
Advances in Financial Machine Learning
by Marcos Lopez de Prado · 2 Feb 2018 · 571pp · 105,054 words
A Devil's Chaplain: Selected Writings
by Richard Dawkins · 1 Jan 2004 · 460pp · 107,712 words
The Scientist as Rebel
by Freeman Dyson · 1 Jan 2006 · 332pp · 109,213 words
Complexity: A Guided Tour
by Melanie Mitchell · 31 Mar 2009 · 524pp · 120,182 words
The Chip: How Two Americans Invented the Microchip and Launched a Revolution
by T. R. Reid · 18 Dec 2007 · 293pp · 91,110 words
Lifespan: Why We Age—and Why We Don't Have To
by David A. Sinclair and Matthew D. Laplante · 9 Sep 2019
The Woman Who Smashed Codes: A True Story of Love, Spies, and the Unlikely Heroine Who Outwitted America's Enemies
by Jason Fagone · 25 Sep 2017 · 592pp · 152,445 words
Understanding Sponsored Search: Core Elements of Keyword Advertising
by Jim Jansen · 25 Jul 2011 · 298pp · 43,745 words
The Organized Mind: Thinking Straight in the Age of Information Overload
by Daniel J. Levitin · 18 Aug 2014 · 685pp · 203,949 words
The Information: A History, a Theory, a Flood
by James Gleick · 1 Mar 2011 · 855pp · 178,507 words
The Chomsky Reader
by Noam Chomsky · 11 Sep 1987
Turing's Vision: The Birth of Computer Science
by Chris Bernhardt · 12 May 2016 · 210pp · 62,771 words
Noam Chomsky: A Life of Dissent
by Robert F. Barsky · 2 Feb 1997
Cognitive Gadgets: The Cultural Evolution of Thinking
by Cecilia Heyes · 15 Apr 2018
The Internet of Us: Knowing More and Understanding Less in the Age of Big Data
by Michael P. Lynch · 21 Mar 2016 · 230pp · 61,702 words
The Idea Factory: Bell Labs and the Great Age of American Innovation
by Jon Gertner · 15 Mar 2012 · 550pp · 154,725 words
The Fractalist
by Benoit Mandelbrot · 30 Oct 2012
The Computer Boys Take Over: Computers, Programmers, and the Politics of Technical Expertise
by Nathan L. Ensmenger · 31 Jul 2010 · 429pp · 114,726 words
Life's Greatest Secret: The Race to Crack the Genetic Code
by Matthew Cobb · 6 Jul 2015 · 608pp · 150,324 words
Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems
by Martin Kleppmann · 17 Apr 2017
The Most Human Human: What Talking With Computers Teaches Us About What It Means to Be Alive
by Brian Christian · 1 Mar 2011 · 370pp · 94,968 words
How to Predict the Unpredictable
by William Poundstone · 267pp · 71,941 words
The Atlantic and Its Enemies: A History of the Cold War
by Norman Stone · 15 Feb 2010 · 851pp · 247,711 words
Making Sense of Chaos: A Better Economics for a Better World
by J. Doyne Farmer · 24 Apr 2024 · 406pp · 114,438 words
How to Create a Mind: The Secret of Human Thought Revealed
by Ray Kurzweil · 13 Nov 2012 · 372pp · 101,174 words
Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems
by Martin Kleppmann · 16 Mar 2017 · 1,237pp · 227,370 words
Why Information Grows: The Evolution of Order, From Atoms to Economies
by Cesar Hidalgo · 1 Jun 2015 · 242pp · 68,019 words
Code: The Hidden Language of Computer Hardware and Software
by Charles Petzold · 28 Sep 1999 · 566pp · 122,184 words
Social Life of Information
by John Seely Brown and Paul Duguid · 2 Feb 2000 · 791pp · 85,159 words
Whiplash: How to Survive Our Faster Future
by Joi Ito and Jeff Howe · 6 Dec 2016 · 254pp · 76,064 words
Deep Utopia: Life and Meaning in a Solved World
by Nick Bostrom · 26 Mar 2024 · 547pp · 173,909 words
Literary Theory for Robots: How Computers Learned to Write
by Dennis Yi Tenen · 6 Feb 2024 · 169pp · 41,887 words
Superbloom: How Technologies of Connection Tear Us Apart
by Nicholas Carr · 28 Jan 2025 · 231pp · 85,135 words
Kitten Clone: Inside Alcatel-Lucent
by Douglas Coupland · 29 Sep 2014 · 124pp · 36,360 words
Novacene: The Coming Age of Hyperintelligence
by James Lovelock · 27 Aug 2019 · 94pp · 33,179 words
A World Without Email: Reimagining Work in an Age of Communication Overload
by Cal Newport · 2 Mar 2021 · 350pp · 90,898 words
Paper Machines: About Cards & Catalogs, 1548-1929
by Markus Krajewski and Peter Krapp · 18 Aug 2011 · 222pp · 74,587 words
The Price of Tomorrow: Why Deflation Is the Key to an Abundant Future
by Jeff Booth · 14 Jan 2020 · 180pp · 55,805 words
Energy and Civilization: A History
by Vaclav Smil · 11 May 2017
Simple Rules: How to Thrive in a Complex World
by Donald Sull and Kathleen M. Eisenhardt · 20 Apr 2015 · 294pp · 82,438 words
Commodore: A Company on the Edge
by Brian Bagnall · 13 Sep 2005 · 781pp · 226,928 words
The End of Accounting and the Path Forward for Investors and Managers (Wiley Finance)
by Feng Gu · 26 Jun 2016
The Future of Ideas: The Fate of the Commons in a Connected World
by Lawrence Lessig · 14 Jul 2001 · 494pp · 142,285 words