Maxwell's demon information theory

As the dictionary entry above shows, maxwells demon is no more than a simple idea. The demon s seductive quality makes it appealing to physical scientists, engineers, computer scientists, biologists, psychologists, and historians and philosophers of science. In 1871, james clerk maxwell proposed a thought experiment. Pynchons solution pynchon uses maxwells demon to synthesize the fields of thermodynamics and information theory together into a mysterious unity.

Entropy, information, computing in 1990, maxwells demon has been the subject of renewed and increased interest by numerous. Information theory studies the quantification, storage, and communication of information. If the demon and thermal system combined are a hamiltonian system, then the intended operation of the demon must compress the overall phase space, in violation of liouvilles theorem. It was originally proposed by claude shannon in 1948 to find fundamental limits on signal processing and communication operations such as data compression, in a landmark paper. Mar 03, 2020 over 150 years after the famous scottish scientist james clerk maxwell first introduced the idea, the concept of maxwell s demon continues to perplex physicists and information scientists. The most successful exorcism of maxwells demon is smoluchowskis 1912 observation that thermal fluctuations would likely disrupt the operation of any molecularscale demonic machine. A physical thought experiment demonstrating how just the possession of information might in principle have thermodynamic consequences was established in 1929 by leo szilard, in a refinement of the famous maxwell s demon scenario consider maxwell s setup, but with only a single gas particle in a box. Maxwellian demons are mechanical devices that carry out measurements on a thermodynamic system, manipulate the system so as to extract work from it, and erase all records of the measurement outcomes. Fascination with the demon persisted throughout the development of statistical and quantum physics, information theory, and computer scienceand linkages have been established between maxwells demon and each of these disciplines. Yet it has challenged some of the best scientific minds, and its extensive literature spans thermodynamics, statistical physics, information theory, cybernetics, the limits of computing, biological sciences and the history and philosophy of science. A physical thought experiment demonstrating how just the possession of information might in principle have thermodynamic consequences was established in 1929 by leo szilard, in a refinement of the famous maxwells demon scenario.

The concept of maxwells demon is named after a james clerk maxwell. Jun 23, 2015 in a rather different context, the recent intensive research on maxwells demona feedback controller that utilizes information of individual moleculeshave led to a unified theory of. Maxwells demon in biochemical signal transduction with. Entropy in thermodynamics and information theory wikipedia. Dec 18, 2018 maxwells demon is smart enough to open the door at the exact time a high energy molecule approaches to let it pass to the other side.

Over 150 years after the famous scottish scientist james clerk maxwell first introduced the idea, the concept of maxwells demon continues to perplex physicists and information scientists. As individual gas molecules approach the door, the demon quickly opens and shuts the door so that only fast molecules are. Nov 14, 2010 an image of maxwell s demon extracting energy from the thermal motion of particles in escher s waterfall an artistic paradox in which water flows up a waterfall, instead of down. We may replace the demon by an automatic device with a magic eye which opens the trap door at convenient. Its a thought experiment which demonstrates that the concept of entropy from information theory and the concept of entropy from thermodynamics are really about the same thing, and connected in. An image of maxwells demon extracting energy from the thermal motion of particles in eschers waterfall an artistic paradox in which water flows up a waterfall, instead of down. Different demons maxwells device described above is an example of what is called a temperature demon, because it creates a temperature difference that can. Exorcism of maxwells demon university of pittsburgh. James clerk maxwells idea for violating the second law of thermodynamics. Fascination with the demon persisted throughout the development of statistical and quantum physics, information theory, and computer science and linkages have been established. This thought experiment has provoked debate and theoretical work on the relation between thermodynamics and information theory extending to the. Entropy, information, computing in 1990, maxwell s demon has been the subject of renewed and increased interest by numerous.

Maxwell was one amongst a number of researchers in the developing field of thermodynamics who was interested in seeking an understanding of thermal phenomena in terms of an underlying atomic physics. Here, we present the history of the demon and a variety of interesting consequences of the second law of thermodynamics, mainly in quantum mechanics, but also in the theory of gravity. Here the history of the demon and a variety of interesting consequences of the second law of thermodynamics are presented, mainly in quantum mechanics, but also in the theory of gravity. In his 1867 thought experiment, maxwells demon, james clerk maxwell attempted to show that thermodynamics is not strictly reducible to mechanics.

Over 150 years after the famous scottish scientist james clerk maxwell first introduced the idea, the concept of maxwell s demon continues to perplex physicists and information scientists. Maxwells demon was the invention of scottish mathematician and theoretical physicist james clerk maxwell, who wanted to contradict the second law of. Most information theoretic exorcisms of maxwell s demon employ principles that have been derived from the assumption of the second law of thermodynamics, so that the protection of the second law ultimately depends upon assuming its truth. Well, it turns out that living organisms are packed full of maxwell demons. Efforts to exorcise maxwell s demon have focused on the information processing a demon supposedly must do. Maxwells demon was first mentioned in a letter written to tait in 1867. This means that the average speed of the molecules is a certain amount depending on the temperature. Efforts to exorcise maxwells demon have focused on the information processing a demon supposedly must do. Shannon and warren weaver, the mathematical theory of communication university of illinois press, urbana, illinois, 1949. Jul 25, 2018 viewers like you help make pbs thank you. Fascination with the demon persisted throughout the development of statistical and quantum physics, information theory, and computer scienceand linkages have been established between maxwell s demon and each of these disciplines. If your theory is found to be against the second law of thermodynamics i can.

Fascination with the demon persisted throughout the development of statistical and quantum physics, information theory, and computer science, and links have been established between maxwell s demon and each of these disciplines. As individual gas molecules approach the door, the demon quickly opens and. A later tradition sought to exorcise maxwells demon by assessing the entropic cost of the demons processing of information. By detecting the positions and velocities of gas molecules in two neighboring chambers and using that information to time the opening and closing of a trapdoor that separates them, a tiny, intelligent being could, in theory, sort molecules by velocity. The paradox a character who has played an important role in the history of physics, particularly in thermodynamics and information, is maxwells demon. Maxwell s demon is a thought experiment created by the physicist james clerk maxwell in 1867 in which he suggested how the second law of thermodynamics might hypothetically be violated. Maxwell s demon was born in 1867 and still thrives in modern physics. Eric lutz is a professor of theoretical physics at the university of erlangen nuremberg in erlangen, germany. It was later unveiled to the public in maxwells book on thermodynamics titled theory of heat, published in 1872.

Entropy, classical and quantum information, computing retains many of the seminal papers that appeared in the first edition, including the original thoughts of james clerk maxwell and william thomson. Maxwells demon was an instant source of fascination and led to many important results, including the development of a thermodynamic theory of information. It was originally proposed by claude shannon in 1948 to find fundamental limits on signal processing and communication operations such as data compression, in a landmark paper titled a mathematical theory of communication. Information theory is a branch of applied mathematics. Suppose that you have a box filled with a gas at some temperature. If the supernatural demon knows which half of the box the particle is in equivalent to a. Since then this being, dubbed maxwells demon by lord kelvin, has been an active topic of. Connecting the problem of maxwell s demon with that of brownian motion, smoluchowski wrote that in order to. Jul 23, 2007 maxwell s demon was born in 1867 and still thrives in modern physics. Dec 30, 2015 maxwells demon was an instant source of fascination and led to many important results, including the development of a thermodynamic theory of information. Maxwells demon demonstration turns information into energy. Maxwells demon was the invention of scottish mathematician and theoretical physicist james clerk maxwell, who wanted to contradict the. Laplacess demon and maxwells demon, the demons of classical. The physics of informationprocessing derived a considerable variety of attempts to understand how maxwells demon could function.

He plays important roles in clarifying the connections between two theories. Maxwell s demon was the invention of scottish mathematician and theoretical physicist james clerk maxwell, who wanted to contradict the second law of thermodynamics although the name was given to. A little demon sits by a tiny trapdoor in the wall it looks at oncoming gas molecules, and depending on their speeds it opens or closes the trapdoor. In a letter that he wrote in december 1867 to his friend peter guthrie tait, the physicist james clerk maxwell 18311879 described how the action of a being controlling a shutter on a microscopic hole between two gas containers a and b could apparently violate the second law of thermodynamics. This second law normally says that heat flows only from hot to cold. The resolution of the maxwells demon paradox linked thermodynamics with information theory through information erasure principle. Maxwells demon is a thought experiment created by the physicist james clerk maxwell in. Maxwells demon is an imaginary creature that the mathematician james clerk maxwell created to contradict the second law of thermodynamics. Less is more for maxwells demon in quantum heat engines. In the thought experiment, a demon controls a small door between two chambers of gas. Video also covers reconciling the information theory of entropy. About 120 years ago, james clerk maxwell introduced his now legendary hypothetical demon as a challenge to the integrity of the second law of thermodynamics.

As more and more particles accumulate on the same side, the entropy decreases. Maxwells demon, hypothetical intelligent being or a functionally equivalent device. Essentially, this law states that heat does not naturally flow from a cool body to a warmer. The experiment first appeared in an exchange of letters between maxwell and peter tait around 1867.

Consider maxwells setup, but with only a single gas particle in a box. Maxwells demon is smart enough to open the door at the exact time a high energy molecule approaches to let it pass to the other side. Maxwells demon converts information into energy live science. But a particularly important insight came in the 1960s from the ibm researcher rolf landauer. Concluding chapters explore the associations between information theory, the uncertainty principle, and physical limits of observation, in addition to problems related to computing, organizing information, and inevitable errors. One of the most important contributions to this work was the account provided by marian smoluchowski, professor at the jagiellone university in krakow. It is also shown that there is an entropy symmetry between the. The concept seeks to explain what happens when two objects are subjected to different degrees of heat. What maxwells demon does is allow heat to flow backwards reverse the arrow of time, if you like by using information about the molecular speed. Maxwells demon 2 entropy, classical and quantum information. It was imagined by james clerk maxwell in 1871, to illustrate the possibility of violating the second law of thermodynamics. Information processing and thermodynamic entropy stanford.

This problem has led to very interesting links between physics, information theory and the theory of computation from concepts of information entropy brillouin, szilard, shannon to reversible computing landauer, bennett. If the demon and thermal system combined are a hamiltonian system, then the intended operation of the demon must compress the overall phase space, in violation of liouville s theorem. The demons seductive quality makes it appealing to physical scientists, engineers, computer scientists, biologists, psychologists, and historians and philosophers of science. Connecting the problem of maxwells demon with that of brownian motion, smoluchowski wrote that in order to. Maxwells demon is a thought experiment created by the physicist james clerk maxwell in 1867 in which he suggested how the second law of thermodynamics might hypothetically be violated. This made scientists crazy for at least a century until information theory came into play. Most informationtheoretic exorcisms of maxwells demon employ principles that have been derived from the assumption of the second law of thermodynamics, so that the protection of the second law ultimately depends upon assuming its truth. Maxwell s demon is an imaginary creature that the mathematician james clerk maxwell created to contradict the second law of thermodynamics. Fascination with the demon persisted throughout the development of statistical and quantum physics, information theory, and computer science, and links have been established between maxwells demon and each of these disciplines. Over years ago, james clerk maxwell introduced his hypothetical demon as a challenge to the scope of the second law of thermodynamics. Maxwells demon and the entropy cost of information. Nov 15, 2010 maxwell s demon was the invention of scottish mathematician and theoretical physicist james clerk maxwell, who wanted to contradict the second law of thermodynamics although the name was given to.

It s a thought experiment which demonstrates that the concept of entropy from information theory and the concept of entropy from thermodynamics are really about the same thing, and connected in a very physical way. Fascination with the demon persisted throughout the development of statistical and quantum physics, information theory, and computer. Since then this being, dubbed maxwell s demon by lord kelvin, has been an active topic of. Mar 12, 2018 the concept of maxwells demon is named after a james clerk maxwell. He realized that the extra work that can be extracted from the demons action has a cost that. Maxwell s demon was first mentioned in a letter written to tait in 1867. A discussion of the negentropy principle of information introduces brillouins renowned examination of maxwells demon.

It is shown that the entropy of the demon increases during the expansion step, due to the decoupling of the molecule from the measurement information. In his 1867 thought experiment, maxwells demon, james clerk maxwell. The concept that a demon opens door to fastmoving particles making them move to one chamber consequently making it hotter than the other chamber is still being widely. Operational derivation of boltzmann distribution with maxwell. We present an analysis of szilards onemolecule maxwells demon, including a detailed entropy accounting, that suggests a general theory of the entropy cost of information.

Maxwell s demon in 1867 james clerk maxwell suggested that a sentient being capable of observing molecular motions might be able to bring about a violation of the second law of thermodynamics through a systematic sorting of molecules. Maxwells demon, hypothetical intelligent being or a functionally equivalent device capable of detecting and reacting to the motions of individual molecules. Fascination with the demon persisted throughout the development of statistical and quantum physics, information theory, and. The later area obtained the technical term entropy as a metaphor borrowed from its classical origin in thermodynamics. In a rather different context, the recent intensive research on maxwells demona feedback controller that utilizes information of individual moleculeshave led to a unified theory of. This problem has led to very interesting links between physics, information theory and the theory of. Maxwells demon was born in 1867 and still thrives in modern physics.

785 715 1527 907 1338 1270 556 442 1082 251 174 1002 1606 1607 1074 1147 160 330 54 1140 1166 764 1376 657 318 969 159 169 800 1539 1347 1413 381 318 1240 761 990 73 232 869 1158 1417 894