Entropy (thermodynamics)

Entropy (thermodynamics)
HirokiSayama · CC BY-SA 4.0 · source
Name	Entropy (thermodynamics)
Units	joule per kelvin (J·K^−1)
Introduced	19th century
Discoverer	Rudolf Clausius

Entropy (thermodynamics) is a central state function in classical thermodynamics that quantifies the dispersal of energy and the availability of work in macroscopic systems. Originating in 19th‑century studies of heat engines and formulated by Rudolf Clausius, entropy connects observable thermodynamic processes to statistical descriptions developed later by figures such as Ludwig Boltzmann and Josiah Willard Gibbs. Entropy plays a pivotal role across fields including James Clerk Maxwell‑inspired thought experiments, the development of Sadi Carnot's cyclic engine analysis, and modern applications spanning Claude Shannon‑influenced information theory and John von Neumann's quantum mechanics.

Definition and Thermodynamic Interpretation

Thermodynamic entropy was introduced by Rudolf Clausius to characterize transformations in heat engines studied by Sadi Carnot and later formalized in the context of the Second Law of Thermodynamics by Lord Kelvin and Émile Clapeyron. For a closed system undergoing a reversible process between states A and B, the change in entropy ΔS is defined by the line integral ΔS = ∫_A^B δQ_rev/T, where δQ_rev references reversible heat transfer as in analyses by James Prescott Joule and William Thomson, later known as Lord Kelvin. Clausius framed entropy to codify irreversibility observed in experiments by Joule and theoretical treatments by Gibbs and Boltzmann, situating entropy as an extensive thermodynamic potential alongside internal energy, pressure, and volume as employed in Nicolas Léonard Sadi Carnot cycle considerations.

Statistical Mechanics Foundation

The statistical foundation of entropy was articulated by Ludwig Boltzmann and later refined by Josiah Willard Gibbs. Boltzmann's famous relation S = k_B ln W links thermodynamic entropy S to the number W of microstates compatible with a macrostate, where k_B is the Boltzmann constant introduced into physics via work by Max Planck. Gibbs generalized to the ensemble formalism used by researchers at institutions like Princeton University and Harvard University, defining entropy for canonical, microcanonical, and grand canonical ensembles. Quantum statistical mechanics, developed by contributors including Erwin Schrödinger, Werner Heisenberg, Paul Dirac, and John von Neumann, replaces classical counting with density matrices and von Neumann entropy, connecting thermodynamic entropy to quantum state populations and eigenvalue spectra as studied in Institute for Advanced Study contexts.

Calculation and Units

Entropy is measured in joules per kelvin (J·K^−1) in the International System of Units, derived from energy units central to experiments by James Prescott Joule and temperature scales set by Anders Celsius and William Thomson, 1st Baron Kelvin. Practical calculation uses state equations like the ideal gas law associated with studies by Emile Clapeyron and Auguste Krönig; for an ideal monoatomic gas, S can be evaluated with Sackur–Tetrode type expressions refined by Hugo Tetrode and Otto Sackur. In chemical thermodynamics, standard molar entropies rely on calorimetric measurements traceable to techniques advanced at institutions such as National Institute of Standards and Technology and summarized in compilations by IUPAC and NIST. In quantum contexts, the von Neumann entropy S = −k_B Tr(ρ ln ρ) uses the density operator ρ as in treatments by John von Neumann and is computed in materials research centers like Bell Labs and Los Alamos National Laboratory.

Second Law and Irreversibility

The Second Law, formalized in works by Rudolf Clausius and Lord Kelvin, states that for isolated systems entropy does not decrease, a principle validated across experiments performed in laboratories affiliated with Royal Society and Académie des sciences. This law underpins the thermodynamic arrow of time discussed in contexts involving Arthur Eddington and cosmological considerations investigated by researchers at University of Cambridge and Princeton University. Irreversible processes analyzed by Ilya Prigogine and others show entropy production due to dissipative mechanisms, friction, and heat flow; such production is central to engineering designs by firms like Siemens and General Electric for heat engines and refrigerators. The Second Law constrains efficiencies of devices following the Carnot limit derived by Sadi Carnot and formalized in later treatments by Rudolf Clausius.

Entropy in Reversible and Irreversible Processes

For reversible processes—idealizations exploited in thermodynamic cycles studied by Sadi Carnot—entropy change depends only on initial and final states and is path independent, enabling exact differentials used in formulations by Josiah Willard Gibbs. Irreversible processes, including real heat transfer, viscous dissipation, and mixing, generate internal entropy as analyzed in nonequilibrium thermodynamics by Ilya Prigogine and explored in experimental programs at Max Planck Society institutes. Linear nonequilibrium relations such as Onsager reciprocal relations, developed by Lars Onsager, relate entropy production rates to fluxes and forces in systems studied in chemical engineering departments at Massachusetts Institute of Technology and ETH Zurich.

Applications and Examples

Entropy informs chemical reaction spontaneity via Gibbs free energy relations used by chemists at Imperial College London and industrial labs at BASF and DuPont; it governs phase equilibria explored by Lev Landau and Pierre-Gilles de Gennes in condensed matter research at institutions like École Normale Supérieure. In materials science, entropy considerations guide alloy thermodynamics investigated at Los Alamos National Laboratory and MIT; in cosmology, entropy arguments feature in studies by Stephen Hawking and Roger Penrose concerning black hole thermodynamics and the entropy of the universe. Engineering applications include refrigeration cycles designed by companies such as Carrier and Trane, and information storage technologies influenced by thermodynamic limits discussed in contexts involving IBM and Intel research labs.

Relation to Information Theory

The bridge between thermodynamic entropy and information-theoretic entropy was articulated by Claude Shannon and enriched by interactions with physics via Leon Brillouin, Rolf Landauer, and Charles H. Bennett. Landauer's principle links erasure of information in computational devices, studied at research centers like Bell Labs and IBM Research, to a minimal thermodynamic entropy increase k_B ln 2 per bit, setting physical limits for computation described in work at Massachusetts Institute of Technology. Quantum information theory developed by Peter Shor and David Deutsch employs von Neumann entropy to quantify entanglement and resource costs in protocols tested in laboratories at Caltech and University of Oxford, tying information measures to thermodynamic behavior in nanoscale systems explored at Harvard University and Stanford University.

Category:Thermodynamics