von Neumann entropy
Generated by GPT-5-miniExpansion Funnel Raw 53 → Dedup 0 → NER 0 → Enqueued 0
| von Neumann entropy | |
|---|---|
| Name | von Neumann entropy |
| Field | Quantum mechanics; Statistical mechanics; Information theory |
| Introduced | 1927 |
| Named after | John von Neumann |
von Neumann entropy Von Neumann entropy is a measure of quantum statistical uncertainty associated with a density operator describing a quantum state. It plays a central role in the mathematical formulation of quantum mechanics, statistical mechanics, and quantum information theory, and influences developments in thermodynamics, quantum computing, and condensed matter physics.
Definition
The von Neumann entropy of a quantum state represented by a density operator ρ on a Hilbert space H is defined as S(ρ) = −Tr(ρ log ρ). The definition generalizes the classical Shannon entropy concept introduced by Claude Shannon and connects with the spectral decomposition studied by David Hilbert-era mathematicians and later formalized by John von Neumann. The trace operation appears in the work of Emmy Noether and Michael Atiyah-related algebraic formulations, while the logarithm relates to operator functional calculus developed following contributions by John von Neumann and Paul Dirac.
Properties
Von Neumann entropy is nonnegative, unitarily invariant under transformations by operators associated with Paul Dirac's algebraic formalism, and achieves its maximum for the maximally mixed state on a finite-dimensional Hilbert space, paralleling results in Ludwig Boltzmann's statistical reasoning and Josiah Willard Gibbs's ensembles. It is concave as a function of the density operator, a property exploited in proofs by researchers influenced by Richard Feynman and Lev Landau. The entropy obeys subadditivity and strong subadditivity, the latter proven using techniques connected to convexity results studied by Elliott Lieb and Mary Beth Ruskai, and later applied in contexts influenced by Alexei Kitaev and Peter Shor.
Relation to Classical Entropy
Von Neumann entropy reduces to classical Shannon entropy for density operators that are diagonal in a fixed orthonormal basis, a correspondence that mirrors the classical limit in formulations by Niels Bohr and mathematical foundations elaborated by John von Neumann and Norbert Wiener. The quantum-to-classical transition also relates to decoherence studies involving Hendrik Casimir-related vacuum effects and to information-theoretic inequalities paralleling those investigated by Claude Shannon and Andrey Kolmogorov in probability theory. Comparisons with Gibbs entropy highlight ensemble equivalences invoked in analyses by Ludwig Boltzmann and Josiah Willard Gibbs.
Applications in Quantum Information
Von Neumann entropy is central to quantifying entanglement in bipartite systems examined by Albert Einstein-inspired debates and later operationalized in protocols developed by Charles Bennett, Gilles Brassard, and Peter Shor. It appears in the statements of quantum coding theorems by Benjamin Schumacher and underlies capacities of quantum channels studied by Alexander Holevo and Igor Devetak. It informs resource theories used by researchers following John Preskill and Seth Lloyd and appears in error-correction analyses linked to Shor's and Andrew Steane's work. The entropy also guides interpretations of black hole thermodynamics influenced by Stephen Hawking and Jacob Bekenstein.
Calculation and Examples
Computing von Neumann entropy typically proceeds by diagonalizing ρ to obtain eigenvalues {λ_i} and evaluating −Σ λ_i log λ_i; such spectral methods trace back to linear algebra advances by Carl Friedrich Gauss and spectral theory developed further by David Hilbert and Erhard Schmidt. Example systems include pure states (zero entropy), maximally mixed states (entropy log d for d-dimensional Hilbert space), and thermal Gibbs states characterized by a Hamiltonian H as ρ ∝ e^{-βH}, a construction central to works of Josiah Willard Gibbs and Ludwig Boltzmann. Practical examples arise in spin chains studied by Kenneth Wilson and Philip Anderson and in cavity QED setups explored by Roy Glauber.
Operational Interpretations
Operationally, von Neumann entropy quantifies compressibility in quantum source coding, as formalized in the Schumacher quantum coding theorem connected to Benjamin Schumacher and follow-ups by Charles Bennett. It bounds achievable rates in entanglement distillation and formation protocols studied by Bennett and John Smolin, and it appears in trade-offs for quantum channel capacities analyzed by Alexander Holevo and Igor Devetak. Thermodynamically, it enters work-extraction and fluctuation theorem contexts influenced by Rolf Landauer and Christopher Jarzynski.
Extensions and Generalizations
Generalizations include Rényi entropies and Tsallis entropies introduced by Alfréd Rényi and Constantino Tsallis, which interpolate between different operational regimes and have been applied in contexts explored by Elliott Lieb and Olivier Lieb-related inequalities. Conditional and relative entropy variants, such as quantum relative entropy studied by Kullback-Leibler contemporaries and formalized in quantum settings by H. Araki, underpin quantum hypothesis testing and channel discrimination problems pursued by Peter Shor and Amit Winter. Recent extensions connect to resource theories and noncommutative geometry inspired by Alain Connes and to holographic entropy proposals advanced by Juan Maldacena and Mark Van Raamsdonk.