| von Neumann entropy | |
|---|---|
| Name | von Neumann entropy |
| Unit | dimensionless (natural units) |
| Symbols | S(ρ) |
von Neumann entropy
Von Neumann entropy is a measure of the information content of a quantum state represented by a density matrix ρ. It generalizes the Shannon entropy of information theory to quantum mechanics and plays a central role in quantum information theory and the statistical description of many-body systems. Introduced by John von Neumann in the 1930s, it quantifies mixedness, entanglement, and thermodynamic entropy in quantum settings.
The von Neumann entropy S(ρ) of a density operator ρ on a Hilbert space H is defined as S(ρ) = −Tr(ρ log ρ). For a state with spectral decomposition ρ = ∑_i p_i |ψ_i⟩⟨ψ_i|, the entropy reduces to S(ρ) = −∑_i p_i log p_i, directly analogous to the Gibbs entropy and the Shannon entropy for a probability distribution {p_i}. The logarithm is typically taken in base e (natural units) or base 2 (bits). The definition requires that ρ is a positive semi-definite, trace-class operator with Tr ρ = 1, as employed in the algebraic formulation of quantum statistical mechanics used at Los Alamos National Laboratory and in foundational work by Ludwig Boltzmann and Josiah Willard Gibbs.
Von Neumann entropy quantifies the degree of uncertainty or mixedness of a quantum ensemble prepared by agents using laboratory apparatus in quantum optics or solid-state physics experiments. For a pure state (ρ = |ψ⟩⟨ψ|) the entropy is zero, reflecting maximal knowledge about the system. For bipartite systems on H_A ⊗ H_B, the entropy of the reduced state S(ρ_A) characterizes entanglement for pure global states and underpins protocols such as quantum teleportation and superdense coding. In quantum cryptography, bounds derived from von Neumann entropy are used in security proofs for protocols like BB84. The quantity bridges quantum statistical mechanics and information theory, linking the thermodynamic concept of thermodynamic entropy to operational measures used in quantum computing and experiments by groups at IBM, Google and university laboratories such as MIT and University of Oxford.
Von Neumann entropy satisfies several key properties: non-negativity (S(ρ) ≥ 0), unitary invariance S(UρU†) = S(ρ) for U ∈ U(H), and subadditivity S(ρ_{AB}) ≤ S(ρ_A) + S(ρ_B). The stronger strong subadditivity of quantum entropy (SSA), proven by Lieb and Ruskai and central to quantum information, states S(ρ_{ABC}) + S(ρ_B) ≤ S(ρ_{AB}) + S(ρ_{BC}). Equality conditions relate to quantum Markov chains and recovery maps such as the Petz recovery map. The von Neumann entropy is concave in ρ and plays a role in entropy inequalities used in proofs of capacities: the Holevo bound limits classical information extractable from quantum ensembles, and the Lindblad inequality and Araki–Lieb inequality bound entropic differences. The entropy is additive for product states and extensive in thermodynamic limits addressed in quantum statistical mechanics and rigorous studies at institutions like the Princeton University Centre for Theoretical Science.
Computing S(ρ) requires diagonalizing ρ to obtain eigenvalues {p_i}. For finite-dimensional systems this reduces to standard linear algebra methods used in numerical linear algebra packages in research groups at Los Alamos National Laboratory and industry. Examples include: (1) a qubit mixed state ρ = (1/2)(I + r·σ) has entropy S(ρ) = h((1+|r|)/2) where h is the binary entropy; (2) thermal (Gibbs) states ρ = e^{-βH}/Z yield S(ρ) = β⟨H⟩ + log Z, connecting to the canonical ensemble; (3) maximally mixed states ρ = I/d achieve maximal entropy log d. In many-body systems one computes entanglement entropy for subsystems, often numerically via density matrix renormalization group (DMRG) or tensor network methods developed by researchers at Caltech and Perimeter Institute.
Von Neumann entropy underlies the statistical description of equilibrium and non-equilibrium quantum systems. In quantum thermodynamics it appears in formulations of the second law of thermodynamics for quantum processes and in resource-theoretic treatments of work extraction and thermal operations. In condensed matter physics, scaling of entanglement entropy distinguishes phases: area laws versus logarithmic violations characterize critical systems described by conformal field theory and studied in experiments on ultracold atoms at facilities like CERN spin-off collaborations. In black hole thermodynamics and quantum gravity research, von Neumann entropy of quantum fields is central to discussions of the black hole information paradox and the Ryu–Takayanagi formula in the AdS/CFT correspondence, linking entanglement to spacetime geometry. Operationally, entropy governs capacities of quantum channels (quantum capacity, classical capacity) and entanglement measures used in quantum error correction and fault-tolerant quantum computing architectures pursued by Microsoft and national labs.
Several generalizations extend von Neumann entropy to broader contexts: Rényi entropies S_α(ρ) parameterize a family used in entanglement spectrum analysis and quantum criticality studies; the quantum relative entropy D(ρ||σ) serves as a divergence underpinning quantum hypothesis testing and the quantum Stein's lemma; conditional entropy S(A|B) and mutual information I(A:B) quantify correlations and information flow. Operator algebraic generalizations treat states on C*-algebras or von Neumann algebras in algebraic quantum field theory, with modular theory by Tomita–Takesaki and mathematical results by Haag and others. Recent work connects entropy production and fluctuation theorems in open quantum systems described by Lindblad equation dynamics and experiments in quantum optics and mesoscopic devices.
Category:Quantum information theory Category:Quantum statistical mechanics Category:John von Neumann