Aspects of entropy in classical and in quantum physics

Abstract

Entropy has played an essential role in the history of physics. Its mathematical definition and applications have changed over time till today. In this paper, we first review the historical evolution of these various points of view, from the thermodynamic definition to information entropy from Shannon in classical physics, up to the modern concept of Neumann’s quantum entropy. As a specific example, we consider entanglement entropy and compare the phase space approach in classical physics to the Hilbert space approach in quantum physics in simple model systems. We derive a general expression for the entanglement entropy of fermions and bosons in arbitrary partitions of Hilbert space, valid beyond the thermodynamic limit. Next, we compare thermodynamic heat engines with quantum heat engines. Finally, we proceed to the more general concept of quantum (computational) complexity and argue, using the concept of entanglement entropy, that the Heisenberg time in classically chaotic systems coincides with the time when maximal complexity is reached in the quantum case for systems with all-all interactions.