Evolution of Ideas on Entropy

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Our stated goal is to develop a general theory of thermodynamics that we may apply to stochastic processes, but what is thermodynamics? At the mathematical level, thermodynamics is the calculus of entropy. The inequality of the second law forms the starting point for a large number of mathematical relationships that are written among the set of primary variables, entropy, energy, volume and number of particles, and a number of defined functions based on the primary set. The mathematical framework of classical thermodynamics is established as soon as the second law is formulated in mathematical form. The subsequent development of statistical mechanics left this framework intact, while making the connection to the microscopic structure of matter. Even as the basic mathematical framework did not change, the revolution lead by Gibbs introduced a statistical view of entropy that opened an entirely new viewpoint. Starting with Shannon’s work on information theory and Jaynes’s formulation of maximum entropy has now escaped from the realm of physics to invade other fields. In this chapter we review the evolution of ideas on entropy, from the classical view, to Gibbs, Shannon, and Jaynes, and cover the background that gives rise to our development in the chapters that follow.

Original languageEnglish (US)
Title of host publicationUnderstanding Complex Systems
PublisherSpringer Verlag
Pages1-21
Number of pages21
DOIs
StatePublished - Jan 1 2018

Publication series

NameUnderstanding Complex Systems
ISSN (Print)1860-0832
ISSN (Electronic)1860-0840

Fingerprint

Entropy
Thermodynamics
Statistical mechanics
Information theory
Random processes
Physics

All Science Journal Classification (ASJC) codes

  • Software
  • Computational Mechanics
  • Artificial Intelligence

Cite this

Matsoukas, T. (2018). Evolution of Ideas on Entropy. In Understanding Complex Systems (pp. 1-21). (Understanding Complex Systems). Springer Verlag. https://doi.org/10.1007/978-3-030-04149-6_1
Matsoukas, Themis. / Evolution of Ideas on Entropy. Understanding Complex Systems. Springer Verlag, 2018. pp. 1-21 (Understanding Complex Systems).
@inbook{943a27a64a934210806a4478ad22a768,
title = "Evolution of Ideas on Entropy",
abstract = "Our stated goal is to develop a general theory of thermodynamics that we may apply to stochastic processes, but what is thermodynamics? At the mathematical level, thermodynamics is the calculus of entropy. The inequality of the second law forms the starting point for a large number of mathematical relationships that are written among the set of primary variables, entropy, energy, volume and number of particles, and a number of defined functions based on the primary set. The mathematical framework of classical thermodynamics is established as soon as the second law is formulated in mathematical form. The subsequent development of statistical mechanics left this framework intact, while making the connection to the microscopic structure of matter. Even as the basic mathematical framework did not change, the revolution lead by Gibbs introduced a statistical view of entropy that opened an entirely new viewpoint. Starting with Shannon’s work on information theory and Jaynes’s formulation of maximum entropy has now escaped from the realm of physics to invade other fields. In this chapter we review the evolution of ideas on entropy, from the classical view, to Gibbs, Shannon, and Jaynes, and cover the background that gives rise to our development in the chapters that follow.",
author = "Themis Matsoukas",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-030-04149-6_1",
language = "English (US)",
series = "Understanding Complex Systems",
publisher = "Springer Verlag",
pages = "1--21",
booktitle = "Understanding Complex Systems",
address = "Germany",

}

Matsoukas, T 2018, Evolution of Ideas on Entropy. in Understanding Complex Systems. Understanding Complex Systems, Springer Verlag, pp. 1-21. https://doi.org/10.1007/978-3-030-04149-6_1

Evolution of Ideas on Entropy. / Matsoukas, Themis.

Understanding Complex Systems. Springer Verlag, 2018. p. 1-21 (Understanding Complex Systems).

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Evolution of Ideas on Entropy

AU - Matsoukas, Themis

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Our stated goal is to develop a general theory of thermodynamics that we may apply to stochastic processes, but what is thermodynamics? At the mathematical level, thermodynamics is the calculus of entropy. The inequality of the second law forms the starting point for a large number of mathematical relationships that are written among the set of primary variables, entropy, energy, volume and number of particles, and a number of defined functions based on the primary set. The mathematical framework of classical thermodynamics is established as soon as the second law is formulated in mathematical form. The subsequent development of statistical mechanics left this framework intact, while making the connection to the microscopic structure of matter. Even as the basic mathematical framework did not change, the revolution lead by Gibbs introduced a statistical view of entropy that opened an entirely new viewpoint. Starting with Shannon’s work on information theory and Jaynes’s formulation of maximum entropy has now escaped from the realm of physics to invade other fields. In this chapter we review the evolution of ideas on entropy, from the classical view, to Gibbs, Shannon, and Jaynes, and cover the background that gives rise to our development in the chapters that follow.

AB - Our stated goal is to develop a general theory of thermodynamics that we may apply to stochastic processes, but what is thermodynamics? At the mathematical level, thermodynamics is the calculus of entropy. The inequality of the second law forms the starting point for a large number of mathematical relationships that are written among the set of primary variables, entropy, energy, volume and number of particles, and a number of defined functions based on the primary set. The mathematical framework of classical thermodynamics is established as soon as the second law is formulated in mathematical form. The subsequent development of statistical mechanics left this framework intact, while making the connection to the microscopic structure of matter. Even as the basic mathematical framework did not change, the revolution lead by Gibbs introduced a statistical view of entropy that opened an entirely new viewpoint. Starting with Shannon’s work on information theory and Jaynes’s formulation of maximum entropy has now escaped from the realm of physics to invade other fields. In this chapter we review the evolution of ideas on entropy, from the classical view, to Gibbs, Shannon, and Jaynes, and cover the background that gives rise to our development in the chapters that follow.

UR - http://www.scopus.com/inward/record.url?scp=85065848715&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065848715&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-04149-6_1

DO - 10.1007/978-3-030-04149-6_1

M3 - Chapter

AN - SCOPUS:85065848715

T3 - Understanding Complex Systems

SP - 1

EP - 21

BT - Understanding Complex Systems

PB - Springer Verlag

ER -

Matsoukas T. Evolution of Ideas on Entropy. In Understanding Complex Systems. Springer Verlag. 2018. p. 1-21. (Understanding Complex Systems). https://doi.org/10.1007/978-3-030-04149-6_1