TRANSKRIP 🔗
WEBVTT
00:00:00.400 --> 00:00:09.130
welcome to sleepy facts about the universe a
00:00:12.869 --> 00:00:15.810
sealed box of ordinary air contains more distinct
00:00:15.810 --> 00:00:18.390
microscopic arrangements than there are atoms
00:00:18.390 --> 00:00:21.710
in the observable universe this simple physical
00:00:21.710 --> 00:00:24.469
reality forms the starting point for a careful
00:00:24.469 --> 00:00:27.149
examination of what entropy actually measures
00:00:27.149 --> 00:00:31.079
far from being a vague tendency toward visual
00:00:31.079 --> 00:00:34.390
messiness or decay Entropy is a precise count
00:00:34.390 --> 00:00:36.969
of how many hidden microscopic configurations
00:00:36.969 --> 00:00:40.350
can produce the exact same macroscopic condition.
00:00:41.049 --> 00:00:44.390
This episode explores the three connected but
00:00:44.390 --> 00:00:47.429
distinct ways scientists and mathematicians understand
00:00:47.429 --> 00:00:51.109
entropy. The statistical view of Ludwig Boltzmann,
00:00:51.250 --> 00:00:54.590
the classical thermodynamic view of Rudolf Clausius,
00:00:54.829 --> 00:00:58.149
and the information theoretic view of Kord Shannon.
00:00:58.560 --> 00:01:01.700
By looking at familiar examples like melting
00:01:01.700 --> 00:01:06.010
ice, gas expanding into a vacuum, and a shuffled
00:01:06.010 --> 00:01:09.370
deck of cards. The discussion builds a usable
00:01:09.370 --> 00:01:12.709
mental model of why states of greater multiplicity
00:01:12.709 --> 00:01:16.430
are overwhelmingly more likely to occur and persist.
00:01:17.359 --> 00:01:20.700
Some questions sound simple until you try to
00:01:20.700 --> 00:01:24.280
answer them. I kept returning to one question
00:01:24.280 --> 00:01:27.680
while working on this episode. Why do we so often
00:01:27.680 --> 00:01:31.310
reduce entropy to a synonym for disorder? when
00:01:31.310 --> 00:01:34.170
its actual physical meaning is so much more interesting?
00:01:35.069 --> 00:01:37.829
Understanding entropy as a measure of hidden
00:01:37.829 --> 00:01:40.810
possibilities rather than visible chaos completely
00:01:40.810 --> 00:01:44.450
changes how you look at ordinary phenomena, from
00:01:44.450 --> 00:01:47.310
the steady pressure of air in a room to the slow
00:01:47.310 --> 00:01:53.569
melting of an ice cube. A sealed box of ordinary
00:01:53.569 --> 00:01:56.769
air contains more distinct microscopic arrangements
00:01:56.769 --> 00:01:59.489
than there are atoms in the observable universe.
00:02:00.780 --> 00:02:03.739
Those arrangements are raised to powers so large
00:02:03.739 --> 00:02:06.640
that no conventional notation can hold them.
00:02:06.819 --> 00:02:11.610
The question is not why entropy matters. The
00:02:11.610 --> 00:02:14.250
question is why we ever imagined it was something
00:02:14.250 --> 00:02:18.319
as small as disorder. Imagine a sealed metal
00:02:18.319 --> 00:02:21.860
box, about the size of a shoebox, sitting on
00:02:21.860 --> 00:02:25.990
a table at room temperature. The air inside presses
00:02:25.990 --> 00:02:28.610
gently against the walls with a pressure you
00:02:28.610 --> 00:02:31.889
could measure. The temperature feels utterly
00:02:31.889 --> 00:02:36.590
ordinary. Nothing about this box suggests drama.
00:02:37.430 --> 00:02:42.590
It does not hum, glow or tremble. Yet beneath
00:02:42.590 --> 00:02:45.469
this calm surface, billions upon billions of
00:02:45.469 --> 00:02:49.270
molecules are in constant motion. They collide,
00:02:49.509 --> 00:02:52.650
rebound and stream through every possible path
00:02:52.650 --> 00:02:56.270
the space allows. The pressure and temperature
00:02:56.270 --> 00:02:58.689
you could record with simple instruments give
00:02:58.689 --> 00:03:02.400
you no hint of this hidden activity. They describe
00:03:02.400 --> 00:03:06.439
what physicists call a macroscopic state. That
00:03:06.439 --> 00:03:09.419
is a condition defined by a handful of measurable
00:03:09.419 --> 00:03:12.759
quantities like pressure, temperature, volume,
00:03:12.979 --> 00:03:16.870
and density. But the macroscopic state is not
00:03:16.870 --> 00:03:21.939
the whole story. It is a summary. It is a compression
00:03:21.939 --> 00:03:25.969
of something far more intricate. The question
00:03:25.969 --> 00:03:28.610
this episode begins with is simple and precise.
00:03:30.000 --> 00:03:32.699
How many different microscopic arrangements of
00:03:32.699 --> 00:03:35.340
those molecules could produce exactly this same
00:03:35.340 --> 00:03:38.870
ordinary appearance? And what does it mean that
00:03:38.870 --> 00:03:42.189
the number is not merely large, but astronomically,
00:03:42.289 --> 00:03:46.830
almost incomprehensibly large? This is the physical
00:03:46.830 --> 00:03:52.259
meaning of entropy, not disorder, not chaos,
00:03:52.539 --> 00:03:58.210
not some vague tendency toward decay. Entropy
00:03:58.210 --> 00:04:01.629
is a measure of how many microscopic ways a particular
00:04:01.629 --> 00:04:05.729
visible condition can be realized. The reason
00:04:05.729 --> 00:04:08.210
this matters, and the reason it appears across
00:04:08.210 --> 00:04:11.449
physics and information theory, is that states
00:04:11.449 --> 00:04:14.189
with enormously greater multiplicity are overwhelmingly
00:04:14.189 --> 00:04:17.750
more likely to occur and to persist than states
00:04:17.750 --> 00:04:21.589
with only a few. States with enormously greater
00:04:21.589 --> 00:04:24.170
multiplicity have enormously more compatible
00:04:24.170 --> 00:04:28.250
microscopic arrangements. The box of gas looks
00:04:28.250 --> 00:04:32.470
ordinary because it is ordinary. It is ordinary
00:04:32.470 --> 00:04:35.189
because the number of hidden arrangements that
00:04:35.189 --> 00:04:37.930
produce this appearance swamps the number that
00:04:37.930 --> 00:04:40.230
would produce anything noticeably different.
00:04:41.199 --> 00:04:44.319
To make this
Load full transcript
concrete, we need to distinguish
00:04:44.319 --> 00:04:48.439
two levels of description. The macroscopic state
00:04:48.439 --> 00:04:51.959
is what you see and measure. The microscopic
00:04:51.959 --> 00:04:55.699
state or microstate specifies the position and
00:04:55.699 --> 00:04:59.639
momentum of every single molecule. For the sealed
00:04:59.639 --> 00:05:03.000
box of fixed pressure and temperature, the number
00:05:03.000 --> 00:05:05.339
of microstates that would produce exactly these
00:05:05.339 --> 00:05:07.980
readings is not a number you could write down
00:05:07.980 --> 00:05:10.519
in ordinary notation without using scientific
00:05:10.519 --> 00:05:14.439
shorthand. It is roughly 10 raised to a power
00:05:14.439 --> 00:05:18.420
in the tens of trillions. Every one of those
00:05:18.420 --> 00:05:23.000
microstates is, in principle, different. One
00:05:23.000 --> 00:05:25.819
molecule might be near the left wall moving upward.
00:05:26.790 --> 00:05:29.730
Another might be near the center moving downward.
00:05:30.819 --> 00:05:33.879
Swap their positions, reverse their directions,
00:05:34.160 --> 00:05:37.540
and the macroscopic readings stay the same. The
00:05:38.060 --> 00:05:41.980
system looks unchanged, but the microscopic reality
00:05:41.980 --> 00:05:44.540
has shifted to another of its countless compatible
00:05:44.540 --> 00:05:49.350
configurations. Now, if we wanted to quantify
00:05:49.350 --> 00:05:52.910
this hidden abundance directly, we might simply
00:05:52.910 --> 00:05:57.180
count the microstates. But here we encounter
00:05:57.180 --> 00:06:01.069
a problem. Suppose you have two separate boxes
00:06:01.069 --> 00:06:04.120
of gas. each with its own enormous number of
00:06:04.120 --> 00:06:08.420
compatible arrangements box 1 has some number
00:06:08.420 --> 00:06:11.160
of microstates for its macroscopic condition
00:06:11.160 --> 00:06:16.290
box 2 has another if you bring them together
00:06:16.290 --> 00:06:19.649
as a single isolated system the total number
00:06:19.649 --> 00:06:22.730
of possible combined microstates is the product
00:06:22.730 --> 00:06:27.170
of the two numbers every microstate of the first
00:06:27.170 --> 00:06:30.449
can pair with every microstate of the second
00:06:31.629 --> 00:06:34.689
But in physics, we want quantities that add when
00:06:34.689 --> 00:06:42.089
systems combine. Mass adds. Volume adds. Energy
00:06:42.089 --> 00:06:46.410
adds. If entropy was simply the raw count of
00:06:46.410 --> 00:06:49.670
microstates, combining two systems would require
00:06:49.670 --> 00:06:53.129
multiplying numbers so vast they become unusable.
00:06:53.350 --> 00:06:56.720
The resulting entropy would not behave like other
00:06:56.720 --> 00:07:00.550
physical properties. Imagine trying to describe
00:07:00.550 --> 00:07:03.730
the combined population of two cities by multiplying
00:07:03.730 --> 00:07:06.629
the number of possible arrangements of each person.
00:07:06.810 --> 00:07:10.389
The number would explode beyond any practical
00:07:10.389 --> 00:07:14.569
meaning. The Austrian physicist Ludwig Boltzmann,
00:07:14.689 --> 00:07:19.129
in work published in 1877, found a way around
00:07:19.129 --> 00:07:23.069
this problem. His insight was to define entropy
00:07:23.069 --> 00:07:25.750
as proportional to the logarithm of the number
00:07:25.750 --> 00:07:29.980
of compatible microstates. In the standard notation,
00:07:30.439 --> 00:07:33.839
this is s equals k times the logarithm of w.
00:07:34.769 --> 00:07:39.110
Here, w is the multiplicity, the count of microstates.
00:07:39.930 --> 00:07:43.730
And k is a constant of proportionality now called
00:07:43.730 --> 00:07:47.819
Boltzmann's constant. The logarithm is not a
00:07:47.819 --> 00:07:51.889
decorative mathematical flourish. It is the essential
00:07:51.889 --> 00:07:54.329
tool that solves the problem of combining systems.
00:07:55.379 --> 00:07:59.019
The logarithm of a product is the sum of the
00:07:59.019 --> 00:08:03.439
logarithms. So when two independent systems are
00:08:03.439 --> 00:08:06.540
brought together, their microstate counts multiply,
00:08:06.899 --> 00:08:11.040
but their entropies add. This makes entropy an
00:08:11.040 --> 00:08:13.839
extensive quantity that behaves like other familiar
00:08:13.839 --> 00:08:18.459
physical properties. Without the logarithm, entropy
00:08:18.459 --> 00:08:22.310
would not add when systems combine. It would
00:08:22.310 --> 00:08:26.519
explode into unmanageable products. The logarithm
00:08:26.519 --> 00:08:29.180
compresses astronomical counts into quantities
00:08:29.180 --> 00:08:33.710
we can compare, combine. and measure this is
00:08:33.710 --> 00:08:37.070
the statistical mechanical view of entropy it
00:08:37.519 --> 00:08:41.159
is entropy as multiplicity made manageable but
00:08:41.700 --> 00:08:44.419
boltzmann's formula did not emerge in isolation
00:08:44.419 --> 00:08:48.750
it connects to two other ways of thinking about
00:08:48.750 --> 00:08:51.850
entropy that developed in parallel and in dialogue
00:08:51.850 --> 00:08:56.070
with it the episode must move between these three
00:08:56.070 --> 00:08:58.970
views carefully because they are connected but
00:08:58.970 --> 00:09:02.700
they are not casual synonyms treating them as
00:09:02.700 --> 00:09:05.799
identical is one of the most common sources of
00:09:05.799 --> 00:09:10.860
confusion the second view is thermodynamic in
00:09:11.179 --> 00:09:14.759
classical thermodynamics which predates the explicit
00:09:14.759 --> 00:09:17.580
molecular picture and was developed by figures
00:09:17.580 --> 00:09:20.500
like rudolph clausius and william thompson in
00:09:20.500 --> 00:09:23.940
the mid 19th century entropy is defined through
00:09:23.940 --> 00:09:26.440
heat and temperature in reversible processes
00:09:26.440 --> 00:09:31.110
for a reversible change the infinitesimal change
00:09:31.110 -->
00:09:34.519
in entropy is the infinitesimal heat transferred
00:09:34.519 --> 00:09:37.419
divided by the temperature at which the transfer
00:09:37.419 --> 00:09:41.730
occurs. Integrating this gives the entropy difference
00:09:41.730 --> 00:09:46.090
between two states. This definition does not
00:09:46.090 --> 00:09:49.210
mention molecules, multiplicities or logarithms.
00:09:49.879 --> 00:09:53.179
It operates entirely at the macroscopic level,
00:09:53.379 --> 00:09:56.720
tracking how heat moves and how efficiently work
00:09:56.720 --> 00:10:00.690
can be extracted. Yet the statistical view explains
00:10:00.690 --> 00:10:05.450
why this macroscopic definition works. Consider
00:10:05.450 --> 00:10:07.889
what happens when heat enters a solid at its
00:10:07.889 --> 00:10:11.870
melting point. The temperature does not rise.
00:10:12.330 --> 00:10:15.639
The energy goes into loosening the molecular
00:10:15.639 --> 00:10:19.870
structure. Each molecule, previously vibrating
00:10:19.870 --> 00:10:22.669
about a fixed position in the crystalline lattice,
00:10:22.990 --> 00:10:26.730
begins to explore a vastly larger range of positions.
00:10:28.110 --> 00:10:31.090
The number of compatible microstates expands
00:10:31.090 --> 00:10:34.769
dramatically. The thermodynamic bookkeeping,
00:10:34.950 --> 00:10:38.330
heat divided by temperature, tracks this microscopic
00:10:38.330 --> 00:10:42.370
expansion of possibilities. When heat enters
00:10:42.370 --> 00:10:45.009
a system at constant temperature, it increases
00:10:45.009 --> 00:10:47.769
the accessible microstates by expanding the range
00:10:47.769 --> 00:10:50.250
of molecular motions compatible with the energy
00:10:50.250 --> 00:10:53.960
budget. The thermodynamic definition and the
00:10:53.960 --> 00:10:56.830
statistical definition describe the same physical
00:10:56.830 --> 00:11:00.570
situation from different vantage points. One
00:11:00.570 --> 00:11:03.049
view looks from the outside with thermometers
00:11:03.049 --> 00:11:06.950
and calorimeters. The other looks from the inside,
00:11:07.110 --> 00:11:11.659
counting configurations. The third view is information
00:11:11.659 --> 00:11:17.509
-theoretic. In 1948, the mathematician Quad Shannon
00:11:17.509 --> 00:11:20.750
published a paper defining entropy in the context
00:11:20.750 --> 00:11:24.610
of communication. Shannon was concerned with
00:11:24.610 --> 00:11:27.169
how much uncertainty is present in a message
00:11:27.169 --> 00:11:31.309
source. He asked how unpredictable the next symbol
00:11:31.309 --> 00:11:35.820
in a sequence might be. His formula, h equals
00:11:35.820 --> 00:11:38.559
minus the sum over all possible states of the
00:11:38.559 --> 00:11:41.279
probability of each state times the logarithm
00:11:41.279 --> 00:11:44.159
of that probability, measures this uncertainty.
00:11:45.009 --> 00:11:48.490
When all microstates are equally probable as
00:11:48.490 --> 00:11:50.789
they are in the simple statistical mechanical
00:11:50.789 --> 00:11:54.629
picture, Shannon's formula reduces directly to
00:11:54.629 --> 00:11:58.830
Boltzmann's. The formal similarity is not accidental.
00:11:59.990 --> 00:12:03.210
Shannon explicitly noted the connection to Boltzmann's
00:12:03.210 --> 00:12:07.169
work, and the term entropy in information theory
00:12:07.169 --> 00:12:11.200
was chosen deliberately. To see why this connection
00:12:11.200 --> 00:12:14.039
is natural, imagine a message source that can
00:12:14.039 --> 00:12:17.820
produce only one symbol. There is no uncertainty.
00:12:18.690 --> 00:12:23.120
You always know what comes next. The information
00:12:23.120 --> 00:12:27.230
entropy is zero. Now imagine a source that can
00:12:27.230 --> 00:12:30.090
produce any of a thousand symbols with equal
00:12:30.090 --> 00:12:35.600
probability. The uncertainty is high. The information
00:12:35.600 --> 00:12:40.169
entropy is large. This is the same counting logic
00:12:40.169 --> 00:12:44.990
as the box of gas. More possibilities means more
00:12:44.990 --> 00:12:48.830
entropy. The difference is that information entropy
00:12:48.830 --> 00:12:52.019
counts possibilities in a message. while physical
00:12:52.019 --> 00:12:54.740
entropy counts possibilities in a material system
00:12:54.740 --> 00:12:58.539
constrained by energy, volume, and other conserved
00:12:58.539 --> 00:13:02.509
quantities. The three views illuminate each other,
00:13:02.610 --> 00:13:06.450
but they have distinct domains and distinct procedures
00:13:06.450 --> 00:13:10.159
for measurement. With these three views established,
00:13:10.500 --> 00:13:12.940
we can turn to the concrete examples that build
00:13:12.940 --> 00:13:16.100
intuition for what entropy actually does in physical
00:13:16.100 --> 00:13:21.899
processes. The first is melting ice. Place a
00:13:21.899 --> 00:13:24.700
cube of ice in a glass of water at room temperature
00:13:24.700 --> 00:13:27.799
and watch the boundary between solid and liquid.
00:13:28.889 --> 00:13:32.110
Picture the sharp edge of the ice cube softening
00:13:32.110 --> 00:13:36.399
as the crystalline lattice gives way. The molecules
00:13:36.399 --> 00:13:38.919
at the surface break free from their fixed positions
00:13:38.919 --> 00:13:43.340
and begin to slide past one another. The temperature
00:13:43.340 --> 00:13:46.559
at that boundary stays fixed at 0 degrees Celsius
00:13:46.559 --> 00:13:51.080
until the last crystal disappears. During this
00:13:51.080 --> 00:13:53.980
phase transition, Energy is entering the system
00:13:53.980 --> 00:13:57.659
as heat from the surrounding water. But the temperature
00:13:57.659 --> 00:14:02.990
does not rise. Where does this energy go? It
00:14:02.990 --> 00:14:05.549
goes into breaking the crystalline bonds that
00:14:05.549 --> 00:14:08.509
hold water molecules in fixed positions in the
00:14:08.509 --> 00:14:12.980
ice lattice. In the solid, each molecule vibrates
00:14:12.980 --> 00:14:16.750
about a definite location. The number of distinct
00:14:16.750 --> 00:14:19.409
arrangements compatible with the solid's energy
00:14:19.409 --> 00:14:23.710
and volume is relatively constrained. The solid's
00:14:23.710 --> 00:14:26.519
rigidity. comes from the constraint of the lattice.
00:14:27.399 --> 00:14:30.759
In the liquid, molecules move past one another
00:14:30.759 --> 00:14:34.850
and explore far more positions. The number of
00:14:34.850 --> 00:14:37.570
compatible microstates expands dramatically.
00:14:38.519 --> 00:14:41.799
The liquid's fluidity comes from the vastly larger
00:14:41.799 --> 00:14:44.799
number of arrangements available to each molecule.
00:14:45.620 --> 00:14:48.419
The entropy increases because the liquid state
00:14:48.419 --> 00:14:51.320
has vastly more accessible microscopic configurations
00:14:51.320 --> 00:14:53.879
than the solid state at the same temperature.
00:14:54.950 --> 00:14:57.769
This is why melting is spontaneous at room temperature.
00:14:58.110 --> 00:15:01.480
The system moves toward a condition of enormously
00:15:01.480 --> 00:15:05.309
greater multiplicity. The heat absorbed during
00:15:05.309 --> 00:15:08.149
melting divided by the melting temperature gives
00:15:08.149 --> 00:15:12.259
the thermodynamic entropy increase. The statistical
00:15:12.259 --> 00:15:15.360
view tells us what this means in molecular terms.
00:15:15.759 --> 00:15:19.289
The molecules have gained access to a vastly
00:15:19.289 --> 00:15:23.440
larger territory of possible arrangements. Return
00:15:23.440 --> 00:15:27.159
to the sealed box from the beginning. Now imagine
00:15:27.159 --> 00:15:30.059
a thin partition dividing it in half with gas
00:15:30.059 --> 00:15:33.879
on one side and vacuum on the other. Remove the
00:15:33.879 --> 00:15:37.710
partition. The gas rushes to fill the entire
00:15:37.710 --> 00:15:43.389
volume. No heat enters from outside. No work
00:15:43.389 --> 00:15:47.080
is done against a piston. The internal energy
00:15:47.080 --> 00:15:51.440
stays essentially the same. Yet the entropy increases.
00:15:52.559 --> 00:15:57.200
Why? Because each molecule now has access to
00:15:57.200 --> 00:16:01.080
a larger region of space. the number of possible
00:16:01.080 --> 00:16:03.379
positions for every molecule has multiplied.
00:16:04.279 --> 00:16:07.960
So the total number of compatible microstates
00:16:07.960 --> 00:16:12.139
has multiplied. If the volume doubles, the number
00:16:12.139 --> 00:16:14.460
of positional arrangements for each molecule
00:16:14.460 --> 00:16:19.519
doubles. The multiplicity W grows by a huge factor.
00:16:19.820 --> 00:16:23.669
The logarithm turns this multiplicative increase
00:16:23.669 --> 00:16:28.269
into an additive entropy change. The thermodynamic
00:16:28.269 --> 00:16:33.700
calculation confirms this. For an ideal gas expanding
00:16:33.700 --> 00:16:37.460
into a vacuum, the entropy increase depends on
00:16:37.460 --> 00:16:41.929
the ratio of final to initial volume. The statistical
00:16:41.929 --> 00:16:46.110
view makes the meaning transparent. More space
00:16:46.110 --> 00:16:50.509
means more places to be. More places to be means
00:16:50.509 --> 00:16:54.870
more microstates. More microstates means more
00:16:54.870 --> 00:16:59.159
multiplicity. The expansion is spontaneous because
00:16:59.159 --> 00:17:02.179
the uniform filled state has overwhelmingly more
00:17:02.179 --> 00:17:04.980
microscopic realizations than the state with
00:17:04.980 --> 00:17:08.920
all molecules confined to one side. The third
00:17:08.920 --> 00:17:13.069
example is the shuffled deck of cards. Here we
00:17:13.069 --> 00:17:16.089
must be especially careful because this is where
00:17:16.089 --> 00:17:19.529
popular explanations of entropy often go astray.
00:17:20.549 --> 00:17:23.470
The deck is useful because it makes the counting
00:17:23.470 --> 00:17:26.349
of possibilities visible in a way that molecules
00:17:26.349 --> 00:17:30.130
are not. You can see the difference between one
00:17:30.130 --> 00:17:33.309
sorted arrangement and the vast number of shuffled
00:17:33.309 --> 00:17:37.720
arrangements. A new deck arrives in a known order.
00:17:38.970 --> 00:17:44.769
Suits are sequenced. Values ascend. There is
00:17:44.769 --> 00:17:49.039
exactly one such sorted arrangement. Shuffle
00:17:49.039 --> 00:17:51.670
thoroughly. and you obtain one of approximately
00:17:51.670 --> 00:17:56.730
8 times 10 to the 67 possible arrangements. That
00:17:56.730 --> 00:17:59.589
number dwarfs the number of atoms in the observable
00:17:59.589 --> 00:18:03.990
universe. The sorted deck is exceptionally constrained.
00:18:05.140 --> 00:18:09.299
The shuffled deck is typical. This illustrates
00:18:09.299 --> 00:18:13.069
the dominance of common states. There are vastly
00:18:13.069 --> 00:18:15.849
more shuffled configurations than sorted ones,
00:18:16.109 --> 00:18:20.059
so a random process will almost certainly produce
00:18:20.059 --> 00:18:23.619
a shuffled appearance. In this limited sense,
00:18:23.940 --> 00:18:26.880
the deck helps build intuition for multiplicity.
00:18:27.480 --> 00:18:32.240
But the deck is only an analogy. And the seed
00:18:32.240 --> 00:18:35.099
explicitly warns against treating it as physically
00:18:35.099 --> 00:18:39.279
equivalent to molecular systems. The differences
00:18:39.279 --> 00:18:43.539
matter profoundly. A deck is shuffled by a dealer,
00:18:43.700 --> 00:18:47.000
a person with intentions or at least with a randomizing
00:18:47.000 --> 00:18:51.039
procedure. Molecules evolve according to physical
00:18:51.039 --> 00:18:55.089
dynamics. They respond to forces, collisions
00:18:55.089 --> 00:18:59.109
and conservation of energy and momentum. A deck
00:18:59.109 --> 00:19:02.930
consists of 52 distinguishable cards, each unique
00:19:02.930 --> 00:19:06.880
and identifiable. Molecules of the same substance
00:19:06.880 --> 00:19:10.299
are, in quantum mechanical terms, indistinguishable.
00:19:11.109 --> 00:19:15.450
They obey statistics, Bose -Einstein or Fermi
00:19:15.450 --> 00:19:18.069
-Dirac, that differ from classical counting.
00:19:18.779 --> 00:19:21.579
The deck analogy captures none of the energy
00:19:21.579 --> 00:19:24.549
constraints, temperature dependence. or heat
00:19:24.549 --> 00:19:27.349
flows that are central to thermodynamic entropy.
00:19:28.319 --> 00:19:31.740
Ice melts because of energy and molecular dynamics,
00:19:32.059 --> 00:19:35.039
not because someone is shuffling water molecules.
00:19:36.220 --> 00:19:39.259
Gas expands because of pressure differences and
00:19:39.259 --> 00:19:42.960
molecular motion, not because a dealer is redistributing
00:19:42.960 --> 00:19:47.000
particles. The deck is a pedagogical aid for
00:19:47.000 --> 00:19:50.220
the concept of multiplicity and multiplicity
00:19:50.220 --> 00:19:54.329
alone. It is not a model of physical entropy.
00:19:55.559 --> 00:19:59.240
When we say that entropy is not disorder, part
00:19:59.240 --> 00:20:01.539
of what we mean is that the visual messiness
00:20:01.539 --> 00:20:04.960
of a shuffled deck is not the same as the physical
00:20:04.960 --> 00:20:08.930
multiplicity of a molecular system. A shuffled
00:20:08.930 --> 00:20:13.259
deck looks disordered to human eyes. A box of
00:20:13.259 --> 00:20:16.680
gas at equilibrium looks uniform and unremarkable.
00:20:17.359 --> 00:20:21.730
Yet its entropy is enormous. The appearance of
00:20:21.730 --> 00:20:25.549
disorder is not the measure. This brings us to
00:20:25.549 --> 00:20:28.150
the central mechanism that makes entropy physically
00:20:28.150 --> 00:20:31.839
consequential. That mechanism is the dominance
00:20:31.839 --> 00:20:36.579
of overwhelmingly common states. For any macroscopic
00:20:36.579 --> 00:20:39.299
system, the number of microstates compatible
00:20:39.299 --> 00:20:42.579
with an equilibrium condition is so much larger
00:20:42.579 --> 00:20:45.140
than the number compatible with any noticeably
00:20:45.140 --> 00:20:48.519
non -equilibrium condition that, for all practical
00:20:48.519 --> 00:20:51.680
purposes, the system will be found in or very
00:20:51.680 --> 00:20:55.440
near equilibrium. Consider the scale of this
00:20:55.440 --> 00:20:59.150
dominance. If the number of microstates compatible
00:20:59.150 --> 00:21:02.109
with equilibrium is 10 to the power of 10 to
00:21:02.109 --> 00:21:05.910
the 23, and the number compatible with a noticeable
00:21:05.910 --> 00:21:09.150
deviation is 10 to the power of 10 to the 22,
00:21:09.509 --> 00:21:14.200
the ratio is not 10 to 1. The ratio is 10 to
00:21:14.200 --> 00:21:18.650
the power of 10 to the 22. This is not a small
00:21:18.650 --> 00:21:22.529
preference. It is a dominance so complete that
00:21:22.529 --> 00:21:25.210
deviations become effectively impossible at ordinary
00:21:25.210 --> 00:21:29.200
scales. A box of gas does not stay uniformly
00:21:29.200 --> 00:21:32.220
distributed because it is forbidden to caster
00:21:32.220 --> 00:21:35.859
in one corner. It stays uniformly distributed
00:21:35.859 --> 00:21:39.019
because the number of uniformly distributed arrangements
00:21:39.019 --> 00:21:41.640
exceeds the number of clustered arrangements
00:21:41.640 --> 00:21:45.220
by a factor so large that no human scale counting
00:21:45.220 --> 00:21:49.269
could express it. The spontaneous processes we
00:21:49.269 --> 00:21:53.769
observe, melting, expansion, mixing, heat flowing
00:21:53.769 --> 00:21:57.480
from hot to cold, are simply the system exploring
00:21:57.480 --> 00:22:01.779
its available microstates. In doing so, it almost
00:22:01.779 --> 00:22:04.119
certainly finds itself in conditions of greater
00:22:04.119 --> 00:22:07.980
multiplicity. The logarithm in Boltzmann's formula
00:22:07.980 --> 00:22:10.920
is what makes this quantitative reasoning possible.
00:22:11.880 --> 00:22:15.000
Without it, we would be comparing numbers like
00:22:15.000 --> 00:22:19.640
10 to the power of 10 to the 23. Those numbers
00:22:19.640 --> 00:22:22.400
have no intuitive meaning and no practical arithmetic.
00:22:23.690 --> 00:22:26.170
The logarithm compresses these into quantities
00:22:26.170 --> 00:22:28.730
on the scale of ordinary physical measurements.
00:22:29.130 --> 00:22:33.900
The constant k, Boltzmann's constant, converts
00:22:33.900 --> 00:22:36.920
between the natural logarithm of dimensionless
00:22:36.920 --> 00:22:40.099
multiplicity and the energy over temperature
00:22:40.099 --> 00:22:45.240
units of thermodynamic entropy. Its small value,
00:22:45.460 --> 00:22:50.400
about 1 .238 times 10 to the minus 23 joules
00:22:50.400 --> 00:22:53.890
per kelvin, reflects the fact that a single molecular
00:22:53.890 --> 00:22:57.829
rearrangement contributes almost nothing to the
00:22:57.829 --> 00:23:01.869
macroscopic entropy. The smallness of K means
00:23:01.869 --> 00:23:04.750
that a single molecular rearrangement contributes
00:23:04.750 --> 00:23:08.650
almost nothing to the macroscopic entropy. It
00:23:09.160 --> 00:23:11.940
is only when we count arrangements across astronomical
00:23:11.940 --> 00:23:14.980
numbers of molecules that the logarithmic count
00:23:14.980 --> 00:23:18.759
becomes significant. We should also be precise
00:23:18.759 --> 00:23:21.799
about what remains uncertain or contested in
00:23:21.799 --> 00:23:25.539
this picture. A calm, honest account of science
00:23:25.539 --> 00:23:29.230
includes its boundaries. These uncertainties
00:23:29.230 --> 00:23:31.390
do not change the central meaning of entropy
00:23:31.390 --> 00:23:35.160
as a counting measure. They refine how we count
00:23:35.160 --> 00:23:39.579
in specific situations. The counting of microstates
00:23:39.579 --> 00:23:42.519
depends on how finely we describe the system.
00:23:43.309 --> 00:23:46.529
In classical
statistical mechanics, we imagine
00:23:46.529 --> 00:23:50.319
continuous positions and momenta. The counting
00:23:50.319 --> 00:23:53.319
requires a somewhat arbitrary division of phase
00:23:53.319 --> 00:23:57.829
space into cells. In quantum statistical mechanics,
00:23:58.309 --> 00:24:01.250
the discreteness of quantum states provides a
00:24:01.250 --> 00:24:05.220
natural counting. But the choice of ensemble,
00:24:05.500 --> 00:24:08.740
microcanonical, canonical or grand canonical
00:24:08.740 --> 00:24:12.200
introduces different idealizations about how
00:24:12.200 --> 00:24:15.160
the system exchanges energy or particles with
00:24:15.160 --> 00:24:19.200
its surroundings. Real systems are never perfectly
00:24:19.200 --> 00:24:23.339
isolated. They are never perfectly in equilibrium.
00:24:23.779 --> 00:24:27.500
They are never perfectly described by any ensemble.
00:24:27.839 --> 00:24:31.029
The connection between thermodynamic entropy
00:24:31.029 --> 00:24:34.150
and statistical entropy involves idealizations
00:24:34.150 --> 00:24:37.910
of reversibility that real processes only approximate
00:24:37.910 --> 00:24:41.890
and the philosophical status of information entropy
00:24:41.890 --> 00:24:45.029
as a physical quantity as opposed to a mathematical
00:24:45.029 --> 00:24:48.589
tool for communication theory. remains a subject
00:24:48.589 --> 00:24:50.829
of discussion among physicists and philosophers
00:24:50.829 --> 00:24:54.619
of science. These are not flaws in the theory.
00:24:55.400 --> 00:24:58.500
They are reminders that entropy, like any deep
00:24:58.500 --> 00:25:01.420
physical concept, operates at the intersection
00:25:01.420 --> 00:25:05.220
of precise mathematics, physical idealization,
00:25:05.579 --> 00:25:09.410
and interpretive choice. What the listener should
00:25:09.410 --> 00:25:12.210
take away is a specific usable mental model.
00:25:13.279 --> 00:25:18.269
Entropy is not a force. It is not a substance.
00:25:19.819 --> 00:25:22.700
It is not a tendency toward visual messiness.
00:25:23.039 --> 00:25:26.980
It is a measure of how many microscopic ways
00:25:26.980 --> 00:25:30.299
a given macroscopic condition can be realized.
00:25:30.700 --> 00:25:34.839
The logarithm is essential because it turns unmanageable
00:25:34.839 --> 00:25:39.029
multiplicities into additive quantities. The
00:25:39.029 --> 00:25:42.630
three views, statistical multiplicity, thermodynamic
00:25:42.630 --> 00:25:45.710
heat over temperature, and information theoretic
00:25:45.710 --> 00:25:49.369
uncertainty are formally connected but operationally
00:25:49.369 --> 00:25:54.789
distinct. Melting ice, expanding gas, and even
00:25:54.789 --> 00:25:58.680
a shuffled deck can guide intuition. But the
00:25:58.680 --> 00:26:01.859
deck is only an analogy, limited by its neglect
00:26:01.859 --> 00:26:04.859
of physical dynamics, energy constraints, and
00:26:04.859 --> 00:26:08.619
quantum indistinguishability. The reason entropy
00:26:08.619 --> 00:26:12.440
explains so much of ordinary experience is that
00:26:12.440 --> 00:26:15.039
states of greater multiplicity are not merely
00:26:15.039 --> 00:26:19.259
more numerous. They are so overwhelmingly more
00:26:19.259 --> 00:26:22.039
numerous that exceptions become practically invisible.
00:26:23.079 --> 00:26:26.539
The sealed box from the beginning is still sitting
00:26:26.539 --> 00:26:32.200
on the table. It is still ordinary. It is still
00:26:32.200 --> 00:26:36.039
stable. But now you know what lies beneath its
00:26:36.039 --> 00:26:40.349
calm surface. Beneath that surface is an ocean
00:26:40.349 --> 00:26:43.529
of hidden arrangements, each one different at
00:26:43.529 --> 00:26:46.750
the molecular level, each one producing the same
00:26:46.750 --> 00:26:50.980
ordinary appearance. When you next hold a glass
00:26:50.980 --> 00:26:54.440
of water with ice melting slowly inside or feel
00:26:54.440 --> 00:26:57.380
the steady pressure of air in a room, you can
00:26:57.380 --> 00:27:01.130
picture what entropy is actually counting. The
00:27:01.130 --> 00:27:03.869
visible calm is the surface of that ocean of
00:27:03.869 --> 00:27:07.839
hidden arrangements. The system does not know
00:27:07.839 --> 00:27:11.690
it is maximizing entropy. It simply explores
00:27:11.690 --> 00:27:15.460
its possibilities. And the possibilities are
00:27:15.460 --> 00:27:18.660
so vast that the exploration almost always leads
00:27:18.660 --> 00:27:22.329
where the counting is richest. That is what entropy
00:27:22.329 --> 00:27:29.650
quantifies. Not disorder. Not decay. The abundance
00:27:29.650 --> 00:27:32.230
of hidden ways to be what we already see.