PART I · Room Three · The Direction of Time

Entropy & the Arrow of Time — Why Does Time
Flow in Only One Direction

A shattered cup never reassembles itself, and ink that has spread never gathers back together. And yet, strangely, the laws of motion governing each individual atom that makes up that cup and that ink draw no distinction between "past" and "future." Where, then, does the arrow of time come from?

§1The Same Law Run Backward — And Yet…

Play a video of two billiard balls colliding in reverse, and nothing looks physically wrong. Newton's equations hold just the same when you replace time t with −t — the fundamental laws of the microscopic world are time symmetric. Yet run a video of a cup shattering in reverse, and anyone can tell it is "fake." Shards leaping up on their own to become a pristine cup simply never happens.

This one-way street of the macroscopic world is precisely the arrow of time. Hot coffee cools, perfume spreads through the room, a tidy room grows cluttered. Always in one direction. The single quantity that fixes this direction is entropy, and its rule is the second law of thermodynamics — "the entropy of an isolated system never decreases."

In plain words Shuffle a neatly ordered deck of cards and it turns into a jumble. Keep shuffling and it never sorts itself back on its own. That is because there is exactly one "ordered arrangement," but the number of "jumbled arrangements" is astronomical. Time always flows toward the side with more possible arrangements.

§2Entropy = the Logarithm of the Number of Arrangements

Ludwig Boltzmann uncovered the true nature of entropy. For a single macroscopic state that we observe (e.g. "ink spread evenly throughout the room"), there is a count W of the microscopic arrangements (the position and velocity of each individual atom) that produce it, and entropy is proportional to its logarithm — S = k_B ln W. The arrangements that produce a state with the ink clumped in one corner are few, but the arrangements that produce an evenly spread state are overwhelmingly many. So the system simply drifts toward the state with more arrangements.

The key point is that the second law is not a "law of prohibition" but a law of probability. Ink gathering back together on its own is not impossible, merely terribly unlikely. When there are only a few particles, you actually see fluctuations that occasionally pile them up on one side, but once there are around 10²³ particles that probability becomes effectively zero, so probability comes to look just like law. In the experiment on the right, shrink the particle count down very small and watch this fluctuation for yourself.

§3Where the Arrow Came From — a Low-Entropy Past

If the laws are time symmetric, why is there really only one direction? The answer lies not in the laws but in the initial conditions. The universe set out 13.8 billion years ago from an extraordinarily low-entropy state (the Big Bang). Ever since, the universe has simply rolled toward states with ever more arrangements, and that downhill-with-no-uphill is the direction of time we feel. The arrow of time springs from the fact that the universe's past was exceptionally orderly.

Here the chaos of the previous chapter returns. The microscopic laws are in principle reversible, but because of chaotic sensitivity, knowing the initial conditions needed to rewind with infinite precision is practically impossible. The "Reverse Velocities" button in the experiment on the right shows this — ideally every particle should rewind and gather back on one side, but even the tiniest numerical error soon scatters them apart again. Reversibility survives in principle, yet breaks down in practice. If this flow runs to its end, the entire universe reaches a heat death, uniform with no temperature differences — a maximum-entropy stillness in which no further change can do any work.

Common misconception

Entropy is not simply "messiness" but the number of microstates. And entropy decreasing locally is perfectly possible — living things organize their bodies and a refrigerator chills its interior. But the price is that they dump even more entropy (heat) into their surroundings, so the entropy of the whole (system + environment) always increases. The second law is a law about the whole universe.

Key points

  • The microscopic laws are time symmetric, yet the macroscopic world has an arrow of time (a one-way street)
  • Entropy = the logarithm of the number of microstates, S = k_B ln W (Boltzmann)
  • The second law is not prohibition but probability — things simply flow toward the overwhelmingly likely side
  • The root of the arrow of time is the low-entropy initial condition of the Big Bang
  • Local entropy decrease is possible, but total entropy always increases → the end is heat death
EXP.10 — Particle BoxPartition in place
120
Observe — Remove the partition and the particles that had been gathered on the left spread out evenly on their own, and the entropy bar climbs to its maximum. Press "Reverse Velocities" and, thanks to tiny errors, they still cannot regather. Shrink the particle count down to 6 and you will sometimes see a fluctuation that piles them on one side — feel for yourself that entropy is not a law but a probability.
EXP.10b — Maxwell's Demon
Fast particles (red) and slow particles (blue) are mixed together. If a "demon" opening and closing a door in the middle lets only the fast particles through to the right and only the slow ones through to the left — a temperature difference arises on its own, seemingly defying the second law. Is it really free?
MAXWELL'S DEMONInformation vs. thermodynamics
Clicking the canvas also opens and closes the door
The hidden price here — Even though the demon seems to create a temperature difference, to measure which particle is fast and then store and erase that information inevitably costs energy (Landauer's principle: erasing one bit of information releases at least k_B·T·ln2 of heat). Once you fold the inside of the demon's head into the accounting, total entropy still increases — the second law is not broken.
DEEP DIVE — Equations & History
Boltzmann's EntropyBoltzmann, 1877
$S = k_B \ln W$
S entropy · W the number of microscopic arrangements that realize a single macroscopic state · k_B the Boltzmann constant (≈ 1.38×10⁻²³ J/K). Entropy is not "an amount of disorder" but the logarithm of the number of possible arrangements. This one line is the bridge linking thermodynamics and probability (statistical mechanics), and it is carved on Boltzmann's tombstone as well.
The Second Law of ThermodynamicsThe Arrow of Time
$\Delta S_{\text{total}} \geq 0$
The change in entropy of an isolated system (or of the whole system + environment) is never negative. Equality holds only in a perfectly reversible ideal process, and every real process is the strict inequality (>). This inequality is the only fundamental direction in physics that separates future from past — because all the other laws are symmetric in time.
HISTORY — Timeline of Entropy and Thermodynamics
1824
Carnot analyzes the efficiency limit of heat engines → the seed of the second law of thermodynamics
1865
Clausius first coins the name "entropy"
1877
Boltzmann links entropy to the number of microstates via S = k ln W (statistical mechanics)
1929
Szilard reformulates Maxwell's demon as a problem of information processing
1961
Landauer proposes the principle that erasing one bit of information costs at least k_B·T·ln2 of heat
← PREV
Chaos Theory