The correction that faded to a whisper. · Source

The report is wrong — now the correction must travel back

Years after his walking nights, Teodor keeps the dawn gate as captain. Two hundred posts hold a watchman each now, and the night's news is relayed post to post into his hands. This dawn the report says all quiet — yet a shepherd swears thieves crossed near the dusk gate. Somewhere far down the wall, the watching failed. Teodor sends a correction back the way the news came…

Each watchman softens the message before passing it on

The correction cannot leap; it must walk. The nearest watchman hears it whole — the night was called wrong — takes his share of the blame, tightens his own watch, and passes the rest along. But no man repeats a rebuke at full strength. Each keeps a little back — nine parts in ten go on, softened by pride, by tiredness, by the wish to be kind. Post by post, the correction travels… and shrinks.

Nine-tenths of nine-tenths of nine-tenths…

Nine parts in ten sounds harmless — one relay costs almost nothing. But softenings do not add, they multiply. Ten posts on, two-thirds of the correction is already gone. Fifty posts on, it limps along two hundred times weaker. A hundred posts on, next to nothing remains — and the thieves crossed at the far end of a two-hundred-post wall…

At the far gate, the whisper is softer than the wind

The dusk-gate watchman — keeper of the very stretch where the thieves crossed — leans toward his neighbor and catches barely a syllable. Nothing in it is loud enough to change how he watches, so he keeps his old habits. Next season, the same stretch fails the same way. No alarm rings; nothing breaks. The report simply stays wrong in the same far places, quietly, year after year…

Too loud is easy to cure. Too faint is not

One winter the wall tries the opposite: pass every correction on louder. By post forty it is a roar; by the far stretch, a panic — men abandoning the parapet over one loose stone. That failure is loud, and easily cured: Teodor caps every relay at one firm voice. But no order can turn a whisper back into instruction. Fading does not just quiet a message — it spends what the message knew…

The fading has a name: the vanishing gradient

0.9^{100} \approx \frac{1}{40\,000}

Machines that learn in long chains suffer Teodor's wall. The final verdict's correction is passed backward stage by stage, and each relay multiplies it by a factor slightly below one. Keep nine-tenths at each of a hundred relays and one part in forty thousand arrives. That is the vanishing gradient: the earliest stages hear almost nothing of their own mistakes, so they barely learn at all…

🌱 How many relays before a correction reaches you?

In the end Teodor walks the whole wall himself, dawn gate to dusk gate, to say it plainly to one man — and wonders how to build a wall where the farthest post hears the verdict as clearly as the nearest. You live inside such chains too. By the time a hard truth reaches you, how many kind mouths have softened it — and which correction never arrived at all?