Dreamento Dev Path · Tiny Workshop
A tiny workshop about how an LSTM carries memory from one epoch to the next
Robo just learned to spot a shape in one epoch. But a single epoch alone can be a hard guess — Robo also needs to remember what happened a few epochs ago. Meet Robo's memory helpers.
One notebook gets scribbled on constantly. The other only gets a new entry when something actually matters.
Changes almost every step. Easy to overwrite. Holds whatever just happened.
Only updated when it really matters. Carries the big picture across many epochs.
Three small decision-makers control what happens to the journal every single epoch. Nobody programs their rules by hand — they learn their own judgment during training, same as Robo's stamp in Workshop 1.
Decides what's in the journal is no longer relevant and can be crossed out.
Decides what's new and actually worth writing into the journal.
Decides what part of the journal actually gets used for THIS epoch's prediction.
Six epochs, one night. Click through and watch the three doormen work the journal, one decision at a time.
Epoch 1 of 6
Forget Gate
Input Gate
Journal now reads
(empty)
Output Gate — used for this epoch's prediction