D6 · Sequences & Memory
Backprop Through Time
Run backprop across time steps and explain truncation.
Backpropagation through time sounds like a new algorithm. It is the old one, run on the unrolled picture. Unroll the loop and you have a graph. Walk the graph backward and you have your gradients. Only one thing is new, and it comes from sharing weights.