The LSTM (gated recurrent network)

Step through the forget, input and output gates that regulate the memory conveyor belt (cell state C) across time steps.

Reference Hochreiter & Schmidhuber, 1997