Connect LSTM Cells Across Time and Space

Let’s see how LSTM cells are connected in time and space. Let’s start from the time perspective by considering a single sequence of $N$ timesteps and one cell as it is easier to understand.

Focus on the left cell. The upper left arrow is the context memory vector $c_{t-1}$, and the lower arrow is the previous ...