Residual connection Character alignment is mostly local in nature, but this fact is not reflected by how the next character is predicted by the model.
the prediction is made based on the context vectorh, which is a nonlinear function of the hidden states of the encoder and the decoder.