s a t encodes all past marks and depends on the full hidden state so far: However, we make s x t encode only the sequence of past input marks, ignoring all others.
t encodes only the sequence of past output marks.