They have an encoder e with parameters θ that encodes a sequence of word tokens into a sequence of vectors and a decoder d with parameters φ that decodes the sequence of vectors into a sequence of predicted tagsŷ 1:L .
c 1: The model parameters are learned by minimizing some loss function L(ŷ 1:L , y 1:L ) over θ and φ.