X represents an input sentence, which <s> canadian prime … year <s> canada … nato input sentence headline is represented as a sequence of indicator vectors, whose length is M .
x i ∈ {0, 1} |V | , and whose length is L. Here, we assume L < M .