To investigate this effect, we include baseline models where we replace all context vectors c i with the entire sentence embedding (indicated by the suffix "-CTX" in Table 1).
we provide either the flattened matrix M (for models with inner attention; ATTN or ATTN-CTX), the final state of the encoder (FINAL-CTX), or the result of mean-or max-pooling (*POOL-CTX) as a constant input to the decoder cell.