This permits us to decouple decisions made in designing the NMT architecture from decisions about which models we will use for learning sentence embeddings.
we can benefit from orthogonal work in designing neural architectures to embed sentences.