Automatic metrics allow faster measures of progress when training and testing models and easier development of text generation systems.
we introduce two new metrics: sentence mover's similarity (SMS), which relies only on sentence embeddings, and sentence and word mover's similarity (S+wMS), which uses word and sentence embeddings, as in Figure 1.