We fine-tune BERT on each of these, yielding different contextualized embeddings for our general evaluation metrics.
we also observed that soft alignments (MoverScore) marginally outperforms hard alignments (BERTScore).