The strategy used in evaluating the phrasal similarity score from the component token similarity scores is critical in deciding the overall performance of the MEANT metric, as role fillers are often phrases.
the robustness experiments were conducted across various data sets following NISt Met-ricsMatr protocols, showing higher Kendall correlation with human adequacy judgments against BLEU, MEtEOR (with and without synsets), WER, PER, tER and CDER.