2-way tests of homogeneity show that the difference in accuracy of predictions in instances containing seen or unseen word pairs is nonetheless significant for all models (CE: χ 2 (1) = 19.46, DAM: χ 2 (1) = 74.16, ESIM: χ 2 (1) = 39.33).
the models struggle to recognize the reversed antonym pairs, even though they were all seen in their original order at training time.