If either of the two words in a pair in the test dataset does not appear in the training dataset, we excluded the pair from the test dataset since the problem of unknown words is not in the scope of this research.
we evaluate the pairs that are not in the training dataset, but whose component words appear in the training dataset.