Although the semantic relatedness datasets are used in many researches, one major disadvantage is that the words in those word pairs do not have contexts.
we also conduct experiments with the Stanford's Contextual Word Similarities (SCWS) dataset (Huang et al., 2012).