This suggests that if term t a in context c is more informative than t b , then most likely the contexts from t a 's featured context set will be more related to c than will t b .
given a term t and its featured context set U f (t) = {c 1 , ..., c k }, we define the term informativeness of t in context c i as where κ(c i , c j ) is the semantic relatedness of c i and c j , which can be computed by various semantic relatedness metrics such as Wikipedia based (Gabrilovich and Markovitch, 2007;Yazdani and Popescu-Belis, 2012), Wordnet based (Agirre et al., 2009;Budanitsky and Hirst, 2006), or simple cosine similarity and Jaccard similarity based (Zobel and Moffat, 1998).