This non-lexical feature representation makes different target word/substitution pairs in different contexts 4 directly comparable.
it becomes possible to learn an all-words system that is applicable to unseen words, using supervised methods, which provides superior ranking accuracy to unsupervised and knowledge based models.