We experiment with integrating both WordNet (Miller, 1995) and Wikipedia, thus explicitly adding word sense knowledge and facts about named entities (including those unseen at training time).
this results in general purpose knowledge enhanced representations that can be applied to a wide range of downstream tasks.