A fundamental advantage of neural models for NLP is their ability to learn representations from scratch.
in practice this often means ignoring existing external linguistic resources, e.g., Word-Net or domain specific ontologies such as the Unified Medical Language System (UMLS).