Type Definition Encoder Using trainable type embeddings exposes the denoising model to potential data sparsity issues, as some types appear only a few or zero times in the training data.
we also assign each type a vector based on its definition in WordNet (Miller, 1995).