CNN on the other hand can encode long distance relations existing between concepts.
the embedding is extended by introducing an additional output layer (called the constrained context, CC, output layer) to update the embedding based on the fine-grained contexts.