In the spirit of taking advantage of available dictionaries to improve our model as in CRF+SVM, we propose to integrate statistical information from the dictionary to improve the word embeddings.
for a word, we form a vector in which each element is the probability that this word is contained in an entity category, as follows: where x i is the probability that word w is contained in i th category (c i ) : We call these "entity category embeddings".