When the number of surrounding words was smaller than the window size, we used a zero vector.
the dimensionality of the surrounding word vectors was 800 when they were created using only the word embeddings, and 1,000 when both the word and concept embeddings were used.