The model discussed thus far conditions on the POS tags of words in the input sentence.
the embedding of a non-English word which is not aligned to any English words is defined as the average embedding of words with a unit edit distance in the same language (e.g., 'playz' is the average of 'plays' and 'play').