We find that even when some context window performs well on the source language task, that is often not the best choice for the target language.
the performance of the small-window embeddings does not transfer to the test languages.