For the OOV problem, we use FastText to provide vectors to 2,333 words (around 13% of the vocabulary).
the ablation experiment shows a small improvement, which suggests that those words did not substantially contribute to the meaning of the context.