The recently proposed methods, such as CBOW and Skip-gram, have demonstrated their effectiveness in learning word embeddings based on context information such that the obtained word embeddings can capture both semantic and syntactic relationships between words.
it is quite challenging to produce high-quality word representations for rare or unknown words due to their insufficient context information.