The out-of-vocabulary rate is growing as the dataset shrinks, and therefore the performance of sisgand cbow necessarily degrades.
the proposed model (sisg) assigns non-trivial vectors to previously unseen words.