Neural network approaches to a range of NLP problems have also been aided by initialization with word embeddings trained on large amounts of unannotated text (Frome et al., 2013;Zhang et al., 2014;Lau and Baldwin, 2016).
in the case of extremely low-resource languages we do not have the luxury of this unannotated text.