Distributed representation of words (or word embedding) has been demonstrated to be effective in many natural language processing (NLP) tasks (Bengio et al., 2003;Collobert and Weston, 2008;Turney and Pantel, 2010;Collobert et al., 2011;Mikolov et al., 2013b,d;Weston et al., 2015).
the learning and updating are referred by the dashed arrow lines.