Then, while processing all instances of the same word type u one after the other, only the substitute vectors in C u need to be loaded into memory.
in an 'online' mode, to be ready for any arbitrary word instance input, our model would need to keep in memory substitute vectors for all the word types in the vocabulary V .