For each document D and each codeword µ i , the differences x t − µ i of the vectors x t ∈ C i ∩ D and the codeword µ i are accumulated into column vectors: where D ⊂ X is the set of word embeddings in a given text document.
the final VLAWE embedding for a given document D is obtained by stacking together the d-dimensional residual vectors v i,D , where d is equal to the dimension of the word embeddings: the VLAWE document embedding is has k • d components.