For a document, only the word with largest value in each embedding dimension is employed for the final representation.
we suspect that semantically similar words may have large values in some shared dimensions.