Here we investigate the common-held view that polysemy representation improves performance.
we question the validity of word similarity tasks as a suitable evaluation test that would allow drawing such conclusions.