In practice, for a neural translation model in OpenNMT (Klein et al., 2017), the word embedding parameters accout for 80% of the total parameters.
it is significant to reduce the parameters of the embedding layer for deploying NLP models to memory-constrained devices.