In particular, quantization (Lin et al., 2016;Hubara et al., 2016) and groupwise low rank approximation (Chen et al., 2018a) achieve the state-of-the-art performance on tasks like language modeling and machine translation.
these methods are rather computationally inspired than being motivated by intuitions of the semantic composition and thus suffer from poor interpretability.