We investigate the model compression and decoding speedup for NMT from the views of network architecture, sparsification, computation and search strategy, and test the performance of their combination.
we present a four stage pipeline for model compression and decoding speedup.