In addition, on machine translation task, it achieves 41.38X with BLEU score drops around only 1% after retraining.
we observe that the effect of retraining is more prominent for MulCode and simple quantization compared to GroupReduce.