With FullyQT, we achieve higher BLEU scores than all other quantization methods for the Transformer on multiple translation tasks and avoid any loss in BLEU compared to full-precision.
out of 35 experiments, 8-bit quantization performed better than full-precision in 21 cases.