(2016) report that characterlevel decoding is only 14% slower than subwordlevel decoding.
(1) Training/decoding latency For the decoder, although the sequence to be generated is much longer, each character-level softmax operation costs considerably less compared to a word-or subword-level softmax.