Our system produces de-tokenized cased output after BPE decoding, whereas previous systems produce traditional tokenized lower-cased output.
we lowercase and tokenize our system outputs to have fair comparisons with previous systems.