Computing BLEU scores over character sequences does not make much sense, especially for small n-gram sizes (usually, n ≤ 4).
we post-processed the character-level n-best lists in each tuning step to calculate word-level BLEU.