To deal with rare and compound words, byte-pair encoding (BPE) 5 (Sennrich et al., 2016) is applied to both sides.
8,000 and 16,000 BPE merges are used on the News Commentary v11 subset and the full training set, respectively.