Using continuation of training we are able to improve the performance by up to 1.2% absolute.
if we look at the translation quality on the out-ofdomain data set we see the catastrophic forgetting effect, with a drop of 1.7 BLEU points.