In the harder translation direction, English→Croatian, the newly built SMT systems outperform two of the reference systems, Bing and Yandex, while we do not observe a substantial decrease in the quality of the MT system built solely on the hrenWaC parallel corpus compared to the system built on all the training corpora.
in the opposite direction, Croatian→English, there is a significant difference in the performance achieved by both newly built MT systems: the system using all the training data achieves a 2.22 BLEU points increase and a 2.12 TER points decrease when compared to that trained only on the hrenWaC corpus.