Simply combining in-domain training data with out-of-domain data will lead to overfitting to the out-of-domain data.
some domain adaptation technique should be adopted to improve in-domain translation.