In Experiments 1 and 2, we have found an improvement for including out-of-domain data.
it is unclear so far whether the improvements are simply due to the increased amount of training data, or to the training data becoming more varied.