This is probably because along with diatopic variation, systems learn properties of datasets that are often topic or genre specific.
part of what was learned from the additional training corpora was not helpful for predictions on the test set.