Preliminary experiments involving augmentation of the data by duplicating and deleting constituents show no gains, suggesting that the improvement depends on certain kinds of regularities in the English data that are not provided by artificial manipulations.
more investigation is needed to thoroughly assess the role of general-purpose regularization in our observations.