Using more data for training -i.e., our artificial training data which does not include context errors -generally boosts performance on data with and without grammatical errors in the context.
training with additional artificially generated errors seems, overall, to be making our model more robust.