These external rules can provide reliable guidance about which words to modify, resulting in higher add/keep F1 scores (Table 5-a).
our model is inclined to generate shorter sentences, which leads to high F1 scores on delete operations 8 .