Since the immediate goal of this work is to produce a program that identifies the words of a sentence that belong to the reparandum of a repair construction (to a first approximation these words can be ignored in later processing), our evaluation focuses on the model's performance in recovering the words in a reparandum.
the model is used to classify each word in the sentence as belonging to a reparandum or not, and all other additional structure produced by the model is ignored.