After the annotators completed the aforementioned steps, they were asked to collapse all the reason classes that occur in less than 2% of the sentences annotated with non-NONE classes into the OTHER class.
all the sentences that were originally annotated with one of these infrequent reason classes will now be labeled as OTHER.