We did an initial pilot using the instructions mentioned in Table 2, but due to the subjective nature of the task, it was difficult for the annotators to agree on the notion of important information.
we found that the annotators disagreed between most important information and all important information (i.e., they were confused between rating 1 v/s 2 and 4 v/s 5).