However, contrary to the MSRP guidelines-where annotators were not told whether two sentences were supposed to be in an entailment relationship-we considered it essential for the alignment decisions to be consistent with the overall decision as to whether the two questions were taken to be paraphrases in the dialogue context.
we decided that if two questions are taken to be paraphrases, they must have at least one content word aligned.