As we observed in a pilot experiment that there is a good chance that the predictions ranked in the second or third may still be correct, we select top three predictions as the candidate relations for each mention in order to introduce more potentially correct output.
we should discard the predictions whose confidences are too low to be true, where we set up a threshold of 0.1.