This conclusion is also validated by our preliminary experiments on the task of active learning relation extraction, thus we adopt the LC metric for simplicity.
with a sequence of K probabilities for a relation instance at some iteration, denoted as {p 1 ,p 2 ,…p K } in the descending order, the LC metric of the relation instance can be simply picked as the first one, i.e.