To measure how informative a sequence of relations is, we use density-weighted certainty sampling (DCS).
for a sequence of relations r 1 ...r n taken from a document, d, we use the following formula: In this equation, H(r i ) represented the entropy of the distribution of label predictions for the relation r i generated by the current spectral model, which is a measure of the model's uncertainty for the label of the given relation.