A simple approach is to perform the transitive closure of the pairwise decisions.
as shown in recent work (McCallum and Wellner, 2003;Singla and Domingos, 2005), better performance can be obtained by performing relational inference to directly consider the dependence among a set of predictions.