We formulate label assignment problem as a resource allocation problem, where we maximize total value of assigned labels.
exploiting this directional and conditional dependency between the labels should allow us to predict a more coherent set of labels.