For instance for phrase-based translation, it specifies a hard-limit on the number of hypotheses to retain.
apart from translation decoding, this paper is closely related to work on column generation for NLP.