This assumption can be formulated as a co-occurrence model for headword prediction: that is, the probability of a headword is determined by the occurrence of other headwords within a window.
in our experiments, we instead used an interpolated probability First, co-occurrence models do not predict words from left to right, and are thus very difficult to interpolate with trigram models for decoding.