This method is insensitive to the existence of competing hypotheses when performing pruning.
4 While suffix arrays allow for efficient calculation of these statistics, storing all co-occurrence counts c(e, f ) is an unrealistic memory burden for larger corpora.