With this heuristic, we achieve the same BLEU scores and model cost as a trigram decoder with essentially the same speed as a bigram decoder.
we are focusing on Inversion Transduction Grammars (Wu, 1997) which are an important subclass of SCFG.