This scheme generalizes to the case where we have n nonterminals in a SCFG rule, and the decoder conservatively assumes nothing can be done on language model scoring (because target-language spans are non-contiguous in general) until the real nonterminal has been recognized.
target-language boundary words from each child nonterminal of the rule will be cached in all virtual nonterminals derived from this rule.