This scheme generalizes to the case where we have n nonterminals in a SCFG rule, and the decoder conservatively assumes nothing can be done on language model scoring (because target-language spans are non-contiguous in general) until the real nonterminal has been recognized.
targetlanguage boundary words from each child nonterminal of the rule will be cached in all virtual nonterminals derived from this rule.