2 Second, we let the next word prediction of the translation decoder as a generator of RNNG.
the generator of RNNG will output a word, when asked by the shift action, according to the conditional distribution defined by the translation decoder in Eq.