Then, in the case of the parallel type, the third sentence explains the first sentence; however, its content is different from that of the second sentence.
p gen is used as a soft switch to select a word from the vocabulary distribution P vocab or a word from the attention distribution a t .