Apparently, for the source-side monolingual data, the pseudo target reference y should have good translation quality.
for each source-side monolingual sentence, we use the N-MT model trained from the bilingual data to beam search a target sentence and treat it as the pseudo target reference y. Afterwardsŷ is obtained via multinomial sampling to calculate the reward.