The second one is Next Sentence Prediction, which means to predict whether two sentences are adjacent or not.
also build a hybrid system by combining the best pseudo data that SMT models generate into the training of the NMT model while Ren et al.