The input layer consists both source and target language word, which is in one-hot representation.
(3) If current source/target word is not aligned to any target/source words, we introduce a null token in its opposite side, and annotate this word pair as f ollow reordering type.