We run beam search on the pivot sentence with the teacher model and choose the highest-scoring target sentence as the mode.
as the parameters of the teacher model are fixed, the training objective can be equivalently written as: where our goal is to find a set of source-totarget model parameters that minimizes the training objective: We use similar approaches as described in Section 3.2 for approximating the full search space with sentence-level teaching.