The probability of generating next word y t is, 2 where z t is a decoding state for time step t, computed by, c t is a source representation for time t, calculated as, where α t,i scores how well the inputs around position i and the output at position t match, computed as, The standard decoding algorithm for NMT is beam search.
at each time step t, we keep n-best hypotheses.