As discussed earlier, Equation 5addresses the rare words issue, since a word not in vocabulary will have probability p(qword) = 0.
in such cases, our model will replace the <unk> token for out-of-vocabulary words with a word in the input sentence having the highest attention obtained using attention distribution a t i .