The second example has y 3 , y 4 , y 5 as input of the decoder and y 4 , y 5 , y 6 as the output of the decoder, and so on.
we found that our approximation works better in terms of N-choose-1 accuracy (see Section 5.2), which suggests that its value may be closer to the true conditional probability.