The reason is that the hidden state of last word in source sentence is irrelevant to the target sentence, considering the fact that under our scenario, the target side sentences may entirely uncorrelated to the source sentences.
in our model, z k 0 is set to a zero vector as follows: In Figure 2, the hidden state of "<start>" symbol is set to zero vector when y 1 does not belong to parallel part of the sentence pair.