The prediction task could be trained jointly with the translation task in a multi-task learning way (Luong et al., 2015a;Dong et al., 2015;Zhang and Zong, 2016), where both tasks share the same encoder.
word prediction for the initial state could be interpreted as an improvement for the encoder.