As a modification to the sequence-to-sequence model, we suggest that the model uses a static RNN decoder, which does not use a previous token vector (t i−1 ).
the model used randomly normalized token vectors.