However, we observe that, although the network is capable of deciding what to keep in the cell state to affect the later generation, the influence of the added information in the beginning of decoding is becoming weaker and weaker over time.
to provide the model a broader and more flexible space for learning, we propose a global information inception pattern, which fuses the cue word C w as the auxiliary information at every step of decoding.