The stack method can be quite costly, given that it increases the size of several matrices, either in the recurrent unit (for input) or the output mapping for word generation.
this information can be highly informative, for instance, keywords, titles or descriptions, often include central topics which will be helpful in modelling or understanding the document text.