In this paper we consider both options, taking advantage of the second in order to feed the model with BEs.
to standard LSTM-based language  Figure 1: The AE-SCL and AE-SCL-SR models (figure imported from ZR17).