Hence the context model does not see enough data for learning and hence, if the learnt context model is fed directly to the hidden state of the target RNN, the improperly learnt context model can play a big role.
if a Concat kind of architecture is used, the linear plus softmax layer can decide on how much importance to give to the context model.