Our goal is to study how much each of these components contribute to the empirical performance of LSTMs.
it is worth considering the memory cell in more detail to reveal why it could serve as a standalone powerful model of long-distance context.