In this architecture, two separate LSTMs are used-LSTM pt and LSTM ct -similar to the previous architecture without any attention, but for LSTM ct , its memory state is initialized with the last cell state of LSTM pt .
lSTM ct is conditioned on the representation of the lSTM pt that is built on the prior turn pt.