Similar to MINERVA (Das et al., 2017), we want the state to encode all observed information, i.e., we define s t R = (e s , r q , h t ) ∈ S R , where h t encodes the path history, and (e s , r q ) is the context shared among all states.
we use a LSTM module to encode the history, h t = LSTM(h t−1 , [r t , e t ]) (see Fig.