We use a hierarchical recurrent neural network (Serban et al., 2016) to model the current utterances (Figure 1a).
a recurrent neural network (RNN) captures the meaning of a sentence; another LSTM-RNN aggregates the sentence information into a fixed-size vector.