Several recent studies have considered to exploit a longer context information that spans multiple sentences (Mikolov and Zweig, 2012;Wang and Cho, 2016;Ji et al., 2016;Liu and Lane, 2017;Xiong et al., 2018).
we also investigate the effect of the number of utterance history being encoded.