Both Document and Corpus-level Attention In order to integrate the information obtained based on document-level attention and corpuslevel attention, we concatenate h pi , H C pi and H D pi , and feed it into another Bi-LSTM model.
the final hidden state of each word contains the complementary information from both the dialogue and corpus.