The motivation for a topicincorporating model was based on our earlier observations presented in section 3.
we trained an LDA topic model (k = 50) (Blei et al., 2003) on the heldout OPs and during training/testing, we merged the estimated topic distribution vector with the output layer after convolution and pooling.