We use this method to evaluate the coherence of query-oriented topics.
the coherence of a topic model T K Θ composed of K topics is: where probabilities of word occurrences and cooccurrences are estimated using an external reference corpus.