We note that the Topic Coherence (TC) metric in (Mimno et al., 2011) which is often used to approximate coherence in unigram topic models as it correlates with human notions of coherence, uses codocument frequency of individual words in topics.
in our problem as phrases are sparse, their co-document frequency is far lower than words.