However, one could also argue that the original behavior of CSLDA is in some ways desirable.
if two classes of documents are mostly the same both topically and in terms of annotator decisions, perhaps those classes ought to be collapsed.