Therefore, we define a biased probability distribution, p c (y), to be used by the CD clustering algorithm for characterizing a cluster c. It is designed to call attention to y's that are typical for cluster members in all, or most, different datasets.
the common set of features consists of all corpus words that occur in at least three different documents within two or three of the corpora, excluding a list of common function words.