Let's begin with a word trigram model First, we would like to convert this model into a class-based model.
without loss of generality, we have it seems reasonable to use the distributions p ng (c j |w j−2 w j−1 ) and p ng (w j |w j−2 w j−1 c j ) as the starting point for our class model.