, t n , where t i is the i-th token of s, we generalize its words t i to word classes t i as follows: that is, a word t i is left unchanged if it occurs frequently in the training corpus (i.e., t i ∈ F); otherwise it is replaced with its part of speech (POS(t i )).
we obtain a generalized sentence s .