Because some of the feature types (n-grams, cue words, dependencies, and emotion dependencies) described in the previous subsection are expected to generate a large number of non-predictive features, we trim some of the most irrelevant features out of the feature set to avoid memory problems.
following Yang and Pedersen (1997), for each question we calculate the information gain of each feature of these types on the training set.