As previous work (Marcu, 2001) (Biran and McKeown, 2013) used word pairs successfully, we hypothesize that pairs of higher-level categories will improve classification without being penalized as heavily by the sparsity of dealing with individual words.
we include interaction features between every categorical feature for the pre-AltLex text and every feature for the post-AltLex text.