If one is going to the expense of PoS-tagging texts, only a subset of PoS tags should be used as features in AGC in order to maintain performance across changes in the topical distribution.
our results suggest that prediction accuracy on a static topic distribution should not be the sole basis for assessing the quality of Automatic Genre Classification systems: approaches that perform well on a static topic distribution can be severely impacted by changes in topical distributions.