In following experiments, we only consider removing common features shared by both baseline systems for feature subspace generation.
since lower-order models have already been contained in higher-order model for the purpose of smoothing in almost all statistical language model implementations, there is also no extra training cost.