Furthermore, the feature-based hash sampling included only contextual features (in the form of n-gram co-occurrence information), and did not consider orthographic features.
our log-linear model integrates both type-level orthographic features and token-level bigram frequencies.