5 The idea of lowering the specificity of letter class questions as the context length increases is due to Kienappel and Kneser (2001), and is intended to avoid overfitting.
their configuration differs from ours in that they use longer context lengths (4 for German and 5 for English) and ask letter class questions at every position.