Such languages typically exhibit a large number of word types in relation to word tokens in a given text, which leads to high perplexity and a large number of unseen word contexts.
probability estimates are often unreliable, even when using standard smoothing and parameter reduction techniques.