One preprocessing step that we could have done is to run a normalization module across the corpus.
this also requires specialized knowledge about the language/orthography and this source of errors was not large enough for us to take this step.