Nutch follows the standard IR model of Lucene 6 with document parsing, document Indexing, TF-IDF calculation, query parsing and finally searching/document retrieval and document ranking.
the collected corpus is noisy and contains some non-German as well as non-English words 7 http://www.statmt.org/wmt15/translation-task.html and sentences.