To see how the two different ways of crawling affect the final quality of the bitext we applied both methods to the four websites and obtained two sets of parallel documents, which we proceed to split into sentences using NLTK Punkt tokenizer (Kiss and Strunk, 2006), and align with Hunalign (Varga et al., 2007).
we end up with two sets of bitexts which differ only in the way they were crawled.