The extraction process also has to be generic, because of the large number of lexica it would be too cumbersome to craft a targeted extraction algorithm for each webpage.
the pages do not offer structural patterns which could allow for a reliable boilerplate and metadata extraction (Barbaresi, 2016).