3 The API outputs plain text converted from Wiki-Markup, but the text still contains a small portion of leftover markup and other artifacts.
we perform additional cleaning steps removing (i) tokens with more than 30 characters (often URLs), (ii) sentences with less than 5 or more than 200 tokens, and (iii) sentences containing a high fraction of special characters like ':' usually indicating Wikipedia-specific artifacts like lists of language links.