If linguistic variability and noise only occur on the token level, then a tokenization-free approach has fewer advantages.
the foregoing discussion of cross-token regularities and disambiguation applies to well-edited English text as much as it does to other languages and other text-types as the example of "exchange" shows (which is dis-ambiguated by prior context and provides disambiguating context to following words) and as is also exemplified by lines 5-9 in Table 2 (right).