In retrospect, our NPYLM is essentially a hierarchical Markov model where the units (=words) evolve as the Markov process, and each unit has subunits (=characters) that also evolve as the Markov process.
for such languages as English that have already space-separated tokens, we can also begin with tokens besides the character-based approach in Section 5.3.