These attributes suggest that CLMs can model regularities that exist within words, such as morphological inflection.
even large language modeling (LM) corpora have sparse coverage of inflected forms for morphologically-rich languages, which has been shown to make word and character language modeling more difficult (Gerz et al., 2018b;Cotterell et al., 2018).