To model communication in this sense, in our research we employ features based on the information-theoretic notion of surprisal or information density.
we make use of information theory inspired features on the linguistic levels of lexis, part-of-speech and syntax.