In turn, this allows the Sequential-CG component to preserve more probability mass to explain the intermediate content words.
the Sequential-CG component only needs to model words that reflect useful statistical sequential patterns, without expending modeling effort on background content (common words) or noise (rare words).