As shown in Table 4, the additional language model only introduces 23.6% more training time, since it does not involve expensive attention computation.
nLG-LM can offer more natural response generation with comparable efficiency.