These models have improved the language generation tasks to a great extent, e.g., (Mikolov et al., 2010;Galley et al., 2015).
while generating text or code with a large number of named entities (e.g., different variable names in source code), these models often fail to predict the entity names properly due to their wide variations.