For example, if we have never seen the word houses in language model training, but have examples of house, we still can expect houses are to be more probable than houses fly.
factors allow us to collect improved statistics on sparse data.