For example, in Figure 1, NEO estimates the date of a document to be 1958, since it is clear that Sputnik, the most recent word used in the document, sprung into popular use in 1958.
when the regularizer is properly enabled (α = 0.16), observe how the output probability distribution is much smoother and neighboring probability values are more similar.