These studies, however, did not incorporate dynamic representations in the input layer.
the resulting novel model, Dynamic Neural text Model, uses the dynamic word embeddings that are constructed from the context in the output and input layers of an RNLM, as shown in Figures 1 and 2.