Popular word representations for classification train word embeddings using the context of each word (a window around the word, e.g., in skip-gram or continuous bag of words methods) (Mikolov et al., 2013;Bojanowski et al., 2016).
we seek to understand how semantic contexts of words shift across time, in addition to the words themselves.