Another strand of work focuses on generating diachronic word embeddings (Kutuzov et al., 2018), aiming to learn word representations across time (Bamler and Mandt, 2017;Rosenfeld and Erk, 2018;Yao et al., 2018;Rudolph and Blei, 2018).
these are often hard and slow to train under a massive dataset, such as the UK Web Archive.