On the one hand, there has been a growing interest in the linguistic information that may be ultimately encoded in vectorial representations (Be-linkov et al., 2017;Conneau et al., 2018), also relating to their eventual "universality", in view of possibly transferring these representations from one language processing task or application to another (Shi et al., 2016;Cífka and Bojar, 2018).
growing attention has been devoted to sources of information for word embeddings other than what may be conveyed and extracted from co-occurrences in text.