(2018), unlike traditional word type embeddings, each token is assigned a representation that is a function of the entire input sentence.
the authors use vectors derived from a bidirectional long short-term memory network (LSTM) that is trained with a coupled language model in order to build contextualized vectors.