In this paper we present the Pivot Based Language Model (PBLM), a representation learning model that marries together pivot-based and NN modeling in a structure aware manner.
our model processes the information in the text with a sequential NN (LSTM) and its output consists of a context-dependent representation vector for every input word.