This paper presents a new, efficient method for learning task-specific word vectors using a variant of the Passive-Aggressive algorithm.
this algorithm learns a word embedding matrix in tandem with the classifier parameters in an online fashion, solving a biconvex constrained optimization at each iteration.