In all of these cases, the model for composing embeddings of subword units into word embeddings is learned by optimizing an objective over a large unlabeled corpus.
unlike prior work, MIMICK does not require retraining on the original word embedding corpus; instead, learning is performed at the type level.