A large body of work on word embeddings demonstrates that a generic text representation, trained in an unsupervised fashion on large corpora, is useful.
we take the view that group (i) models, end-to-end learning without any representation learning, is not a good general approach for NLP.