An inspiration from the ripples created by the success of pre-training and as well as word2vec, this paper explores pre-training to utilize data from a related domain and also pre-trained vectors from word2vec tool (Mikolov et al., 2013).
finding an optimal dimension for these pre-trained vectors and other involved hyper-parameters requires computationally extensive experiments.