We also test the effectiveness of using pretrained word embeddings.
for VG-NSL+HI+FastText, we use a pre-trained FastText  embedding (300-D, Joulin et al., 2016), concatenated with a 212-D trainable embedding, as the word embedding.