A shared embedding look-up is used for all text features ( Figure 1b).
we embed all unigrams and bigrams to get 300-dimensional averaged unigram embeddings and 300-dimensional averaged bigram embeddings for each text feature.