Overall, the addition of these hand-crafted features to our best systems do not provide improvements as high as one might have hoped.
we investigate three well-known word embeddings, namely Collobert and Weston (Collobert and Weston, 2008), hierarchical log-bilinear model (Mnih and Hinton, 2007) and Hellinger Principal Component Analysis (Lebret and Collobert, 2014), in addition to Brown clusterbased and standard one-hot representations.