This is in contrast to earlier studies (Sahu and Anand, 2017;Collobert and Weston, 2008) where pretrained embeddings Model i2b2-2010 DDI extraction Precision Recall F1 score Precision Recall F1 score SVM (Rink et al., 2011) 67    usually improved model performances by 3-4%.
this result aligns with the observations made in (Johnson and Zhang, 2015) and supports the argument for one-hot LSTMs.