Finally, we also input as onehot vectors external lexicon information, constructed using the Lefff lexicon (Sagot, 2010).
these word embeddings can be initialized with pretrained embeddings and/or learned when training the model.