The key takeout of our model is that we use some feature modeling to show that for a morphologically rich language such as Bulgarian using POS and grammatical information can improve the results.
we mix automatically learned features -the word and the character embeddings -, with hand-crafted features encoded as a grammatical vector.