Following their results, we also introduce syntactic features into the embedding layer.
we combine the surface token embedding w i , POS embedding p i , and dependency relation label embedding r i into a single vector as follows: where [] represents vector concatenation, and e i is an embedding of token x i .