Where speed is more important, it may be worth considering a system that employs a smaller character embedding and does without POS tags, using just pre-trained embeddings.
in the simplest case, we set x i equal to the word embedding e r (w i ): The superscript r refers to the fact that the word embeddings are initialised randomly at training time.