• To leverage character level information, for each word x L i , there is a character sequence where p is the number of characters in word X L i , and V Lc is the number of different characters in language L. Then, we project these input signals from high dimensional space of token id into dense vector spaces using look-up tables.
we have tag are look-up tables for English/IL word, English/IL character, and English tag respectively.