Recent results have shown that better word representations can lead to significantly improved performance in sequence tagging tasks (Peters et al., 2017).
we first map each token w i into two embedding channels e (w) i and e (c) i .