We concatenate these character representations to constitute a word, which is represented as r ∈ R |Vc|×n where V c is a vocabulary of characters and n is the length of a word.
the input representation for convolution has the following shape: where c i is a one-hot encoding for representing the i-th character in a word and ⊕ is a concatenation operator.