We define a projection layer P C ∈ R d C ×|C| , where d C is the number of parameters for each character in the character set C. This of course just a character lookup table, and is used to capture similarities between characters in a language (e.g., vowels vs. consonants).
we write the projection of each input character c i as e Given the input vectors x 1 , .