We also hope to apply the model to other languages with complicated compositional writing systems, potentially including historical texts such as hieroglyphics or cuneiform.
this one-hot vector is then multiplied by the lookup matrix t C ∈ R |C|×dc , where d c is the dimension of the character embedding.