Each character x i in the source sentence x is mapped to the corresponding d ce -dimensional row vector c i of a learnable d voc × d ce embedding matrix, initialized with a random uniform distribution with mean 0 and variance 1.
we experiment with both character embeddings and pre-trained word embeddings, using several embedding models, and we achieve a state-of-theart F 1 score on an Arabic spelling correction task.