Using the proposed model, by combining embedding vectors and attention at both word and character levels, we model all contextual words, including OOVs, in a unified context vector representation.
as we will discuss in Section 5, the character-level attention layer captures most useful information for correcting local errors that involve small edits in orthography.