One of the most successful approaches to grammatical error correction (GEC) is to cast the problem as (monolingual) machine translation (MT), where we translate from possibly ungrammatical English sentences to corrected ones (Brockett et al., 2006;Gao et al., 2010;Junczys-Dowmunt and Grundkiewicz, 2016).
the next hidden stated s is then defined as: where y s−1 is the embedding of the output token at time s-1.