In addition to the forward pass, the Char-Bi-RNN also processes the character sequence backwards (symbolised by ← − h c i,j ) with another set of GRU weight matrices and bias terms.
this sacrifices the meaning of the unknown word which may be critical.