We achieve this by applying our novel residual bypass function to our character representations, inspired by the success of ResNets.
gRUs  are a recently introduced variant of RNNs, and are designed to prevent vanishing gradients, thus being able to cope with longer input sequences than vanilla RNNs.