We achieve this by applying our novel residual bypass function to our character representations, inspired by the success of ResNets.
we first apply the bypass to a CNN-based model achieving large gains over a plain CNN, and later evaluate its effectiveness in a ResNet.