As suggested by Chen and Manning (2014), we apply drop-out, a form of regularization for both source and target language.
we randomly drop some of the activation units from both hidden layer and input layer.