Therefore, we adopt the ratio of differences (dif ) between training costs of two training iterations to be the criterion, It should be noted that some of dif x,y are negative.
the costs of some sentence pairs even increase after one epoch training.