Therefore, it is easy to use standard stochastic gradient descent algorithms to train our model.
a major difficulty in calculating gradients is that the algorithm needs to sum over all candidate translations in an exponential search space for KL divergence.