This might be because the scorer modules are able to correct the details from the Gaussian alignment based on the relevance of the encoder states in the current decoder states.
we conclude that alignment with the scorer is essential for our proposed models.